A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive

Richard Castillo, Edward Castillo, David Fuentes, Moiz Ahmad, Abbie M. Wood, Michelle S. Ludwig, Thomas Guerrero

Research output: Contribution to journalArticle

43 Citations (Scopus)

Abstract

Landmark point-pairs provide a strategy to assess deformable image registration (DIR) accuracy in terms of the spatial registration of the underlying anatomy depicted in medical images. In this study, we propose to augment a publicly available database (www.dir-lab.com) of medical images with large sets of manually identified anatomic feature pairs between breath-hold computed tomography (BH-CT) images for DIR spatial accuracy evaluation. Ten BH-CT image pairs were randomly selected from the COPDgene study cases. Each patient had received CT imaging of the entire thorax in the supine position at one-fourth dose normal expiration and maximum effort full dose inspiration. Using dedicated in-house software, an imaging expert manually identified large sets of anatomic feature pairs between images. Estimates of inter- and intra-observer spatial variation in feature localization were determined by repeat measurements of multiple observers over subsets of randomly selected features. 7298 anatomic landmark features were manually paired between the 10 sets of images. Quantity of feature pairs per case ranged from 447 to 1172. Average 3D Euclidean landmark displacements varied substantially among cases, ranging from 12.29 (SD: 6.39) to 30.90 (SD: 14.05) mm. Repeat registration of uniformly sampled subsets of 150 landmarks for each case yielded estimates of observer localization error, which ranged in average from 0.58 (SD: 0.87) to 1.06 (SD: 2.38) mm for each case. The additions to the online web database (www.dir-lab.com) described in this work will broaden the applicability of the reference data, providing a freely available common dataset for targeted critical evaluation of DIR spatial accuracy performance in multiple clinical settings. Estimates of observer variance in feature localization suggest consistent spatial accuracy for all observers across both four-dimensional CT and COPDgene patient cohorts.

Original languageEnglish (US)
Pages (from-to)2861-2877
Number of pages17
JournalPhysics in Medicine and Biology
Volume58
Issue number9
DOIs
StatePublished - May 7 2013
Externally publishedYes

Fingerprint

Four-Dimensional Computed Tomography
Tomography
Databases
Anatomic Landmarks
Observer Variation
Supine Position
Anatomy
Thorax
Software
Datasets

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology

Cite this

A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive. / Castillo, Richard; Castillo, Edward; Fuentes, David; Ahmad, Moiz; Wood, Abbie M.; Ludwig, Michelle S.; Guerrero, Thomas.

In: Physics in Medicine and Biology, Vol. 58, No. 9, 07.05.2013, p. 2861-2877.

Research output: Contribution to journalArticle

Castillo, R, Castillo, E, Fuentes, D, Ahmad, M, Wood, AM, Ludwig, MS & Guerrero, T 2013, 'A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive', Physics in Medicine and Biology, vol. 58, no. 9, pp. 2861-2877. https://doi.org/10.1088/0031-9155/58/9/2861
Castillo, Richard ; Castillo, Edward ; Fuentes, David ; Ahmad, Moiz ; Wood, Abbie M. ; Ludwig, Michelle S. ; Guerrero, Thomas. / A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive. In: Physics in Medicine and Biology. 2013 ; Vol. 58, No. 9. pp. 2861-2877.
@article{b4626700946c42008207fc1080e90ba4,
title = "A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive",
abstract = "Landmark point-pairs provide a strategy to assess deformable image registration (DIR) accuracy in terms of the spatial registration of the underlying anatomy depicted in medical images. In this study, we propose to augment a publicly available database (www.dir-lab.com) of medical images with large sets of manually identified anatomic feature pairs between breath-hold computed tomography (BH-CT) images for DIR spatial accuracy evaluation. Ten BH-CT image pairs were randomly selected from the COPDgene study cases. Each patient had received CT imaging of the entire thorax in the supine position at one-fourth dose normal expiration and maximum effort full dose inspiration. Using dedicated in-house software, an imaging expert manually identified large sets of anatomic feature pairs between images. Estimates of inter- and intra-observer spatial variation in feature localization were determined by repeat measurements of multiple observers over subsets of randomly selected features. 7298 anatomic landmark features were manually paired between the 10 sets of images. Quantity of feature pairs per case ranged from 447 to 1172. Average 3D Euclidean landmark displacements varied substantially among cases, ranging from 12.29 (SD: 6.39) to 30.90 (SD: 14.05) mm. Repeat registration of uniformly sampled subsets of 150 landmarks for each case yielded estimates of observer localization error, which ranged in average from 0.58 (SD: 0.87) to 1.06 (SD: 2.38) mm for each case. The additions to the online web database (www.dir-lab.com) described in this work will broaden the applicability of the reference data, providing a freely available common dataset for targeted critical evaluation of DIR spatial accuracy performance in multiple clinical settings. Estimates of observer variance in feature localization suggest consistent spatial accuracy for all observers across both four-dimensional CT and COPDgene patient cohorts.",
author = "Richard Castillo and Edward Castillo and David Fuentes and Moiz Ahmad and Wood, {Abbie M.} and Ludwig, {Michelle S.} and Thomas Guerrero",
year = "2013",
month = "5",
day = "7",
doi = "10.1088/0031-9155/58/9/2861",
language = "English (US)",
volume = "58",
pages = "2861--2877",
journal = "Physics in Medicine and Biology",
issn = "0031-9155",
publisher = "IOP Publishing Ltd.",
number = "9",

}

TY - JOUR

T1 - A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive

AU - Castillo, Richard

AU - Castillo, Edward

AU - Fuentes, David

AU - Ahmad, Moiz

AU - Wood, Abbie M.

AU - Ludwig, Michelle S.

AU - Guerrero, Thomas

PY - 2013/5/7

Y1 - 2013/5/7

N2 - Landmark point-pairs provide a strategy to assess deformable image registration (DIR) accuracy in terms of the spatial registration of the underlying anatomy depicted in medical images. In this study, we propose to augment a publicly available database (www.dir-lab.com) of medical images with large sets of manually identified anatomic feature pairs between breath-hold computed tomography (BH-CT) images for DIR spatial accuracy evaluation. Ten BH-CT image pairs were randomly selected from the COPDgene study cases. Each patient had received CT imaging of the entire thorax in the supine position at one-fourth dose normal expiration and maximum effort full dose inspiration. Using dedicated in-house software, an imaging expert manually identified large sets of anatomic feature pairs between images. Estimates of inter- and intra-observer spatial variation in feature localization were determined by repeat measurements of multiple observers over subsets of randomly selected features. 7298 anatomic landmark features were manually paired between the 10 sets of images. Quantity of feature pairs per case ranged from 447 to 1172. Average 3D Euclidean landmark displacements varied substantially among cases, ranging from 12.29 (SD: 6.39) to 30.90 (SD: 14.05) mm. Repeat registration of uniformly sampled subsets of 150 landmarks for each case yielded estimates of observer localization error, which ranged in average from 0.58 (SD: 0.87) to 1.06 (SD: 2.38) mm for each case. The additions to the online web database (www.dir-lab.com) described in this work will broaden the applicability of the reference data, providing a freely available common dataset for targeted critical evaluation of DIR spatial accuracy performance in multiple clinical settings. Estimates of observer variance in feature localization suggest consistent spatial accuracy for all observers across both four-dimensional CT and COPDgene patient cohorts.

AB - Landmark point-pairs provide a strategy to assess deformable image registration (DIR) accuracy in terms of the spatial registration of the underlying anatomy depicted in medical images. In this study, we propose to augment a publicly available database (www.dir-lab.com) of medical images with large sets of manually identified anatomic feature pairs between breath-hold computed tomography (BH-CT) images for DIR spatial accuracy evaluation. Ten BH-CT image pairs were randomly selected from the COPDgene study cases. Each patient had received CT imaging of the entire thorax in the supine position at one-fourth dose normal expiration and maximum effort full dose inspiration. Using dedicated in-house software, an imaging expert manually identified large sets of anatomic feature pairs between images. Estimates of inter- and intra-observer spatial variation in feature localization were determined by repeat measurements of multiple observers over subsets of randomly selected features. 7298 anatomic landmark features were manually paired between the 10 sets of images. Quantity of feature pairs per case ranged from 447 to 1172. Average 3D Euclidean landmark displacements varied substantially among cases, ranging from 12.29 (SD: 6.39) to 30.90 (SD: 14.05) mm. Repeat registration of uniformly sampled subsets of 150 landmarks for each case yielded estimates of observer localization error, which ranged in average from 0.58 (SD: 0.87) to 1.06 (SD: 2.38) mm for each case. The additions to the online web database (www.dir-lab.com) described in this work will broaden the applicability of the reference data, providing a freely available common dataset for targeted critical evaluation of DIR spatial accuracy performance in multiple clinical settings. Estimates of observer variance in feature localization suggest consistent spatial accuracy for all observers across both four-dimensional CT and COPDgene patient cohorts.

UR - http://www.scopus.com/inward/record.url?scp=84876480845&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876480845&partnerID=8YFLogxK

U2 - 10.1088/0031-9155/58/9/2861

DO - 10.1088/0031-9155/58/9/2861

M3 - Article

VL - 58

SP - 2861

EP - 2877

JO - Physics in Medicine and Biology

JF - Physics in Medicine and Biology

SN - 0031-9155

IS - 9

ER -