Quality assurance assessment of diagnostic and radiation therapy-simulation CT image registration for head and neck radiation therapy: Anatomic region of interest-based comparison of rigid and deformable algorithms

Abdallah S R Mohamed, Manee Naad Ruangskul, Musaddiq J. Awan, Charles A. Baron, Jayashree Kalpathy-Cramer, Richard Castillo, Edward Castillo, Thomas M. Guerrero, Esengul Kocak-Uzel, Jinzhong Yang, Laurence E. Court, Michael E. Kantor, G. Brandon Gunn, Rivka R. Colen, Steven J. Frank, Adam S. Garden, David I. Rosenthal, Clifton D. Fuller

Research output: Contribution to journalArticle

27 Citations (Scopus)

Abstract

Purpose: To develop a quality assurance (QA) workflow by using a robust, curated, manually segmented anatomic region-of-interest (ROI) library as a benchmark for quantitative assessment of different image registration techniques used for head and neck radiation therapy-simulation computed tomography (CT) with diagnostic CT coregistration. Materials and Methods: Radiation therapy-simulation CT images and diagnostic CT images in 20 patients with head and neck squamous cell carcinoma treated with curative-intent intensity-modulated radiation therapy between August 2011 and May 2012 were retrospectively retrieved with institutional review board approval. Sixty-eight reference anatomic ROIs with gross tumor and nodal targets were then manually contoured on images from each examination. Diagnostic CT images were registered with simulation CT images rigidly and by using four deformable image registration (DIR) algorithms: atlas based, B-spline, demons, and optical flow. The resultant deformed ROIs were compared with manually contoured reference ROIs by using similarity coefficient metrics (ie, Dice similarity coefficient) and surface distance metrics (ie, 95% maximum Hausdorff distance). The nonparametric Steel test with control was used to compare different DIR algorithms with rigid image registration (RIR) by using the post hoc Wilcoxon signed-rank test for stratified metric comparison.. Results: A total of 2720 anatomic and 50 tumor and nodal ROIs were delineated. All DIR algorithms showed improved performance over RIR for anatomic and target ROI conformance, as shown for most comparison metrics (Steel test, P < .008 after Bonferroni correction). The performance of different algorithms varied substantially with stratification by specific anatomic structures or category and simulation CT section thickness. Conclusion: Development of a formal ROI-based QA workflow for registration assessment demonstrated improved performance with DIR techniques over RIR. After QA, DIR implementation should be the standard for head and neck diagnostic CT and simulation CT allineation, especially for target delineation.

Original languageEnglish (US)
Pages (from-to)752-763
Number of pages12
JournalRadiology
Volume274
Issue number3
DOIs
StatePublished - Mar 1 2015
Externally publishedYes

Fingerprint

Neck
Radiotherapy
Head
Tomography
Workflow
Steel
Benchmarking
Atlases
Research Ethics Committees
Nonparametric Statistics
Libraries
Neoplasms

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Quality assurance assessment of diagnostic and radiation therapy-simulation CT image registration for head and neck radiation therapy : Anatomic region of interest-based comparison of rigid and deformable algorithms. / Mohamed, Abdallah S R; Ruangskul, Manee Naad; Awan, Musaddiq J.; Baron, Charles A.; Kalpathy-Cramer, Jayashree; Castillo, Richard; Castillo, Edward; Guerrero, Thomas M.; Kocak-Uzel, Esengul; Yang, Jinzhong; Court, Laurence E.; Kantor, Michael E.; Gunn, G. Brandon; Colen, Rivka R.; Frank, Steven J.; Garden, Adam S.; Rosenthal, David I.; Fuller, Clifton D.

In: Radiology, Vol. 274, No. 3, 01.03.2015, p. 752-763.

Research output: Contribution to journalArticle

Mohamed, ASR, Ruangskul, MN, Awan, MJ, Baron, CA, Kalpathy-Cramer, J, Castillo, R, Castillo, E, Guerrero, TM, Kocak-Uzel, E, Yang, J, Court, LE, Kantor, ME, Gunn, GB, Colen, RR, Frank, SJ, Garden, AS, Rosenthal, DI & Fuller, CD 2015, 'Quality assurance assessment of diagnostic and radiation therapy-simulation CT image registration for head and neck radiation therapy: Anatomic region of interest-based comparison of rigid and deformable algorithms', Radiology, vol. 274, no. 3, pp. 752-763. https://doi.org/10.1148/radiol.14132871
Mohamed, Abdallah S R ; Ruangskul, Manee Naad ; Awan, Musaddiq J. ; Baron, Charles A. ; Kalpathy-Cramer, Jayashree ; Castillo, Richard ; Castillo, Edward ; Guerrero, Thomas M. ; Kocak-Uzel, Esengul ; Yang, Jinzhong ; Court, Laurence E. ; Kantor, Michael E. ; Gunn, G. Brandon ; Colen, Rivka R. ; Frank, Steven J. ; Garden, Adam S. ; Rosenthal, David I. ; Fuller, Clifton D. / Quality assurance assessment of diagnostic and radiation therapy-simulation CT image registration for head and neck radiation therapy : Anatomic region of interest-based comparison of rigid and deformable algorithms. In: Radiology. 2015 ; Vol. 274, No. 3. pp. 752-763.
@article{45b6fe15a2994363ab168e18154f64c8,
title = "Quality assurance assessment of diagnostic and radiation therapy-simulation CT image registration for head and neck radiation therapy: Anatomic region of interest-based comparison of rigid and deformable algorithms",
abstract = "Purpose: To develop a quality assurance (QA) workflow by using a robust, curated, manually segmented anatomic region-of-interest (ROI) library as a benchmark for quantitative assessment of different image registration techniques used for head and neck radiation therapy-simulation computed tomography (CT) with diagnostic CT coregistration. Materials and Methods: Radiation therapy-simulation CT images and diagnostic CT images in 20 patients with head and neck squamous cell carcinoma treated with curative-intent intensity-modulated radiation therapy between August 2011 and May 2012 were retrospectively retrieved with institutional review board approval. Sixty-eight reference anatomic ROIs with gross tumor and nodal targets were then manually contoured on images from each examination. Diagnostic CT images were registered with simulation CT images rigidly and by using four deformable image registration (DIR) algorithms: atlas based, B-spline, demons, and optical flow. The resultant deformed ROIs were compared with manually contoured reference ROIs by using similarity coefficient metrics (ie, Dice similarity coefficient) and surface distance metrics (ie, 95{\%} maximum Hausdorff distance). The nonparametric Steel test with control was used to compare different DIR algorithms with rigid image registration (RIR) by using the post hoc Wilcoxon signed-rank test for stratified metric comparison.. Results: A total of 2720 anatomic and 50 tumor and nodal ROIs were delineated. All DIR algorithms showed improved performance over RIR for anatomic and target ROI conformance, as shown for most comparison metrics (Steel test, P < .008 after Bonferroni correction). The performance of different algorithms varied substantially with stratification by specific anatomic structures or category and simulation CT section thickness. Conclusion: Development of a formal ROI-based QA workflow for registration assessment demonstrated improved performance with DIR techniques over RIR. After QA, DIR implementation should be the standard for head and neck diagnostic CT and simulation CT allineation, especially for target delineation.",
author = "Mohamed, {Abdallah S R} and Ruangskul, {Manee Naad} and Awan, {Musaddiq J.} and Baron, {Charles A.} and Jayashree Kalpathy-Cramer and Richard Castillo and Edward Castillo and Guerrero, {Thomas M.} and Esengul Kocak-Uzel and Jinzhong Yang and Court, {Laurence E.} and Kantor, {Michael E.} and Gunn, {G. Brandon} and Colen, {Rivka R.} and Frank, {Steven J.} and Garden, {Adam S.} and Rosenthal, {David I.} and Fuller, {Clifton D.}",
year = "2015",
month = "3",
day = "1",
doi = "10.1148/radiol.14132871",
language = "English (US)",
volume = "274",
pages = "752--763",
journal = "Radiology",
issn = "0033-8419",
publisher = "Radiological Society of North America Inc.",
number = "3",

}

TY - JOUR

T1 - Quality assurance assessment of diagnostic and radiation therapy-simulation CT image registration for head and neck radiation therapy

T2 - Anatomic region of interest-based comparison of rigid and deformable algorithms

AU - Mohamed, Abdallah S R

AU - Ruangskul, Manee Naad

AU - Awan, Musaddiq J.

AU - Baron, Charles A.

AU - Kalpathy-Cramer, Jayashree

AU - Castillo, Richard

AU - Castillo, Edward

AU - Guerrero, Thomas M.

AU - Kocak-Uzel, Esengul

AU - Yang, Jinzhong

AU - Court, Laurence E.

AU - Kantor, Michael E.

AU - Gunn, G. Brandon

AU - Colen, Rivka R.

AU - Frank, Steven J.

AU - Garden, Adam S.

AU - Rosenthal, David I.

AU - Fuller, Clifton D.

PY - 2015/3/1

Y1 - 2015/3/1

N2 - Purpose: To develop a quality assurance (QA) workflow by using a robust, curated, manually segmented anatomic region-of-interest (ROI) library as a benchmark for quantitative assessment of different image registration techniques used for head and neck radiation therapy-simulation computed tomography (CT) with diagnostic CT coregistration. Materials and Methods: Radiation therapy-simulation CT images and diagnostic CT images in 20 patients with head and neck squamous cell carcinoma treated with curative-intent intensity-modulated radiation therapy between August 2011 and May 2012 were retrospectively retrieved with institutional review board approval. Sixty-eight reference anatomic ROIs with gross tumor and nodal targets were then manually contoured on images from each examination. Diagnostic CT images were registered with simulation CT images rigidly and by using four deformable image registration (DIR) algorithms: atlas based, B-spline, demons, and optical flow. The resultant deformed ROIs were compared with manually contoured reference ROIs by using similarity coefficient metrics (ie, Dice similarity coefficient) and surface distance metrics (ie, 95% maximum Hausdorff distance). The nonparametric Steel test with control was used to compare different DIR algorithms with rigid image registration (RIR) by using the post hoc Wilcoxon signed-rank test for stratified metric comparison.. Results: A total of 2720 anatomic and 50 tumor and nodal ROIs were delineated. All DIR algorithms showed improved performance over RIR for anatomic and target ROI conformance, as shown for most comparison metrics (Steel test, P < .008 after Bonferroni correction). The performance of different algorithms varied substantially with stratification by specific anatomic structures or category and simulation CT section thickness. Conclusion: Development of a formal ROI-based QA workflow for registration assessment demonstrated improved performance with DIR techniques over RIR. After QA, DIR implementation should be the standard for head and neck diagnostic CT and simulation CT allineation, especially for target delineation.

AB - Purpose: To develop a quality assurance (QA) workflow by using a robust, curated, manually segmented anatomic region-of-interest (ROI) library as a benchmark for quantitative assessment of different image registration techniques used for head and neck radiation therapy-simulation computed tomography (CT) with diagnostic CT coregistration. Materials and Methods: Radiation therapy-simulation CT images and diagnostic CT images in 20 patients with head and neck squamous cell carcinoma treated with curative-intent intensity-modulated radiation therapy between August 2011 and May 2012 were retrospectively retrieved with institutional review board approval. Sixty-eight reference anatomic ROIs with gross tumor and nodal targets were then manually contoured on images from each examination. Diagnostic CT images were registered with simulation CT images rigidly and by using four deformable image registration (DIR) algorithms: atlas based, B-spline, demons, and optical flow. The resultant deformed ROIs were compared with manually contoured reference ROIs by using similarity coefficient metrics (ie, Dice similarity coefficient) and surface distance metrics (ie, 95% maximum Hausdorff distance). The nonparametric Steel test with control was used to compare different DIR algorithms with rigid image registration (RIR) by using the post hoc Wilcoxon signed-rank test for stratified metric comparison.. Results: A total of 2720 anatomic and 50 tumor and nodal ROIs were delineated. All DIR algorithms showed improved performance over RIR for anatomic and target ROI conformance, as shown for most comparison metrics (Steel test, P < .008 after Bonferroni correction). The performance of different algorithms varied substantially with stratification by specific anatomic structures or category and simulation CT section thickness. Conclusion: Development of a formal ROI-based QA workflow for registration assessment demonstrated improved performance with DIR techniques over RIR. After QA, DIR implementation should be the standard for head and neck diagnostic CT and simulation CT allineation, especially for target delineation.

UR - http://www.scopus.com/inward/record.url?scp=84924301770&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84924301770&partnerID=8YFLogxK

U2 - 10.1148/radiol.14132871

DO - 10.1148/radiol.14132871

M3 - Article

C2 - 25380454

AN - SCOPUS:84924301770

VL - 274

SP - 752

EP - 763

JO - Radiology

JF - Radiology

SN - 0033-8419

IS - 3

ER -