Measurement variation in method comparison studies: An empirical examination

Kenneth Ottenbacher, S. D. Tomchek

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

Procedures commonly used in rehabilitation research to analyze data from method comparison studies were examined. A simulation study was conducted in which different types of measurement variation were introduced to a reference set of range of motion (ROM) values. The test ROM data included individual data sets with random variation, alternate variation, constant variation, and proportional variation. Comparisons were made between original ROM reference values and simulated test ROM data. The statistical comparisons involved Pearson product-moment correlation, least square regression, t tests, and intraclass correlation coefficients. The individual data sets were also presented graphically using a method referred to as limits of agreement. The analyses revealed Pearson product-moment correlations, t tests, and other commonly used statistical procedures were not sensitive to different types of measurement variation in evaluating the results of method comparison investigations. The findings indicate that the limits of agreement technique, based on plotting difference scores against mean values, provided the most accurate estimation of measurement error. The advantages and limitations of various procedures to analyze agreement between rehabilitation assessment methods are described.

Original languageEnglish (US)
Pages (from-to)505-512
Number of pages8
JournalArchives of Physical Medicine and Rehabilitation
Volume75
Issue number5
StatePublished - 1994
Externally publishedYes

Fingerprint

Articular Range of Motion
Reference Values
Least-Squares Analysis
Rehabilitation
Datasets

ASJC Scopus subject areas

  • Rehabilitation

Cite this

Measurement variation in method comparison studies : An empirical examination. / Ottenbacher, Kenneth; Tomchek, S. D.

In: Archives of Physical Medicine and Rehabilitation, Vol. 75, No. 5, 1994, p. 505-512.

Research output: Contribution to journalArticle

@article{7a2bf1b8873c48cdb48198c6126dbe79,
title = "Measurement variation in method comparison studies: An empirical examination",
abstract = "Procedures commonly used in rehabilitation research to analyze data from method comparison studies were examined. A simulation study was conducted in which different types of measurement variation were introduced to a reference set of range of motion (ROM) values. The test ROM data included individual data sets with random variation, alternate variation, constant variation, and proportional variation. Comparisons were made between original ROM reference values and simulated test ROM data. The statistical comparisons involved Pearson product-moment correlation, least square regression, t tests, and intraclass correlation coefficients. The individual data sets were also presented graphically using a method referred to as limits of agreement. The analyses revealed Pearson product-moment correlations, t tests, and other commonly used statistical procedures were not sensitive to different types of measurement variation in evaluating the results of method comparison investigations. The findings indicate that the limits of agreement technique, based on plotting difference scores against mean values, provided the most accurate estimation of measurement error. The advantages and limitations of various procedures to analyze agreement between rehabilitation assessment methods are described.",
author = "Kenneth Ottenbacher and Tomchek, {S. D.}",
year = "1994",
language = "English (US)",
volume = "75",
pages = "505--512",
journal = "Archives of Physical Medicine and Rehabilitation",
issn = "0003-9993",
publisher = "W.B. Saunders Ltd",
number = "5",

}

TY - JOUR

T1 - Measurement variation in method comparison studies

T2 - An empirical examination

AU - Ottenbacher, Kenneth

AU - Tomchek, S. D.

PY - 1994

Y1 - 1994

N2 - Procedures commonly used in rehabilitation research to analyze data from method comparison studies were examined. A simulation study was conducted in which different types of measurement variation were introduced to a reference set of range of motion (ROM) values. The test ROM data included individual data sets with random variation, alternate variation, constant variation, and proportional variation. Comparisons were made between original ROM reference values and simulated test ROM data. The statistical comparisons involved Pearson product-moment correlation, least square regression, t tests, and intraclass correlation coefficients. The individual data sets were also presented graphically using a method referred to as limits of agreement. The analyses revealed Pearson product-moment correlations, t tests, and other commonly used statistical procedures were not sensitive to different types of measurement variation in evaluating the results of method comparison investigations. The findings indicate that the limits of agreement technique, based on plotting difference scores against mean values, provided the most accurate estimation of measurement error. The advantages and limitations of various procedures to analyze agreement between rehabilitation assessment methods are described.

AB - Procedures commonly used in rehabilitation research to analyze data from method comparison studies were examined. A simulation study was conducted in which different types of measurement variation were introduced to a reference set of range of motion (ROM) values. The test ROM data included individual data sets with random variation, alternate variation, constant variation, and proportional variation. Comparisons were made between original ROM reference values and simulated test ROM data. The statistical comparisons involved Pearson product-moment correlation, least square regression, t tests, and intraclass correlation coefficients. The individual data sets were also presented graphically using a method referred to as limits of agreement. The analyses revealed Pearson product-moment correlations, t tests, and other commonly used statistical procedures were not sensitive to different types of measurement variation in evaluating the results of method comparison investigations. The findings indicate that the limits of agreement technique, based on plotting difference scores against mean values, provided the most accurate estimation of measurement error. The advantages and limitations of various procedures to analyze agreement between rehabilitation assessment methods are described.

UR - http://www.scopus.com/inward/record.url?scp=0028236817&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028236817&partnerID=8YFLogxK

M3 - Article

C2 - 8185441

AN - SCOPUS:0028236817

VL - 75

SP - 505

EP - 512

JO - Archives of Physical Medicine and Rehabilitation

JF - Archives of Physical Medicine and Rehabilitation

SN - 0003-9993

IS - 5

ER -