Reliability and accuracy of visually analyzing graphed data from single-subject designs.

Research output: Contribution to journalArticle

45 Citations (Scopus)

Abstract

As the number of single-subject research reports in the occupational therapy literature increases, the reliability of clinical decisions made from single-subject data must be determined. This study examined the ability of occupational therapists to reliably and accurately analyze data from single-subject designs using visual inspection of graphed data. Forty-six therapists provided a rating on whether or not a clinically significant change in performance had occurred across the baseline and treatment phases for five graphs of hypothetical data. The results revealed that considerable disagreement existed in making visual judgments based on the five graphs. The data sets were also analyzed using a recently developed statistical procedure for use with single-subject data. The level of agreement between the quantitative analysis and the visual analysis was also poor, suggesting inconsistency in the ability to make accurate visual judgments of single-subject data. The advantages and limitations of graphic presentation and visual inspection of single-subject data are discussed and the argument is made that some form of quantitative analysis should generally be used in conjunction with the visual inspection of graphed data.

Original languageEnglish (US)
Pages (from-to)464-469
Number of pages6
JournalThe American journal of occupational therapy. : official publication of the American Occupational Therapy Association
Volume40
Issue number7
StatePublished - Jul 1986
Externally publishedYes

Fingerprint

Aptitude
Occupational Therapy
Therapeutics
Datasets
Occupational Therapists

ASJC Scopus subject areas

  • Rehabilitation
  • Health Professions(all)

Cite this

@article{d6cad9e4502741cca0b7fb8c985cb259,
title = "Reliability and accuracy of visually analyzing graphed data from single-subject designs.",
abstract = "As the number of single-subject research reports in the occupational therapy literature increases, the reliability of clinical decisions made from single-subject data must be determined. This study examined the ability of occupational therapists to reliably and accurately analyze data from single-subject designs using visual inspection of graphed data. Forty-six therapists provided a rating on whether or not a clinically significant change in performance had occurred across the baseline and treatment phases for five graphs of hypothetical data. The results revealed that considerable disagreement existed in making visual judgments based on the five graphs. The data sets were also analyzed using a recently developed statistical procedure for use with single-subject data. The level of agreement between the quantitative analysis and the visual analysis was also poor, suggesting inconsistency in the ability to make accurate visual judgments of single-subject data. The advantages and limitations of graphic presentation and visual inspection of single-subject data are discussed and the argument is made that some form of quantitative analysis should generally be used in conjunction with the visual inspection of graphed data.",
author = "Kenneth Ottenbacher",
year = "1986",
month = "7",
language = "English (US)",
volume = "40",
pages = "464--469",
journal = "American Journal of Occupational Therapy",
issn = "0272-9490",
publisher = "American Occupational Therapy Association, Inc",
number = "7",

}

TY - JOUR

T1 - Reliability and accuracy of visually analyzing graphed data from single-subject designs.

AU - Ottenbacher, Kenneth

PY - 1986/7

Y1 - 1986/7

N2 - As the number of single-subject research reports in the occupational therapy literature increases, the reliability of clinical decisions made from single-subject data must be determined. This study examined the ability of occupational therapists to reliably and accurately analyze data from single-subject designs using visual inspection of graphed data. Forty-six therapists provided a rating on whether or not a clinically significant change in performance had occurred across the baseline and treatment phases for five graphs of hypothetical data. The results revealed that considerable disagreement existed in making visual judgments based on the five graphs. The data sets were also analyzed using a recently developed statistical procedure for use with single-subject data. The level of agreement between the quantitative analysis and the visual analysis was also poor, suggesting inconsistency in the ability to make accurate visual judgments of single-subject data. The advantages and limitations of graphic presentation and visual inspection of single-subject data are discussed and the argument is made that some form of quantitative analysis should generally be used in conjunction with the visual inspection of graphed data.

AB - As the number of single-subject research reports in the occupational therapy literature increases, the reliability of clinical decisions made from single-subject data must be determined. This study examined the ability of occupational therapists to reliably and accurately analyze data from single-subject designs using visual inspection of graphed data. Forty-six therapists provided a rating on whether or not a clinically significant change in performance had occurred across the baseline and treatment phases for five graphs of hypothetical data. The results revealed that considerable disagreement existed in making visual judgments based on the five graphs. The data sets were also analyzed using a recently developed statistical procedure for use with single-subject data. The level of agreement between the quantitative analysis and the visual analysis was also poor, suggesting inconsistency in the ability to make accurate visual judgments of single-subject data. The advantages and limitations of graphic presentation and visual inspection of single-subject data are discussed and the argument is made that some form of quantitative analysis should generally be used in conjunction with the visual inspection of graphed data.

UR - http://www.scopus.com/inward/record.url?scp=0022745348&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0022745348&partnerID=8YFLogxK

M3 - Article

C2 - 3740198

AN - SCOPUS:0022745348

VL - 40

SP - 464

EP - 469

JO - American Journal of Occupational Therapy

JF - American Journal of Occupational Therapy

SN - 0272-9490

IS - 7

ER -