Statistical conclusion validity and type IV errors in rehabilitation research

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The incidence of type IV errors was examined in 71 rehabilitation research studies, including a two-way analysis of variance with a statistically significant interaction. The interpretation of the significant interaction was examined to determine whether it qualified as a type IV error. A type IV error was defined as the incorrect interpretation of a correctly rejected null hypothesis. Statistically significant interactions were classified in one of the following categories: (1) correct interpretation, (2) cell mean interpretation, (3) main effect interpretation, or (4) no interpretation. Interpretations classified as cell means or main effects were considered type IV errors. The analysis revealed that 21% of the interactions were correctly interpreted and 63% of the interactions were classified as type IV errors. The remaining 16% of the studies showed a statistically significant interaction but no interpretation. The implications of statistical conclusion validity and type IV errors are discussed, and methods to eliminate or reduce the incidence of type IV errors in rehabilitation research are pressented.

Original languageEnglish (US)
Pages (from-to)121-125
Number of pages5
JournalArchives of Physical Medicine and Rehabilitation
Volume73
Issue number2
StatePublished - 1992
Externally publishedYes

Fingerprint

Incidence
Analysis of Variance
Rehabilitation Research

Keywords

  • Research design
  • Statistical analysis

ASJC Scopus subject areas

  • Rehabilitation

Cite this

@article{d30cc1c2048e4d2c83ba86772ffb21fa,
title = "Statistical conclusion validity and type IV errors in rehabilitation research",
abstract = "The incidence of type IV errors was examined in 71 rehabilitation research studies, including a two-way analysis of variance with a statistically significant interaction. The interpretation of the significant interaction was examined to determine whether it qualified as a type IV error. A type IV error was defined as the incorrect interpretation of a correctly rejected null hypothesis. Statistically significant interactions were classified in one of the following categories: (1) correct interpretation, (2) cell mean interpretation, (3) main effect interpretation, or (4) no interpretation. Interpretations classified as cell means or main effects were considered type IV errors. The analysis revealed that 21{\%} of the interactions were correctly interpreted and 63{\%} of the interactions were classified as type IV errors. The remaining 16{\%} of the studies showed a statistically significant interaction but no interpretation. The implications of statistical conclusion validity and type IV errors are discussed, and methods to eliminate or reduce the incidence of type IV errors in rehabilitation research are pressented.",
keywords = "Research design, Statistical analysis",
author = "Kenneth Ottenbacher",
year = "1992",
language = "English (US)",
volume = "73",
pages = "121--125",
journal = "Archives of Physical Medicine and Rehabilitation",
issn = "0003-9993",
publisher = "W.B. Saunders Ltd",
number = "2",

}

TY - JOUR

T1 - Statistical conclusion validity and type IV errors in rehabilitation research

AU - Ottenbacher, Kenneth

PY - 1992

Y1 - 1992

N2 - The incidence of type IV errors was examined in 71 rehabilitation research studies, including a two-way analysis of variance with a statistically significant interaction. The interpretation of the significant interaction was examined to determine whether it qualified as a type IV error. A type IV error was defined as the incorrect interpretation of a correctly rejected null hypothesis. Statistically significant interactions were classified in one of the following categories: (1) correct interpretation, (2) cell mean interpretation, (3) main effect interpretation, or (4) no interpretation. Interpretations classified as cell means or main effects were considered type IV errors. The analysis revealed that 21% of the interactions were correctly interpreted and 63% of the interactions were classified as type IV errors. The remaining 16% of the studies showed a statistically significant interaction but no interpretation. The implications of statistical conclusion validity and type IV errors are discussed, and methods to eliminate or reduce the incidence of type IV errors in rehabilitation research are pressented.

AB - The incidence of type IV errors was examined in 71 rehabilitation research studies, including a two-way analysis of variance with a statistically significant interaction. The interpretation of the significant interaction was examined to determine whether it qualified as a type IV error. A type IV error was defined as the incorrect interpretation of a correctly rejected null hypothesis. Statistically significant interactions were classified in one of the following categories: (1) correct interpretation, (2) cell mean interpretation, (3) main effect interpretation, or (4) no interpretation. Interpretations classified as cell means or main effects were considered type IV errors. The analysis revealed that 21% of the interactions were correctly interpreted and 63% of the interactions were classified as type IV errors. The remaining 16% of the studies showed a statistically significant interaction but no interpretation. The implications of statistical conclusion validity and type IV errors are discussed, and methods to eliminate or reduce the incidence of type IV errors in rehabilitation research are pressented.

KW - Research design

KW - Statistical analysis

UR - http://www.scopus.com/inward/record.url?scp=0026554560&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026554560&partnerID=8YFLogxK

M3 - Article

VL - 73

SP - 121

EP - 125

JO - Archives of Physical Medicine and Rehabilitation

JF - Archives of Physical Medicine and Rehabilitation

SN - 0003-9993

IS - 2

ER -