How to detect effects: Statistical power and evidence-based practice in occupational therapy research

Research output: Contribution to journalArticle

30 Scopus citations

Abstract

The findings from 30 research investigations examining the effectiveness of occupational therapy interventions were reviewed and analyzed. The statistical conclusion validity was determined by computing post hoc power coefficients for the statistical hypothesis tests included in the examined studies. Data analysis revealed the median power values to detect small, medium, and large effect sizes were .09, .33, and .66, respectively. These results suggest a high probability of Type II errors in the sample of occupational therapy intervention research examined. In practical terms, this means the intervention produced a potentially useful treatment effect, but the effect was not detected as significant. Examples are provided that illustrate how low statistical power contributes to increases in Type II errors and inhibits the development of consensus through replication in the research literature. The presence of low-power studies with high rates of false negative findings prevents the establishment of guidelines for evidence-based practice and impedes the scientific progress of rehabilitation professions such as occupational therapy.

Original languageEnglish (US)
Pages (from-to)181-188
Number of pages8
JournalAmerican Journal of Occupational Therapy
Volume53
Issue number2
DOIs
StatePublished - Jan 1 1999

    Fingerprint

Keywords

  • Probability (statistics)
  • Quantitative method
  • Statistics

ASJC Scopus subject areas

  • Occupational Therapy

Cite this