Epistemology and experimentation

an examination of quality factors in research design.

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Forty-four research articles published in the occupational therapy literature were examined to determine the effect of design quality on study outcome. All 44 of the studies examined involved a parallel-groups comparison design. Twenty-two of the studies included random assignment of subjects to various groups, and the remaining 22 investigations used some nonrandom method to determine subject allocation. A standardized metric (i.e., effect size) was used to determine the effect of the independent variable in the 44 studies. The data analysis revealed that effect-size values were not significantly different between studies that involved random assignment and those not involving random assignment. The argument is made that such design characteristics as random assignment should be examined as moderator variables in any attempt to synthesize findings from multiple studies. Such an approach would treat the design used in a study as one of many possible variables that could influence the outcome. This approach would modify the a priori assumption that one research design is inherently superior to another regardless of the research question or context.

Original languageEnglish (US)
Pages (from-to)917-923
Number of pages7
JournalThe American journal of occupational therapy. : official publication of the American Occupational Therapy Association
Volume45
Issue number10
StatePublished - Oct 1991
Externally publishedYes

Fingerprint

Research Design
Epidemiologic Effect Modifiers
Occupational Therapy
Research
Outcome Assessment (Health Care)

ASJC Scopus subject areas

  • Rehabilitation
  • Health Professions(all)

Cite this

@article{c4d370dd0a604bd09e6019b12362c085,
title = "Epistemology and experimentation: an examination of quality factors in research design.",
abstract = "Forty-four research articles published in the occupational therapy literature were examined to determine the effect of design quality on study outcome. All 44 of the studies examined involved a parallel-groups comparison design. Twenty-two of the studies included random assignment of subjects to various groups, and the remaining 22 investigations used some nonrandom method to determine subject allocation. A standardized metric (i.e., effect size) was used to determine the effect of the independent variable in the 44 studies. The data analysis revealed that effect-size values were not significantly different between studies that involved random assignment and those not involving random assignment. The argument is made that such design characteristics as random assignment should be examined as moderator variables in any attempt to synthesize findings from multiple studies. Such an approach would treat the design used in a study as one of many possible variables that could influence the outcome. This approach would modify the a priori assumption that one research design is inherently superior to another regardless of the research question or context.",
author = "Kenneth Ottenbacher",
year = "1991",
month = "10",
language = "English (US)",
volume = "45",
pages = "917--923",
journal = "American Journal of Occupational Therapy",
issn = "0272-9490",
publisher = "American Occupational Therapy Association, Inc",
number = "10",

}

TY - JOUR

T1 - Epistemology and experimentation

T2 - an examination of quality factors in research design.

AU - Ottenbacher, Kenneth

PY - 1991/10

Y1 - 1991/10

N2 - Forty-four research articles published in the occupational therapy literature were examined to determine the effect of design quality on study outcome. All 44 of the studies examined involved a parallel-groups comparison design. Twenty-two of the studies included random assignment of subjects to various groups, and the remaining 22 investigations used some nonrandom method to determine subject allocation. A standardized metric (i.e., effect size) was used to determine the effect of the independent variable in the 44 studies. The data analysis revealed that effect-size values were not significantly different between studies that involved random assignment and those not involving random assignment. The argument is made that such design characteristics as random assignment should be examined as moderator variables in any attempt to synthesize findings from multiple studies. Such an approach would treat the design used in a study as one of many possible variables that could influence the outcome. This approach would modify the a priori assumption that one research design is inherently superior to another regardless of the research question or context.

AB - Forty-four research articles published in the occupational therapy literature were examined to determine the effect of design quality on study outcome. All 44 of the studies examined involved a parallel-groups comparison design. Twenty-two of the studies included random assignment of subjects to various groups, and the remaining 22 investigations used some nonrandom method to determine subject allocation. A standardized metric (i.e., effect size) was used to determine the effect of the independent variable in the 44 studies. The data analysis revealed that effect-size values were not significantly different between studies that involved random assignment and those not involving random assignment. The argument is made that such design characteristics as random assignment should be examined as moderator variables in any attempt to synthesize findings from multiple studies. Such an approach would treat the design used in a study as one of many possible variables that could influence the outcome. This approach would modify the a priori assumption that one research design is inherently superior to another regardless of the research question or context.

UR - http://www.scopus.com/inward/record.url?scp=0026245910&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026245910&partnerID=8YFLogxK

M3 - Article

VL - 45

SP - 917

EP - 923

JO - American Journal of Occupational Therapy

JF - American Journal of Occupational Therapy

SN - 0272-9490

IS - 10

ER -