Impact of random assignment on study outcome

An empirical examination

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

Sixty research investigations published in the biomedical literature were analyzed to examine the effect of design attributes on outcome. All 60 studies included a controlled trial involving a pretest, a therapeutic intervention, and a posttest across at least two groups. Thirty of the trials used random assignment of participants to treatment or control conditions and 30 trials employed some nonrandom method of subject assignment. Trial results were aggregated and evaluated by comparing effect sizes for the primary statistical test of the hypothesis. Data analysis revealed that the trial results, as measured by effect size, did not vary across therapeutic trials using random assignment versus those using nonrandom allocation of subjects. The impact of design attributes in the interpretation of multiple clinical trials addressing a similar research question is examined. The argument is made that various design attributes frequently associated with methodological quality should be considered as important moderator variables and their influence on trial outcome should not be assumed a priori but rather examined empirically.

Original languageEnglish (US)
Pages (from-to)50-61
Number of pages12
JournalControlled Clinical Trials
Volume13
Issue number1
DOIs
StatePublished - 1992
Externally publishedYes

Fingerprint

Outcome Assessment (Health Care)
Epidemiologic Effect Modifiers
Research
Clinical Trials
Therapeutics

Keywords

  • data analysis
  • interpretation
  • Research design

ASJC Scopus subject areas

  • Pharmacology

Cite this

Impact of random assignment on study outcome : An empirical examination. / Ottenbacher, Kenneth.

In: Controlled Clinical Trials, Vol. 13, No. 1, 1992, p. 50-61.

Research output: Contribution to journalArticle

@article{33da33297af04121ac53df242196f54a,
title = "Impact of random assignment on study outcome: An empirical examination",
abstract = "Sixty research investigations published in the biomedical literature were analyzed to examine the effect of design attributes on outcome. All 60 studies included a controlled trial involving a pretest, a therapeutic intervention, and a posttest across at least two groups. Thirty of the trials used random assignment of participants to treatment or control conditions and 30 trials employed some nonrandom method of subject assignment. Trial results were aggregated and evaluated by comparing effect sizes for the primary statistical test of the hypothesis. Data analysis revealed that the trial results, as measured by effect size, did not vary across therapeutic trials using random assignment versus those using nonrandom allocation of subjects. The impact of design attributes in the interpretation of multiple clinical trials addressing a similar research question is examined. The argument is made that various design attributes frequently associated with methodological quality should be considered as important moderator variables and their influence on trial outcome should not be assumed a priori but rather examined empirically.",
keywords = "data analysis, interpretation, Research design",
author = "Kenneth Ottenbacher",
year = "1992",
doi = "10.1016/0197-2456(92)90029-Y",
language = "English (US)",
volume = "13",
pages = "50--61",
journal = "Controlled Clinical Trials",
issn = "0197-2456",
publisher = "Elsevier BV",
number = "1",

}

TY - JOUR

T1 - Impact of random assignment on study outcome

T2 - An empirical examination

AU - Ottenbacher, Kenneth

PY - 1992

Y1 - 1992

N2 - Sixty research investigations published in the biomedical literature were analyzed to examine the effect of design attributes on outcome. All 60 studies included a controlled trial involving a pretest, a therapeutic intervention, and a posttest across at least two groups. Thirty of the trials used random assignment of participants to treatment or control conditions and 30 trials employed some nonrandom method of subject assignment. Trial results were aggregated and evaluated by comparing effect sizes for the primary statistical test of the hypothesis. Data analysis revealed that the trial results, as measured by effect size, did not vary across therapeutic trials using random assignment versus those using nonrandom allocation of subjects. The impact of design attributes in the interpretation of multiple clinical trials addressing a similar research question is examined. The argument is made that various design attributes frequently associated with methodological quality should be considered as important moderator variables and their influence on trial outcome should not be assumed a priori but rather examined empirically.

AB - Sixty research investigations published in the biomedical literature were analyzed to examine the effect of design attributes on outcome. All 60 studies included a controlled trial involving a pretest, a therapeutic intervention, and a posttest across at least two groups. Thirty of the trials used random assignment of participants to treatment or control conditions and 30 trials employed some nonrandom method of subject assignment. Trial results were aggregated and evaluated by comparing effect sizes for the primary statistical test of the hypothesis. Data analysis revealed that the trial results, as measured by effect size, did not vary across therapeutic trials using random assignment versus those using nonrandom allocation of subjects. The impact of design attributes in the interpretation of multiple clinical trials addressing a similar research question is examined. The argument is made that various design attributes frequently associated with methodological quality should be considered as important moderator variables and their influence on trial outcome should not be assumed a priori but rather examined empirically.

KW - data analysis

KW - interpretation

KW - Research design

UR - http://www.scopus.com/inward/record.url?scp=0026573754&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026573754&partnerID=8YFLogxK

U2 - 10.1016/0197-2456(92)90029-Y

DO - 10.1016/0197-2456(92)90029-Y

M3 - Article

VL - 13

SP - 50

EP - 61

JO - Controlled Clinical Trials

JF - Controlled Clinical Trials

SN - 0197-2456

IS - 1

ER -