Quantitative evaluation of multiplicity in epidemiology and public health research

Research output: Contribution to journalArticle

59 Citations (Scopus)

Abstract

Epidemiologic and public health researchers frequently include several dependent variables, repeated assessments, or subgroup analyses in their investigations. These factors result in multiple tests of statistical significance and may produce type 1 experimental errors. This study examined the type 1 error rate in a sample of public health and epidemiologic research. A total of 173 articles chosen at random from 1996 issues of the American Journal of Public Health and the American Journal of Epidemiology were examined to determine the incidence of type 1 errors. Three different methods of computing type 1 error rates were used: experiment-wise error rate, error rate per experiment, and percent error rate. The results indicate a type 1 error rate substantially higher than the traditionally assumed level of 5% (p < 0.05). No practical or statistically significant difference was found between type 1 error rates across the two journals. Methods to determine and correct type 1 errors should be reported in epidemiologic and public health research investigations that include multiple statistical tests.

Original languageEnglish (US)
Pages (from-to)615-619
Number of pages5
JournalAmerican Journal of Epidemiology
Volume147
Issue number7
StatePublished - Apr 1 1998

Fingerprint

Epidemiology
Public Health
Research
Research Personnel
Incidence

Keywords

  • Bias (epidemiology)
  • Probability
  • Research design
  • Significance tests

ASJC Scopus subject areas

  • Epidemiology

Cite this

Quantitative evaluation of multiplicity in epidemiology and public health research. / Ottenbacher, Kenneth.

In: American Journal of Epidemiology, Vol. 147, No. 7, 01.04.1998, p. 615-619.

Research output: Contribution to journalArticle

@article{406f7a97be254ddd913e0afe33edbd20,
title = "Quantitative evaluation of multiplicity in epidemiology and public health research",
abstract = "Epidemiologic and public health researchers frequently include several dependent variables, repeated assessments, or subgroup analyses in their investigations. These factors result in multiple tests of statistical significance and may produce type 1 experimental errors. This study examined the type 1 error rate in a sample of public health and epidemiologic research. A total of 173 articles chosen at random from 1996 issues of the American Journal of Public Health and the American Journal of Epidemiology were examined to determine the incidence of type 1 errors. Three different methods of computing type 1 error rates were used: experiment-wise error rate, error rate per experiment, and percent error rate. The results indicate a type 1 error rate substantially higher than the traditionally assumed level of 5{\%} (p < 0.05). No practical or statistically significant difference was found between type 1 error rates across the two journals. Methods to determine and correct type 1 errors should be reported in epidemiologic and public health research investigations that include multiple statistical tests.",
keywords = "Bias (epidemiology), Probability, Research design, Significance tests",
author = "Kenneth Ottenbacher",
year = "1998",
month = "4",
day = "1",
language = "English (US)",
volume = "147",
pages = "615--619",
journal = "American Journal of Epidemiology",
issn = "0002-9262",
publisher = "Oxford University Press",
number = "7",

}

TY - JOUR

T1 - Quantitative evaluation of multiplicity in epidemiology and public health research

AU - Ottenbacher, Kenneth

PY - 1998/4/1

Y1 - 1998/4/1

N2 - Epidemiologic and public health researchers frequently include several dependent variables, repeated assessments, or subgroup analyses in their investigations. These factors result in multiple tests of statistical significance and may produce type 1 experimental errors. This study examined the type 1 error rate in a sample of public health and epidemiologic research. A total of 173 articles chosen at random from 1996 issues of the American Journal of Public Health and the American Journal of Epidemiology were examined to determine the incidence of type 1 errors. Three different methods of computing type 1 error rates were used: experiment-wise error rate, error rate per experiment, and percent error rate. The results indicate a type 1 error rate substantially higher than the traditionally assumed level of 5% (p < 0.05). No practical or statistically significant difference was found between type 1 error rates across the two journals. Methods to determine and correct type 1 errors should be reported in epidemiologic and public health research investigations that include multiple statistical tests.

AB - Epidemiologic and public health researchers frequently include several dependent variables, repeated assessments, or subgroup analyses in their investigations. These factors result in multiple tests of statistical significance and may produce type 1 experimental errors. This study examined the type 1 error rate in a sample of public health and epidemiologic research. A total of 173 articles chosen at random from 1996 issues of the American Journal of Public Health and the American Journal of Epidemiology were examined to determine the incidence of type 1 errors. Three different methods of computing type 1 error rates were used: experiment-wise error rate, error rate per experiment, and percent error rate. The results indicate a type 1 error rate substantially higher than the traditionally assumed level of 5% (p < 0.05). No practical or statistically significant difference was found between type 1 error rates across the two journals. Methods to determine and correct type 1 errors should be reported in epidemiologic and public health research investigations that include multiple statistical tests.

KW - Bias (epidemiology)

KW - Probability

KW - Research design

KW - Significance tests

UR - http://www.scopus.com/inward/record.url?scp=0032054025&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032054025&partnerID=8YFLogxK

M3 - Article

C2 - 9554599

AN - SCOPUS:0032054025

VL - 147

SP - 615

EP - 619

JO - American Journal of Epidemiology

JF - American Journal of Epidemiology

SN - 0002-9262

IS - 7

ER -