Guidelines for Designing and Evaluating Feasibility Pilot Studies

Jeanne A. Teresi, Xiaoying Yu, Anita L. Stewart, Ron D. Hays

Research output: Contribution to journalArticlepeer-review

47 Scopus citations

Abstract

Background: Pilot studies test the feasibility of methods and procedures to be used in larger-scale studies. Although numerous articles describe guidelines for the conduct of pilot studies, few have included specific feasibility indicators or strategies for evaluating multiple aspects of feasibility. In addition, using pilot studies to estimate effect sizes to plan sample sizes for subsequent randomized controlled trials has been challenged; however, there has been little consensus on alternative strategies. Methods: In Section 1, specific indicators (recruitment, retention, intervention fidelity, acceptability, adherence, and engagement) are presented for feasibility assessment of data collection methods and intervention implementation. Section 1 also highlights the importance of examining feasibility when adapting an intervention tested in mainstream populations to a new more diverse group. In Section 2, statistical and design issues are presented, including sample sizes for pilot studies, estimates of minimally important differences, design effects, confidence intervals (CI) and nonparametric statistics. An in-depth treatment of the limits of effect size estimation as well as process variables is presented. Tables showing CI around parameters are provided. With small samples, effect size, completion and adherence rate estimates will have large CI. Conclusion: This commentary offers examples of indicators for evaluating feasibility, and of the limits of effect size estimation in pilot studies. As demonstrated, most pilot studies should not be used to estimate effect sizes, provide power calculations for statistical tests or perform exploratory analyses of efficacy. It is hoped that these guidelines will be useful to those planning pilot/feasibility studies before a larger-scale study.

Original languageEnglish (US)
Pages (from-to)95-103
Number of pages9
JournalMedical care
Volume60
Issue number1
DOIs
StatePublished - Jan 1 2022

Keywords

  • confidence intervals
  • diversity
  • feasibility
  • guidelines
  • pilot studies
  • statistical issues

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Fingerprint

Dive into the research topics of 'Guidelines for Designing and Evaluating Feasibility Pilot Studies'. Together they form a unique fingerprint.

Cite this