Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates

Steven A. Lieberman, Ann W. Frye, Stephanie D. Litwins, Karen A. Rasmusson, John R. Boulet

Research output: Contribution to journalArticle

12 Scopus citations

Abstract

Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

Original languageEnglish (US)
Pages (from-to)S48-S51
JournalAcademic Medicine
Volume78
Issue number10 SUPPL.
StatePublished - Oct 1 2003

    Fingerprint

ASJC Scopus subject areas

  • Education

Cite this

Lieberman, S. A., Frye, A. W., Litwins, S. D., Rasmusson, K. A., & Boulet, J. R. (2003). Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates. Academic Medicine, 78(10 SUPPL.), S48-S51.