Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates

Steven Lieberman, Ann W. Frye, Stephanie D. Litwins, Karen A. Rasmusson, John R. Boulet

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

Original languageEnglish (US)
JournalAcademic Medicine
Volume78
Issue number10 SUPPL.
StatePublished - Oct 1 2003
Externally publishedYes

Fingerprint

video clip
Surgical Instruments
video
statistics
Psychometrics
psychometrics
neurology
Neurology
Neurologic Manifestations
Medical Students
Physical Examination
medical student
discrimination
inclusion
examination
evidence

ASJC Scopus subject areas

  • Nursing(all)
  • Public Health, Environmental and Occupational Health
  • Education

Cite this

Lieberman, S., Frye, A. W., Litwins, S. D., Rasmusson, K. A., & Boulet, J. R. (2003). Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates. Academic Medicine, 78(10 SUPPL.).

Introduction of patient video clips into computer-based testing : Effects on item statistics and reliability estimates. / Lieberman, Steven; Frye, Ann W.; Litwins, Stephanie D.; Rasmusson, Karen A.; Boulet, John R.

In: Academic Medicine, Vol. 78, No. 10 SUPPL., 01.10.2003.

Research output: Contribution to journalArticle

Lieberman, S, Frye, AW, Litwins, SD, Rasmusson, KA & Boulet, JR 2003, 'Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates', Academic Medicine, vol. 78, no. 10 SUPPL..
Lieberman, Steven ; Frye, Ann W. ; Litwins, Stephanie D. ; Rasmusson, Karen A. ; Boulet, John R. / Introduction of patient video clips into computer-based testing : Effects on item statistics and reliability estimates. In: Academic Medicine. 2003 ; Vol. 78, No. 10 SUPPL.
@article{2d281ed40c364d18b7bc3daccbb1dac5,
title = "Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates",
abstract = "Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.",
author = "Steven Lieberman and Frye, {Ann W.} and Litwins, {Stephanie D.} and Rasmusson, {Karen A.} and Boulet, {John R.}",
year = "2003",
month = "10",
day = "1",
language = "English (US)",
volume = "78",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "10 SUPPL.",

}

TY - JOUR

T1 - Introduction of patient video clips into computer-based testing

T2 - Effects on item statistics and reliability estimates

AU - Lieberman, Steven

AU - Frye, Ann W.

AU - Litwins, Stephanie D.

AU - Rasmusson, Karen A.

AU - Boulet, John R.

PY - 2003/10/1

Y1 - 2003/10/1

N2 - Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

AB - Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

UR - http://www.scopus.com/inward/record.url?scp=0141924562&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141924562&partnerID=8YFLogxK

M3 - Article

C2 - 14557094

AN - SCOPUS:0141924562

VL - 78

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 10 SUPPL.

ER -