Standardized patients: A long-station clinical examination format

B. G. Ferrell, Barbara Thompson

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Data from the first 20 periods of a long-station clinical performance examination for a 4-week required clerkship in family medicine were examined in order to assess the reliability and validity of the examination. Data from 304 students were examined for station, case scenario and examiner effects and results compared to short-station formats. A significant examiner effect was found but there were no differences in student performance for station or case scenario, These findings reflect examiner specificity cited in the literature for short station examinations, but not case specificity. The source of variability for this examination appears to be primarily examiner effect. There was a significant correlation between student scores on the two cases, and raters tended to rank order students similarly in spite of variability in mean rater score. Scores on the CPE correlated with other measures of clinical performance as well as other methods of student evaluation for the clerkship providing some evidence for construct and criterion-related validity. CPE cases were developed from clerkship objectives but examination of the test blueprint revealed some gaps in the extent to which the CPE covers the course content. CPE developers are working to increase inter-rater reliability through examiner training and further standardize case scenarios through checklists and patient training. Additional cases are being developed to increase the content validity of the examination.

Original languageEnglish (US)
Pages (from-to)376-381
Number of pages6
JournalMedical Education
Volume27
Issue number4
StatePublished - 1993

Fingerprint

examiner
Students
examination
scenario
student
performance
Checklist
Reproducibility of Results
Medicine
medicine
evaluation
evidence

Keywords

  • Clinical clerkship
  • clinical competence
  • Educational measurement
  • Family practice educ
  • Texas

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health
  • Nursing(all)
  • Education

Cite this

Standardized patients : A long-station clinical examination format. / Ferrell, B. G.; Thompson, Barbara.

In: Medical Education, Vol. 27, No. 4, 1993, p. 376-381.

Research output: Contribution to journalArticle

@article{ef3cb9cca0094d89bb20a30903290996,
title = "Standardized patients: A long-station clinical examination format",
abstract = "Data from the first 20 periods of a long-station clinical performance examination for a 4-week required clerkship in family medicine were examined in order to assess the reliability and validity of the examination. Data from 304 students were examined for station, case scenario and examiner effects and results compared to short-station formats. A significant examiner effect was found but there were no differences in student performance for station or case scenario, These findings reflect examiner specificity cited in the literature for short station examinations, but not case specificity. The source of variability for this examination appears to be primarily examiner effect. There was a significant correlation between student scores on the two cases, and raters tended to rank order students similarly in spite of variability in mean rater score. Scores on the CPE correlated with other measures of clinical performance as well as other methods of student evaluation for the clerkship providing some evidence for construct and criterion-related validity. CPE cases were developed from clerkship objectives but examination of the test blueprint revealed some gaps in the extent to which the CPE covers the course content. CPE developers are working to increase inter-rater reliability through examiner training and further standardize case scenarios through checklists and patient training. Additional cases are being developed to increase the content validity of the examination.",
keywords = "Clinical clerkship, clinical competence, Educational measurement, Family practice educ, Texas",
author = "Ferrell, {B. G.} and Barbara Thompson",
year = "1993",
language = "English (US)",
volume = "27",
pages = "376--381",
journal = "Medical Education",
issn = "0308-0110",
publisher = "Wiley-Blackwell",
number = "4",

}

TY - JOUR

T1 - Standardized patients

T2 - A long-station clinical examination format

AU - Ferrell, B. G.

AU - Thompson, Barbara

PY - 1993

Y1 - 1993

N2 - Data from the first 20 periods of a long-station clinical performance examination for a 4-week required clerkship in family medicine were examined in order to assess the reliability and validity of the examination. Data from 304 students were examined for station, case scenario and examiner effects and results compared to short-station formats. A significant examiner effect was found but there were no differences in student performance for station or case scenario, These findings reflect examiner specificity cited in the literature for short station examinations, but not case specificity. The source of variability for this examination appears to be primarily examiner effect. There was a significant correlation between student scores on the two cases, and raters tended to rank order students similarly in spite of variability in mean rater score. Scores on the CPE correlated with other measures of clinical performance as well as other methods of student evaluation for the clerkship providing some evidence for construct and criterion-related validity. CPE cases were developed from clerkship objectives but examination of the test blueprint revealed some gaps in the extent to which the CPE covers the course content. CPE developers are working to increase inter-rater reliability through examiner training and further standardize case scenarios through checklists and patient training. Additional cases are being developed to increase the content validity of the examination.

AB - Data from the first 20 periods of a long-station clinical performance examination for a 4-week required clerkship in family medicine were examined in order to assess the reliability and validity of the examination. Data from 304 students were examined for station, case scenario and examiner effects and results compared to short-station formats. A significant examiner effect was found but there were no differences in student performance for station or case scenario, These findings reflect examiner specificity cited in the literature for short station examinations, but not case specificity. The source of variability for this examination appears to be primarily examiner effect. There was a significant correlation between student scores on the two cases, and raters tended to rank order students similarly in spite of variability in mean rater score. Scores on the CPE correlated with other measures of clinical performance as well as other methods of student evaluation for the clerkship providing some evidence for construct and criterion-related validity. CPE cases were developed from clerkship objectives but examination of the test blueprint revealed some gaps in the extent to which the CPE covers the course content. CPE developers are working to increase inter-rater reliability through examiner training and further standardize case scenarios through checklists and patient training. Additional cases are being developed to increase the content validity of the examination.

KW - Clinical clerkship

KW - clinical competence

KW - Educational measurement

KW - Family practice educ

KW - Texas

UR - http://www.scopus.com/inward/record.url?scp=0027217973&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0027217973&partnerID=8YFLogxK

M3 - Article

C2 - 8412881

AN - SCOPUS:0027217973

VL - 27

SP - 376

EP - 381

JO - Medical Education

JF - Medical Education

SN - 0308-0110

IS - 4

ER -