Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents

Emil R. Petrusa, Thomas A. Blackwell, Michael Ainsworth

Research output: Contribution to journalArticle

100 Citations (Scopus)

Abstract

Clinical performance of residents should be assessed as reliably and validly as possible. This study investigated the reliability and validity of an objective structured clinical examination (OSCE) for assessing clinical performance of internal medicine residents. Residents were required to take a 17-patient OSCE in their first and second year. Reliability of the OSCE was 0.40. Validity studies indicated second-year students were significantly better than third-year students for five of six OSCE skill scores; first-year students were significantly better for three scores. Resident's scores for diagnosis, plan, and total significantly increased on their second OSCE. Generally faculty overall ratings of residents' clinical performance did not correlate with OSCE scores. American Board of Internal Medicine certifying examination scores were consistently positively correlated only with diagnosis. This 17-case OSCE is a feasible method for obtaining moderately reliable, valid data not available from other sources about the clinical performance of residents. More cases should be added to increase its reliability.

Original languageEnglish (US)
Pages (from-to)573-577
Number of pages5
JournalArchives of Internal Medicine
Volume150
Issue number3
StatePublished - Mar 1990

Fingerprint

Reproducibility of Results
Internal Medicine
Students
Clinical Competence

ASJC Scopus subject areas

  • Internal Medicine

Cite this

Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents. / Petrusa, Emil R.; Blackwell, Thomas A.; Ainsworth, Michael.

In: Archives of Internal Medicine, Vol. 150, No. 3, 03.1990, p. 573-577.

Research output: Contribution to journalArticle

@article{c4788c4288d94b4c9d26810befe2f116,
title = "Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents",
abstract = "Clinical performance of residents should be assessed as reliably and validly as possible. This study investigated the reliability and validity of an objective structured clinical examination (OSCE) for assessing clinical performance of internal medicine residents. Residents were required to take a 17-patient OSCE in their first and second year. Reliability of the OSCE was 0.40. Validity studies indicated second-year students were significantly better than third-year students for five of six OSCE skill scores; first-year students were significantly better for three scores. Resident's scores for diagnosis, plan, and total significantly increased on their second OSCE. Generally faculty overall ratings of residents' clinical performance did not correlate with OSCE scores. American Board of Internal Medicine certifying examination scores were consistently positively correlated only with diagnosis. This 17-case OSCE is a feasible method for obtaining moderately reliable, valid data not available from other sources about the clinical performance of residents. More cases should be added to increase its reliability.",
author = "Petrusa, {Emil R.} and Blackwell, {Thomas A.} and Michael Ainsworth",
year = "1990",
month = "3",
language = "English (US)",
volume = "150",
pages = "573--577",
journal = "JAMA Internal Medicine",
issn = "2168-6106",
publisher = "American Medical Association",
number = "3",

}

TY - JOUR

T1 - Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents

AU - Petrusa, Emil R.

AU - Blackwell, Thomas A.

AU - Ainsworth, Michael

PY - 1990/3

Y1 - 1990/3

N2 - Clinical performance of residents should be assessed as reliably and validly as possible. This study investigated the reliability and validity of an objective structured clinical examination (OSCE) for assessing clinical performance of internal medicine residents. Residents were required to take a 17-patient OSCE in their first and second year. Reliability of the OSCE was 0.40. Validity studies indicated second-year students were significantly better than third-year students for five of six OSCE skill scores; first-year students were significantly better for three scores. Resident's scores for diagnosis, plan, and total significantly increased on their second OSCE. Generally faculty overall ratings of residents' clinical performance did not correlate with OSCE scores. American Board of Internal Medicine certifying examination scores were consistently positively correlated only with diagnosis. This 17-case OSCE is a feasible method for obtaining moderately reliable, valid data not available from other sources about the clinical performance of residents. More cases should be added to increase its reliability.

AB - Clinical performance of residents should be assessed as reliably and validly as possible. This study investigated the reliability and validity of an objective structured clinical examination (OSCE) for assessing clinical performance of internal medicine residents. Residents were required to take a 17-patient OSCE in their first and second year. Reliability of the OSCE was 0.40. Validity studies indicated second-year students were significantly better than third-year students for five of six OSCE skill scores; first-year students were significantly better for three scores. Resident's scores for diagnosis, plan, and total significantly increased on their second OSCE. Generally faculty overall ratings of residents' clinical performance did not correlate with OSCE scores. American Board of Internal Medicine certifying examination scores were consistently positively correlated only with diagnosis. This 17-case OSCE is a feasible method for obtaining moderately reliable, valid data not available from other sources about the clinical performance of residents. More cases should be added to increase its reliability.

UR - http://www.scopus.com/inward/record.url?scp=0025355511&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0025355511&partnerID=8YFLogxK

M3 - Article

VL - 150

SP - 573

EP - 577

JO - JAMA Internal Medicine

JF - JAMA Internal Medicine

SN - 2168-6106

IS - 3

ER -