The relationship between preceptor expectations and student performance on 2 pediatric objective structured clinical examination stations

Michael Malloy, Linda Perkowski, Michael Callaway, Alice Speer

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Background: We designed 2 pediatric objective structured clinical examination stations, 1 anemia case associated with lead exposure and 1 failure-to-gain-weight case associated with extended breast-feeding, to evaluate third-year medical students who had studied in pediatric community preceptors' offices as part of a 12-week multidisciplinary ambulatory clerkship rotation. Objective: To examine the relationship between preceptor expectations and student performance on these 2 objective structured clinical examination stations. Methods: To elicit community preceptors' expectations of student performance, we constructed a 46-item survey replicating checklists filled out by simulated patients evaluating student performance on the objective structured clinical examination stations. The percentage agreement among preceptors for each checklist item as well as the percentage agreement between preceptor responses and student responses on each checklist item were calculated. A summary score of preceptor responses across all checklist items and a summary score for student responses across all checklist items on each station were calculated. The correlation coefficients between preceptor and student summary scores were then examined. Results: Fifty-nine preceptor surveys were mailed and 38 were returned (64% response rate). Data were usable from 37 surveys. Eighty-nine percent (33 of 37) of the preceptors agreed that a third-year clerkship student should have the knowledge to care for the patient with anemia and 92% (34 of 37) of the preceptors agreed similarly for the growth-delay case. Agreement among preceptors on individual checklist items varied widely for both cases. Fifty- seven students studied at the anemia station and 34 students studied at the growth-delay station. The mean ± SD agreement across the 26 items on the anemia case between preceptor responses and student responses was 62% ± 23% and, for the 21 items on the growth-delay case, 60% ± 17%. The mean ± SD preceptor summary score for the anemia case was 17.4 ± 3.8 (maximum, 26) and 16.0 ± 3.6 (maximum, 21) for the growth-delay case. The mean student score on the anemia case was 15.5 ± 3.7 (maximum, 26) and, for the growth-delay case, 10.0 ± 4.5 (maximum, 21). The Pearson correlation coefficient between the preceptor and student scores on the anemia case was 0.19 (P = .15), and for the growth-delay case,- 0.41 (P = .06). Conclusions: These data suggest community preceptors agree on topic areas in which students should be clinically competent. There was, however, considerable variation in agreement among preceptors about what preceptors believe students should be able to do and how the students actually perform. The overall percentage agreement between preceptor expectations and student performance appears to be no better than chance.

Original languageEnglish (US)
Pages (from-to)806-811
Number of pages6
JournalArchives of Pediatrics and Adolescent Medicine
Volume152
Issue number8
StatePublished - Aug 1998

Fingerprint

Pediatrics
Students
Anemia
Checklist
Growth
Breast Feeding
Medical Students
Weight Gain
Patient Care

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health

Cite this

The relationship between preceptor expectations and student performance on 2 pediatric objective structured clinical examination stations. / Malloy, Michael; Perkowski, Linda; Callaway, Michael; Speer, Alice.

In: Archives of Pediatrics and Adolescent Medicine, Vol. 152, No. 8, 08.1998, p. 806-811.

Research output: Contribution to journalArticle

@article{b26655edd6b14cfeae743fbddd996267,
title = "The relationship between preceptor expectations and student performance on 2 pediatric objective structured clinical examination stations",
abstract = "Background: We designed 2 pediatric objective structured clinical examination stations, 1 anemia case associated with lead exposure and 1 failure-to-gain-weight case associated with extended breast-feeding, to evaluate third-year medical students who had studied in pediatric community preceptors' offices as part of a 12-week multidisciplinary ambulatory clerkship rotation. Objective: To examine the relationship between preceptor expectations and student performance on these 2 objective structured clinical examination stations. Methods: To elicit community preceptors' expectations of student performance, we constructed a 46-item survey replicating checklists filled out by simulated patients evaluating student performance on the objective structured clinical examination stations. The percentage agreement among preceptors for each checklist item as well as the percentage agreement between preceptor responses and student responses on each checklist item were calculated. A summary score of preceptor responses across all checklist items and a summary score for student responses across all checklist items on each station were calculated. The correlation coefficients between preceptor and student summary scores were then examined. Results: Fifty-nine preceptor surveys were mailed and 38 were returned (64{\%} response rate). Data were usable from 37 surveys. Eighty-nine percent (33 of 37) of the preceptors agreed that a third-year clerkship student should have the knowledge to care for the patient with anemia and 92{\%} (34 of 37) of the preceptors agreed similarly for the growth-delay case. Agreement among preceptors on individual checklist items varied widely for both cases. Fifty- seven students studied at the anemia station and 34 students studied at the growth-delay station. The mean ± SD agreement across the 26 items on the anemia case between preceptor responses and student responses was 62{\%} ± 23{\%} and, for the 21 items on the growth-delay case, 60{\%} ± 17{\%}. The mean ± SD preceptor summary score for the anemia case was 17.4 ± 3.8 (maximum, 26) and 16.0 ± 3.6 (maximum, 21) for the growth-delay case. The mean student score on the anemia case was 15.5 ± 3.7 (maximum, 26) and, for the growth-delay case, 10.0 ± 4.5 (maximum, 21). The Pearson correlation coefficient between the preceptor and student scores on the anemia case was 0.19 (P = .15), and for the growth-delay case,- 0.41 (P = .06). Conclusions: These data suggest community preceptors agree on topic areas in which students should be clinically competent. There was, however, considerable variation in agreement among preceptors about what preceptors believe students should be able to do and how the students actually perform. The overall percentage agreement between preceptor expectations and student performance appears to be no better than chance.",
author = "Michael Malloy and Linda Perkowski and Michael Callaway and Alice Speer",
year = "1998",
month = "8",
language = "English (US)",
volume = "152",
pages = "806--811",
journal = "JAMA Pediatrics",
issn = "2168-6203",
publisher = "American Medical Association",
number = "8",

}

TY - JOUR

T1 - The relationship between preceptor expectations and student performance on 2 pediatric objective structured clinical examination stations

AU - Malloy, Michael

AU - Perkowski, Linda

AU - Callaway, Michael

AU - Speer, Alice

PY - 1998/8

Y1 - 1998/8

N2 - Background: We designed 2 pediatric objective structured clinical examination stations, 1 anemia case associated with lead exposure and 1 failure-to-gain-weight case associated with extended breast-feeding, to evaluate third-year medical students who had studied in pediatric community preceptors' offices as part of a 12-week multidisciplinary ambulatory clerkship rotation. Objective: To examine the relationship between preceptor expectations and student performance on these 2 objective structured clinical examination stations. Methods: To elicit community preceptors' expectations of student performance, we constructed a 46-item survey replicating checklists filled out by simulated patients evaluating student performance on the objective structured clinical examination stations. The percentage agreement among preceptors for each checklist item as well as the percentage agreement between preceptor responses and student responses on each checklist item were calculated. A summary score of preceptor responses across all checklist items and a summary score for student responses across all checklist items on each station were calculated. The correlation coefficients between preceptor and student summary scores were then examined. Results: Fifty-nine preceptor surveys were mailed and 38 were returned (64% response rate). Data were usable from 37 surveys. Eighty-nine percent (33 of 37) of the preceptors agreed that a third-year clerkship student should have the knowledge to care for the patient with anemia and 92% (34 of 37) of the preceptors agreed similarly for the growth-delay case. Agreement among preceptors on individual checklist items varied widely for both cases. Fifty- seven students studied at the anemia station and 34 students studied at the growth-delay station. The mean ± SD agreement across the 26 items on the anemia case between preceptor responses and student responses was 62% ± 23% and, for the 21 items on the growth-delay case, 60% ± 17%. The mean ± SD preceptor summary score for the anemia case was 17.4 ± 3.8 (maximum, 26) and 16.0 ± 3.6 (maximum, 21) for the growth-delay case. The mean student score on the anemia case was 15.5 ± 3.7 (maximum, 26) and, for the growth-delay case, 10.0 ± 4.5 (maximum, 21). The Pearson correlation coefficient between the preceptor and student scores on the anemia case was 0.19 (P = .15), and for the growth-delay case,- 0.41 (P = .06). Conclusions: These data suggest community preceptors agree on topic areas in which students should be clinically competent. There was, however, considerable variation in agreement among preceptors about what preceptors believe students should be able to do and how the students actually perform. The overall percentage agreement between preceptor expectations and student performance appears to be no better than chance.

AB - Background: We designed 2 pediatric objective structured clinical examination stations, 1 anemia case associated with lead exposure and 1 failure-to-gain-weight case associated with extended breast-feeding, to evaluate third-year medical students who had studied in pediatric community preceptors' offices as part of a 12-week multidisciplinary ambulatory clerkship rotation. Objective: To examine the relationship between preceptor expectations and student performance on these 2 objective structured clinical examination stations. Methods: To elicit community preceptors' expectations of student performance, we constructed a 46-item survey replicating checklists filled out by simulated patients evaluating student performance on the objective structured clinical examination stations. The percentage agreement among preceptors for each checklist item as well as the percentage agreement between preceptor responses and student responses on each checklist item were calculated. A summary score of preceptor responses across all checklist items and a summary score for student responses across all checklist items on each station were calculated. The correlation coefficients between preceptor and student summary scores were then examined. Results: Fifty-nine preceptor surveys were mailed and 38 were returned (64% response rate). Data were usable from 37 surveys. Eighty-nine percent (33 of 37) of the preceptors agreed that a third-year clerkship student should have the knowledge to care for the patient with anemia and 92% (34 of 37) of the preceptors agreed similarly for the growth-delay case. Agreement among preceptors on individual checklist items varied widely for both cases. Fifty- seven students studied at the anemia station and 34 students studied at the growth-delay station. The mean ± SD agreement across the 26 items on the anemia case between preceptor responses and student responses was 62% ± 23% and, for the 21 items on the growth-delay case, 60% ± 17%. The mean ± SD preceptor summary score for the anemia case was 17.4 ± 3.8 (maximum, 26) and 16.0 ± 3.6 (maximum, 21) for the growth-delay case. The mean student score on the anemia case was 15.5 ± 3.7 (maximum, 26) and, for the growth-delay case, 10.0 ± 4.5 (maximum, 21). The Pearson correlation coefficient between the preceptor and student scores on the anemia case was 0.19 (P = .15), and for the growth-delay case,- 0.41 (P = .06). Conclusions: These data suggest community preceptors agree on topic areas in which students should be clinically competent. There was, however, considerable variation in agreement among preceptors about what preceptors believe students should be able to do and how the students actually perform. The overall percentage agreement between preceptor expectations and student performance appears to be no better than chance.

UR - http://www.scopus.com/inward/record.url?scp=0031855896&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031855896&partnerID=8YFLogxK

M3 - Article

VL - 152

SP - 806

EP - 811

JO - JAMA Pediatrics

JF - JAMA Pediatrics

SN - 2168-6203

IS - 8

ER -