Factors influencing medical student attrition and their implications in a large multi-center randomized education trial

A. Kalet, R. H. Ellaway, H. S. Song, M. Nick, U. Sarpel, M. A. Hopkins, J. Hill, J. L. Plass, M. V. Pusic

Research output: Contribution to journalArticle

Abstract

Participant attrition may be a significant threat to the generalizability of the results of educational research studies if participants who do not persist in a study differ from those who do in ways that can affect the experimental outcomes. A multi-center trial of the efficacy of different computer-based instructional strategies gave us the opportunity to observe institutional and student factors linked to attrition from a study and the ways in which they altered the participation profile. The data is from a randomized controlled trial conducted at seven US medical schools investigating the educational impact of different instructional designs for computer-based learning modules for surgical clerks. All students undertaking their surgical clerkships at the participating schools were invited participate and those that consented were asked to complete five study measures during their surgery clerkship. Variations in study attrition rates were explored by institution and by participants' self-regulation, self-efficacy, perception of task value, and mastery goal orientation measured on entry to the study. Of the 1,363 invited participants 995 (73 %) consented to participate and provided baseline data. There was a significant drop in the rate of participation at each of the five study milestones with 902 (94 %) completing at least one of two module post-test, 799 (61 %) both module post-tests, 539 (36 %) the mid-rotation evaluation and 252 (25 %) the final evaluation. Attrition varied between institutions on survival analysis (p < 0.001). Small but statistically significant differences in self-regulation (p = 0.01), self-efficacy (p = 0.02) and task value (p = 0.04) were observed but not in mastery or performance goal orientation measures (p = NS). Study attrition was correlated with lower achievement on the National Board of Medical Examiners subject exam. The results of education trials should be interpreted with the understanding that students who persist may be somewhat more self-regulated, self-efficacious and higher achievers than their peers who drop out and as such do not represent the class as a whole.

Original languageEnglish (US)
Pages (from-to)439-450
Number of pages12
JournalAdvances in Health Sciences Education
Volume18
Issue number3
DOIs
StatePublished - Aug 2013

Fingerprint

education center
Medical Students
medical student
Self Efficacy
Students
Education
self-regulation
self-efficacy
Coroners and Medical Examiners
Survival Analysis
Medical Schools
medical examiner
participation
student
Randomized Controlled Trials
drop-out
educational research
evaluation
Learning
school

Keywords

  • Computer-aided instruction
  • Generalizability
  • Medical education
  • Randomized controlled trial
  • RCT
  • Reproducibility of results
  • Study design
  • Surgery education

ASJC Scopus subject areas

  • Medicine(all)
  • Education

Cite this

Factors influencing medical student attrition and their implications in a large multi-center randomized education trial. / Kalet, A.; Ellaway, R. H.; Song, H. S.; Nick, M.; Sarpel, U.; Hopkins, M. A.; Hill, J.; Plass, J. L.; Pusic, M. V.

In: Advances in Health Sciences Education, Vol. 18, No. 3, 08.2013, p. 439-450.

Research output: Contribution to journalArticle

Kalet, A. ; Ellaway, R. H. ; Song, H. S. ; Nick, M. ; Sarpel, U. ; Hopkins, M. A. ; Hill, J. ; Plass, J. L. ; Pusic, M. V. / Factors influencing medical student attrition and their implications in a large multi-center randomized education trial. In: Advances in Health Sciences Education. 2013 ; Vol. 18, No. 3. pp. 439-450.
@article{9093ffb3207d4a03a6238543ef3ad587,
title = "Factors influencing medical student attrition and their implications in a large multi-center randomized education trial",
abstract = "Participant attrition may be a significant threat to the generalizability of the results of educational research studies if participants who do not persist in a study differ from those who do in ways that can affect the experimental outcomes. A multi-center trial of the efficacy of different computer-based instructional strategies gave us the opportunity to observe institutional and student factors linked to attrition from a study and the ways in which they altered the participation profile. The data is from a randomized controlled trial conducted at seven US medical schools investigating the educational impact of different instructional designs for computer-based learning modules for surgical clerks. All students undertaking their surgical clerkships at the participating schools were invited participate and those that consented were asked to complete five study measures during their surgery clerkship. Variations in study attrition rates were explored by institution and by participants' self-regulation, self-efficacy, perception of task value, and mastery goal orientation measured on entry to the study. Of the 1,363 invited participants 995 (73 {\%}) consented to participate and provided baseline data. There was a significant drop in the rate of participation at each of the five study milestones with 902 (94 {\%}) completing at least one of two module post-test, 799 (61 {\%}) both module post-tests, 539 (36 {\%}) the mid-rotation evaluation and 252 (25 {\%}) the final evaluation. Attrition varied between institutions on survival analysis (p < 0.001). Small but statistically significant differences in self-regulation (p = 0.01), self-efficacy (p = 0.02) and task value (p = 0.04) were observed but not in mastery or performance goal orientation measures (p = NS). Study attrition was correlated with lower achievement on the National Board of Medical Examiners subject exam. The results of education trials should be interpreted with the understanding that students who persist may be somewhat more self-regulated, self-efficacious and higher achievers than their peers who drop out and as such do not represent the class as a whole.",
keywords = "Computer-aided instruction, Generalizability, Medical education, Randomized controlled trial, RCT, Reproducibility of results, Study design, Surgery education",
author = "A. Kalet and Ellaway, {R. H.} and Song, {H. S.} and M. Nick and U. Sarpel and Hopkins, {M. A.} and J. Hill and Plass, {J. L.} and Pusic, {M. V.}",
year = "2013",
month = "8",
doi = "10.1007/s10459-012-9382-z",
language = "English (US)",
volume = "18",
pages = "439--450",
journal = "Advances in Health Sciences Education",
issn = "1382-4996",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - Factors influencing medical student attrition and their implications in a large multi-center randomized education trial

AU - Kalet, A.

AU - Ellaway, R. H.

AU - Song, H. S.

AU - Nick, M.

AU - Sarpel, U.

AU - Hopkins, M. A.

AU - Hill, J.

AU - Plass, J. L.

AU - Pusic, M. V.

PY - 2013/8

Y1 - 2013/8

N2 - Participant attrition may be a significant threat to the generalizability of the results of educational research studies if participants who do not persist in a study differ from those who do in ways that can affect the experimental outcomes. A multi-center trial of the efficacy of different computer-based instructional strategies gave us the opportunity to observe institutional and student factors linked to attrition from a study and the ways in which they altered the participation profile. The data is from a randomized controlled trial conducted at seven US medical schools investigating the educational impact of different instructional designs for computer-based learning modules for surgical clerks. All students undertaking their surgical clerkships at the participating schools were invited participate and those that consented were asked to complete five study measures during their surgery clerkship. Variations in study attrition rates were explored by institution and by participants' self-regulation, self-efficacy, perception of task value, and mastery goal orientation measured on entry to the study. Of the 1,363 invited participants 995 (73 %) consented to participate and provided baseline data. There was a significant drop in the rate of participation at each of the five study milestones with 902 (94 %) completing at least one of two module post-test, 799 (61 %) both module post-tests, 539 (36 %) the mid-rotation evaluation and 252 (25 %) the final evaluation. Attrition varied between institutions on survival analysis (p < 0.001). Small but statistically significant differences in self-regulation (p = 0.01), self-efficacy (p = 0.02) and task value (p = 0.04) were observed but not in mastery or performance goal orientation measures (p = NS). Study attrition was correlated with lower achievement on the National Board of Medical Examiners subject exam. The results of education trials should be interpreted with the understanding that students who persist may be somewhat more self-regulated, self-efficacious and higher achievers than their peers who drop out and as such do not represent the class as a whole.

AB - Participant attrition may be a significant threat to the generalizability of the results of educational research studies if participants who do not persist in a study differ from those who do in ways that can affect the experimental outcomes. A multi-center trial of the efficacy of different computer-based instructional strategies gave us the opportunity to observe institutional and student factors linked to attrition from a study and the ways in which they altered the participation profile. The data is from a randomized controlled trial conducted at seven US medical schools investigating the educational impact of different instructional designs for computer-based learning modules for surgical clerks. All students undertaking their surgical clerkships at the participating schools were invited participate and those that consented were asked to complete five study measures during their surgery clerkship. Variations in study attrition rates were explored by institution and by participants' self-regulation, self-efficacy, perception of task value, and mastery goal orientation measured on entry to the study. Of the 1,363 invited participants 995 (73 %) consented to participate and provided baseline data. There was a significant drop in the rate of participation at each of the five study milestones with 902 (94 %) completing at least one of two module post-test, 799 (61 %) both module post-tests, 539 (36 %) the mid-rotation evaluation and 252 (25 %) the final evaluation. Attrition varied between institutions on survival analysis (p < 0.001). Small but statistically significant differences in self-regulation (p = 0.01), self-efficacy (p = 0.02) and task value (p = 0.04) were observed but not in mastery or performance goal orientation measures (p = NS). Study attrition was correlated with lower achievement on the National Board of Medical Examiners subject exam. The results of education trials should be interpreted with the understanding that students who persist may be somewhat more self-regulated, self-efficacious and higher achievers than their peers who drop out and as such do not represent the class as a whole.

KW - Computer-aided instruction

KW - Generalizability

KW - Medical education

KW - Randomized controlled trial

KW - RCT

KW - Reproducibility of results

KW - Study design

KW - Surgery education

UR - http://www.scopus.com/inward/record.url?scp=84881025140&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881025140&partnerID=8YFLogxK

U2 - 10.1007/s10459-012-9382-z

DO - 10.1007/s10459-012-9382-z

M3 - Article

VL - 18

SP - 439

EP - 450

JO - Advances in Health Sciences Education

JF - Advances in Health Sciences Education

SN - 1382-4996

IS - 3

ER -