Scribd Logo
Upload

Welcome to Scribd!

  • 49 views

    Do Family Medicine NBME Shelf Scores Improve... STFM Annaheim 12 23 2017

    Uploaded by

    fasdfa
    Students who repeated the NBME Family Medicine subject exam at the end of their third year clinical rotation scored higher the second time. The mean score increased from 67.68 to 72.5, a statistically significant improvement. Allowing students to retake the exam provides an opportunity to improve their score. Clerkship exam performance may increase as students gain more clinical experience throughout the academic year.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd

    Do Family Medicine NBME Shelf Scores Improve... STFM Annaheim 12 23 2017

    Uploaded by

    fasdfa
    49 views10 pages
    Students who repeated the NBME Family Medicine subject exam at the end of their third year clinical rotation scored higher the second time. The mean score increased from 67.68 to 72.5, a statistically significant improvement. Allowing students to retake the exam provides an opportunity to improve their score. Clerkship exam performance may increase as students gain more clinical experience throughout the academic year.

    Original Description:

    sdfas

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Students who repeated the NBME Family Medicine subject exam at the end of their third year clinical rotation scored higher the second time. The mean score increased from 67.68 to 72.5, a statistically significant improvement. Allowing students to retake the exam provides an opportunity to improve their score. Clerkship exam performance may increase as students gain more clinical experience throughout the academic year.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    49 views10 pages

    Do Family Medicine NBME Shelf Scores Improve... STFM Annaheim 12 23 2017

    Uploaded by

    fasdfa
    Students who repeated the NBME Family Medicine subject exam at the end of their third year clinical rotation scored higher the second time. The mean score increased from 67.68 to 72.5, a statistically significant improvement. Allowing students to retake the exam provides an opportunity to improve their score. Clerkship exam performance may increase as students gain more clinical experience throughout the academic year.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    of 10

    Do Family Medicine NBME Shelf

    Scores Improve when Students are


    Allowed to Repeat the NBME Exam
    at the End of the Academic Year?
    Suzanne Minor, MD, FAAFP
    Sarah Stumbar, MD, MPH
    Rodolfo Bonnin, PhD
    Marquita Samuels, MBA Candidate
    History of the FM Clerkship
    Class of Academic Year # of Students Structure Shelf
    2013 2011 – 2012 43 Longitudinal, Year-long End of Year
    2014 2012 – 2013 43 Block, 6 week End of Block
    2015 2013 – 2014 80 Block, 4 week End of Block, End of Year
    2016 2014 – 2015 120 Block, 8 week End of Block, End of Year
    2017 2015 – 2016 120 Block, 8 week End of Block
    2018 2016 – 2017 120 Block, 8 week End of Block
    Anecdotally…
    Students seemed to do better when they took the
    shelf at the end of the year than at the end of blocks…
    Our Project
    • Research Objective: To understand the changes in shelf scores when
    students may repeat the shelf at the end of the year
    • Hypothesis: Shelf scores will increase for individual students when
    students are allowed to repeat the exam
    • Importance: This may impact the clerkship summative (grading)
    structure
    Background
    • Mean scores on clerkship examinations improve steadily as the
    academic year progresses
    • 12 week IM clerkship, 1983-84, 1984-85, and 1985-86, University of Illinois
    College of Medicine at Chicago)1

    • 8 & 12 week Surgery clerkships, 8/1994-7/1995, US Medical Schools2

    • 12 week Surgery clerkship, 6/1985-5/1986, Medical College of Ohio, Toledo,


    Ohio3

    1. Whalen JP, Moses VK. The effect on grades of the timing and site of third-year internal medicine clerkships. Acad Med 1990;65:708-9.
    2. Ripkey DR, Case SM, Swanson DB. Predicting performances on the NBME Surgery Subject Test and USMLE Step 2: the effects of surgery clerkship timing
    and length. Acad Med. 1997 Oct;72(10 Suppl 1):S31-3.
    3. Baciewicz FA Jr1, Arent L, Weaver M, Yeastings R, Thomford NR. Influence of clerkship structure and timing on individual student performance. Am J
    Surg. 1990 Feb;159(2):265-8.
    Methods
    • 25 MS3’s repeated NBME FM Core at the end of their clinical year
    (3/2014) Optional
    • Paired T-test analysis was conducted to compare performance
    differences between the two administrations of the NBME Family
    Medicine subject exam
    Results
    Rotation # of students/rotation who retook the shelf
    1 4
    2 1
    3 6
    4 2
    5 3
    6 4
    7 1
    8 5
    n=26
    Results
    NBME, 1st NBME, 2nd
    Administration Administration
    Our Students - Scaled 60-80 57-90
    Range
    Our Students - Mean 67.68 72.5
    Our Students - SD 5.12 7.87
    National Mean, SD 71.9, 8.7 71.9, 8.7

    t(24)=-2.66, p=.001
    2 students repeated the year voluntarily, so we pulled them out of this analysis

    Effect size between the two administrations was measured using Cohen’s D which yielded a large effect size at 0.79
    Conclusion…
    • These results suggest that time on clerkships does influence exam
    performance.
    • There may be a bias that "high-achievers" and students going into
    FM are most likely to opt to optionally repeat the shelf exam...and so
    they would be more likely to improve/study a lot to ensure that
    improvement...
    • There was no difference in timing of original rotation! ½ before
    midpoint and ½ after!
    • Questions?
    • I’d love your feedback – Next steps?
    • Please complete the evaluation on the app

    You might also like