Professional Documents
Culture Documents
Medicine and Surgery Residents' Perspectives On The Impact of COVID-19 On Graduate Medical Education
Medicine and Surgery Residents' Perspectives On The Impact of COVID-19 On Graduate Medical Education
To cite this article: Tanvi Rana , Christopher Hackett , Timothy Quezada , Abhishek Chaturvedi ,
Veli Bakalov , Jody Leonardo & Sandeep Rana (2020) Medicine and surgery residents’
perspectives on the impact of COVID-19 on graduate medical education, Medical Education Online,
25:1, 1818439, DOI: 10.1080/10872981.2020.1818439
RESEARCH ARTICLE
a study conducted by Almarzooq et al. evaluated the were performed to evaluate differences in anxiety
experience that their cardiovascular fellowship pro levels between junior international medical graduates
gram had using innovative virtual learning activities (IMGs) and senior IMGs as well as to assess differ
during this crisis [15]. ences in anxiety levels related to childcare between
Our survey study aims to better understand how the male and female residents.
COVID-19 outbreak has impacted both the education The primary outcome (stress during COVID-19
and well-being of residents from various specialties at crisis) was evaluated using a linear stepwise multiple
our institution. Specifically, we attempted to gain insight regression model. Assumptions were checked and
into resident perspectives regarding the effects of the multicollinearity was found between age and resi
crisis on their professional and personal lives, their dent experience; thus, age was excluded from all
views on the alternative learning opportunities imple regression analyses. Additionally, because descriptive
mented so far, and the extent to which they believe this statistics suggested an interaction between female
unprecedented event will prepare them for the future. gender and anxiety related to PPE, the interaction
term was computed and then added to the model.
Stepping criteria was set at α = 0.05 for entry and
Methods α = 0.10 for removal from the model. The following
We aimed to better understand how the COVID-19 covariates were entered into the linear stepwise mul
outbreak impacted educational experiences and tiple regression model: gender (male or female);
well-being of residents at a large academic institu residency type (medical or surgical); experience
tion in Pittsburgh, Pennsylvania after >6 weeks of (junior: PGY 1–2 or senior: PGY ≥3); race; quaran
a modified schedule due to the pandemic. The tine status (quarantined at any point during crisis or
Allegheny Health Network IRB determined this never quarantined during crisis); citizenship
study to be exempt. (U.S. citizen or international student); anxiety
Authors TR (medical education research track at related to personal protective equipment (PPE);
Sidney Kimmel Medical College), SR (neurology resi and the interaction of female gender and anxiety
dency program director at Allegheny General Hospital related to PPE.
[AGH]), and JL (neurosurgery residency program Preplanned secondary analyses were conducted
director at AGH) developed the survey with feedback with sequential logistic regressions in two blocks to
from the neurology chief resident at AGH (TQ) and an evaluate survey questions based on the same resident
internal medicine resident at AGH who has extensive characteristics inputted as covariates in the regres
research experience (VB). There were 25 to 31 ques sion analysis above. We conducted five separate
tions, depending on if the resident: had been quaran logistic regression analyses assessing how each of
tined, was a U.S. citizen, had children, or was in the resident characteristics were related to residents’
a surgical residency. 15 questions were multiple choice, perception of telemedicine and virtual learning, the
9 were Likert-type scale, 6 were numerical scale (1–10), impact of COVID-19 on their residency training and
and 1 was open-ended. Given the limited literature on personal lives, and their beliefs on how the pan
the subject matter, the survey did not have any prior demic would affect their future self and career. In
testing. A minor participation incentive was awarded each logistic regression, we entered all characteristics
upon completion of the survey ($10 gift card). of the residents in the first block (gender, residency
Residents were contacted via email on type, experience, race, quarantine status, citizenship),
21 April 2020 to complete this anonymous, voluntary, except when the characteristic of interest for the
online survey; the survey window closed on regression was the outcome variable. The second
3 May 2020. Statistical analyses were performed block progressed in stepwise fashion (stepping cri
with SPSS (version 26.0, IBM Corp.). Descriptive teria was set at α = 0.05 for entry and α = 0.10 for
statistics were assessed and reported as mean±stan removal from the model) using likelihood ratios.
dard deviation for normally distributed variables, The sequential design allowed us to control for
median (interquartile range [IQR]) for variables not confounding effects of the other resident character
normally distributed, and proportion (numerator ‘of’ istics, meaning that variables entered in the second
denominator) for categorical variables. We conducted block would predict the resident characteristic of
subgroup analyses with a one-way ANOVA to evalu interest above and beyond any confounding vari
ate how disruptive the COVID-19 crisis was on the ables entered in the first block.
specialties surveyed in our study (psychiatry, internal P values ≤0.05 were considered statistically signifi
and family medicine, neurology, neurosurgery, and cant. Survey questions and scales are provided in the
general surgery). Additionally, Mann-Whitney tests online appendix (eTable1).
MEDICAL EDUCATION ONLINE 3
Table 1. Demographics of survey participants. Overall, 50% (48 of 96) of survey respondents
Characteristic Total, n/96 (%) believed that the COVID-19 crisis had a negative
Gender impact on their clinical experience, but that the experi
Male 48 (50) ence could be made up in the future. Meanwhile, 20%
Female 48 (50) (19 of 96) agreed that the outbreak had a negative
Age impact on clinical experience, and the experience
20 to <30 45 (47)
could not be made up in the future. Conversely, 8% (8
30 to <40 50 (52)
of 96) of study participants indicated that the COVID-
40 to <50 1 (1)
Race 19 crisis had a positive impact on their clinical experi
White 59 (61) ence, 18% (17 of 96) indicated that it had no impact on
Black or African American 2 (2) their clinical experience, and the remaining 4% (4 of 96)
Asian 24 (25) indicated an ‘other’ impact.
Other 11 (11) Among surgery residents specifically, 50% (13 of
Citizenship
26) believed that the COVID-19 crisis had a negative
U.S. citizen 78 (81)
International (visa holder) 18 (19)
impact on their surgical training, but that the experi
Parent Status ence could be made up in the future; 35% (9 of 26)
Parent 22 (23) agreed that the outbreak had a negative impact on
Not a Parent 74 (77) their surgical training, and the experience could not
Quarantine Status be made up in the future; and 15% (4 of 26) indicated
Quarantined 16 (17)
‘no impact’.
Not Quarantined 80 (83)
Residency Program
A one-way ANOVA suggested that there was
Internal Medicine 36 (38) a significant difference in disruption of training
General Surgery 18 (19) among the specialties surveyed during the COVID-
Neurology 15 (16) 19 crisis (F(4,91) = 4.53, P = 0.002). A Bonferroni
Psychiatry 12 (13) correction for multiple comparisons suggested that
Neurosurgery 8 (8) there was an observable difference between the extent
Family Medicine 7 (7)
of training disruption reported by psychiatry resi
Experience Level
Junior (PGY-1 and −2) 51 (53)
dents (3.58 ± 2.31) compared to those reported by
Senior (PGY ≥ 3) 45 (47) residents from internal and family medicine
(5.98 ± 2.05) [P = 0.01], neurology (6.00 ± 2.00)
[P = 0.05], general surgery (6.78 ± 2.34) [P = 0.001],
Results and neurosurgery (6.75 ± 2.38) [P = 0.02].
Notably, on a scale of 1–10 (1 = no anxiety,
Of the initial 205 residents invited to participate in 10 = extreme anxiety), junior IMGs experienced
the study, 96 of them completed the survey (47% a higher anxiety level than senior IMGs (9 [8,10]
response rate). Regarding demographics, participants vs. 6 [2,8]) [P = 0.003]. Using the same scale,
were more equally represented in terms of gender, female residents with children expressed higher
age, and experience; however, medicine residencies, levels of anxiety than their male counterparts (8
U.S. citizens, and residents who had not been quar [7,9] vs. 5.5 [3,8.5]) in terms of getting childcare
antined were fairly overrepresented. Complete at home upon school and daycare closures, but the
respondent demographics are depicted in Table 1. difference was not statistically significant
Response rates among participating residency pro [P = 0.33].
grams can be viewed in Table 2. In addition, we found that 79% (76 of 96) of
residents agreed that the modified schedules (exam
Table 2. Survey response rate by residency program. ple: one week ‘on,’ one week ‘off’) implemented by
Total Response their residency programs to minimize exposure to
Residency Survey Respondents Residents Rate direct patient contact were an effective way to
Program (n = 96) (n = 205) (%)
handle resident education amid the outbreak. One
Medicine Programs
Family 7 21 33
survey respondent commented, ‘[o]ur department
Medicine did a great job of quickly shifting to virtual learn
Internal 36 100 36 ing and patient care such that it did not feel very
Medicine
stressful … our program director was beyond
Psychiatry 12 14 86
Neurology 15 15 100
amazing at helping us adapt to the change.’ Some
Surgery Programs other suggestions from survey participants to
General 18 41 44 further improve resident education amid the
Surgery COVID-19 crisis included: ‘more structured study
Neurosurgery 8 14 57
plans for downtime’; ‘more articles for us to read to
4 T. RANA ET AL.
help guide education goals’; and ‘suggest an alter before the COVID-19 crisis [P < 0.001]. No other
native patient/HIPAA safe communication platform significant associations were found to predict group
for clinical conferences.’ membership. Complete regression results can be
Furthermore, for study participants that experi viewed in eTable 2.
enced ‘work from home’ time as part of their mod
ified schedules, the extra time outside of the hospital Juniors vs. Seniors
was spent reading academic journals (73%, 70 of 96), A sequential logistic regression was performed to
doing practice questions (70%, 67 of 96), completing examine associations between survey responses and
other hospital work (68%, 65 of 96), working on residency experience (juniors or seniors). Overall, the
research (46%, 44 of 96), and/or volunteering (4%, 4 final model was statistically significant [(Χ[2](13,
of 96). One survey respondent noted, ‘ … you can N = 96) = 42.78, P < 0.001]. Five survey questions
argue this has been a blessing because I have used the were included in the logistic regression model that
time off to complete some research projects that have predicted residency experience. Seniors felt that the
lingered for months.’ pandemic was more disruptive on residency training
(6.13 ± 2.04) compared to juniors (5.69 ± 2.53)
[P = 0.02], but more seniors (89%, 40 of 45) reported
Primary outcome
that modified schedules were effective compared to
Stress during COVID-19 crisis juniors (71%, 36 of 51) [P = 0.05]. Fewer seniors (4%,
The overall linear multiple regression model was able 2 of 45) reported virtual meetings to be more effective
to explain 37% of the variance in stress [F than in-person meetings compared to juniors (20%,
(3,92) = 19.59, P < 0.001]. Three variables signifi 10 of 51) [P = 0.04]. Conversely, a greater proportion
cantly contributed to residents’ stress and were of seniors (82%, 37 of 45) reported virtual lectures to
included in the final model: anxiety regarding PPE be more effective than in-person lectures when com
[P < 0.001]; gender, with females reporting more pared with juniors (55%, 28 of 51) [P = 0.002].
stress (5.98 ± 1.85) than males (4.63 ± 2.13) Finally, seniors (7.20 ± 1.79) reported feeling more
[P = 0.03]; and the interaction between gender and confident to lead during a future clinical crisis com
anxiety concerning PPE, as females expressed more pared to juniors (6.22 ± 1.84) [P = 0.003]. No other
anxiety (5.67 ± 2.60) than males (4.44 ± 2.25) regard variables were found to be significantly different
ing PPE [P = 0.04]. Complete regression results can between junior and senior residents. Complete
be viewed in Table 3. regression results can be viewed in eTable 3.
b. Contributions: developed research question; per Internal Medicine PGY-3 at Allegheny General Hospital
formed literature search; developed initial survey; in Pittsburgh, PA
wrote introduction, discussion, conclusion, and Contributions: performed literature search; finalized
survey; edited manuscript
25% of results sections of manuscript; wrote back Jody Leonardo, MD
ground, objectives, and conclusion sections of a. Neurosurgery Residency Program Director at
abstract; created demographics and response rate Allegheny General Hospital in Pittsburgh, PA
tables; managed references; managed online b. Contributions: performed literature search;
supplement developed initial survey; edited manuscript
MS3 at Sidney Kimmel Medical College in Philadelphia, Neurosurgery Residency Program Director at Allegheny
PA General Hospital in Pittsburgh, PA
Contributions: developed research question; per Contributions: performed literature search; developed
formed literature search; developed initial survey; wrote initial survey; edited manuscript
introduction, discussion, conclusion, and 25% of results Sandeep Rana, MD, FAAN
sections of manuscript; wrote background, objectives, and
conclusion sections of abstract; created demographics and a. Neurology Residency Program Director at
response rate tables; managed references; managed online Allegheny General Hospital in Pittsburgh, PA
supplement b. Contributions: developed research question;
Christopher Hackett, MA obtained IRB approval; performed literature
a. Telemedicine Project Manager at the search; finalized survey; recruited residency
Neuroscience Institute of Allegheny Health programs to participate in study; edited
Network in Pittsburgh, PA manuscript
b. Contributions: performed literature search; cal Neurology Residency Program Director at Allegheny
culated all statistics and interpreted the results; General Hospital in Pittsburgh, PA
Contributions: developed research question; obtained
wrote methods and 75% of results sections of
IRB approval; performed literature search; finalized survey;
manuscript; wrote methods and results sections recruited residency programs to participate in study; edited
of abstract; created statistic results tables; edited manuscript
manuscript
Telemedicine Project Manager at the Neuroscience
Institute of Allegheny Health Network in Pittsburgh, PA Disclosures of interest
Contributions: performed literature search; calculated
all statistics and interpreted the results; wrote methods and None
75% of results sections of manuscript; wrote methods and
results sections of abstract; created statistic results tables;
edited manuscript References
Timothy Quezada, DO, MPH
[1] Coronavirus disease 2019 (COVID-19) Situation Report
a. Neurology Chief Resident at Allegheny General 72. Accessed 2020 May 10. https://apps.who.int/iris/bit
Hospital in Pittsburgh, PA stream/handle/10665/331685/nCoVsitrep01Apr2020-
b. Contributions: performed literature search; eng.pdfhttps://www.alleghenycounty.us/Health-
finalized survey; recruited residency programs Department/Resources/COVID-19/COVID-19.aspx
to participate in study; edited manuscript [2] Murphy B. COVID-19 and elective surgeries: 4 key
Neurology Chief Resident at Allegheny General answers for your patients. American Medical
Hospital in Pittsburgh, PA Association. Accessed May 10, 2020. https://www.
Contributions: performed literature search; finalized ama-assn.org/delivering-care/public-health/covid-19-
survey; recruited residency programs to participate in and-elective-surgeries-4-key-answers-your-patients
study; edited manuscript [3] 55 percent fewer Americans sought hospital care in
Abhishek Chaturvedi, MD march-april due to COVID-19, driving a clinical and
financial crisis in U.S. healthcare | Markets Insider.
a. Internal Medicine PGY-3 at Allegheny General Accessed May 11, 2020. https://markets.businessinsider.
Hospital in Pittsburgh, PA com/news/stocks/55-percent-fewer-americans-sought-
b. Contributions: performed literature search; hospital-care-in-march-april-due-to-covid-19-driving
advised about statistics and online supplement; -a-clinical-and-financial-crisis-in-u-s-healthcare-
edited manuscript 1029187091
Internal Medicine PGY-3 at Allegheny General Hospital [4] Murphy B How a residency program is protecting its
in Pittsburgh, PA surgeons during COVID-19. American Medical
Contributions: performed literature search; advised Association. cited May 10, 2020. https://www.ama-
about statistics and online supplement; edited manuscript assn.org/residents-students/residency/how-residency-
Veli Bakalov, MD program-protecting-its-surgeons-during-covid-19
[5] Murphy B Residency in a pandemic: how COVID-19
a. Internal Medicine PGY-3 at Allegheny General
is affecting trainees. American Medical Association.
Hospital in Pittsburgh, PA Accessed April 20, 2020. https://www.ama-assn.org/
b. Contributions: performed literature search; delivering-care/public-health/residency-pandemic-
finalized survey; edited manuscript how-covid-19-affecting-trainees
8 T. RANA ET AL.
[6] Gupta Y. Residents remaining flexible during [25] Robeznieks A. Extending IMG visas would boost efforts to
COVID-19 pandemic. The American Board of fight COVID-19. American Medical Association. cited
Radiology. Published March 24, 2020. cited 2020 Apr May 11, 2020. https://www.ama-assn.org/education/inter
20. https://www.theabr.org/blogs/residents-remaining- national-medical-education/extending-img-visas-would-
flexible-during-covid-19-pandemic boost-efforts-fight-covid-19
[7] Salari S “A terrifying privilege”: residency during the [26] COVID-19 FAQs: guidance for international medical
COVID-19 outbreak. AAMC. Accessed April 20, graduates. American Medical Association. Accessed
2020. https://www.aamc.org/news-insights/terrifying- May 11, 2020. https://www.ama-assn.org/education/
privilege-residency-during-covid-19-outbreak international-medical-education/covid-19-faqs-
[8] Guiding principles to protect resident & fellow physi guidance-international-medical-graduates
cians responding to COVID-19. American Medical [27] Grewal P. Invited Commentary: international medical
Association. cited Apr 20, 2020. https://www.ama-assn. graduates in the COVID-19 pandemic era. Neurology
org/delivering-care/public-health/guiding-principles- Blogs. Published April 20, 2020. Accessed 2020 May
protect-resident-fellow-physicians-responding 11. https://blogs.neurology.org/covid-19-coronavirus
[9] McGugan S. Medical school on bypass during the /invited-commentary-international-medical-graduates
SARS outbreak. Clin Invest Med. 2003;26(3):106. -in-the-covid-19-pandemic-era/
[10] Sherbino J, Atzema C. “SARS-Ed”: severe acute [28] Frieden J. COVID-19 is making the physician short
respiratory syndrome and the impact on medical edu age worse, groups say. MedPage Today. Published
cation. Ann Emerg Med. 2004;44(3):229–231. March 27, 2020. Accessed May 11, 2020. //www.med
[11] Three stages of GME during the COVID-19 pandemic. pagetoday.com/infectiousdisease/covid19/85661
cited May 11, 2020. https://acgme.org/COVID-19/Three- [29] Robeznieks A AMA fighting for IMG physicians on
Stages-of-GME-During-the-COVID-19-Pandemic several fronts with many allies. American Medical
[12] Chong A, Kagetsu N, Yen A, et al. Radiology resi Association. Accessed May 11, 2020. https://www.
dency preparedness and response to the COVID-19 ama-assn.org/education/international-medical-
pandemic. Acad Radiol. 2020 April 2;27:856–861. education/ama-fighting-img-physicians-several-fronts
[13] Anderson M, Turbow S, Willgerodt M, et al. -many-allies
Education in a crisis: the opportunity of our lives. [30] About ECFMG. ECFMG. Accessed May 11, 2020.
J Hosp Med. 2020 April 9;15:287–289. https://www.ecfmg.org/about/index.html
[14] DeFilippis EM, Stefanescu Schmidt AC, Reza N. Adapting [31] For providers and community leaders: helping people
the educational environment for cardiovascular manage stress associated with the COVID-19 virus-
fellows-in-training during the COVID-19 pandemic. PTSD: national center for PTSD. U.S. Department of
J Am Coll Cardiol. 2020 April 15;75:2630–2634. Veterans Affairs. Accessed May 11, 2020. https://www.
[15] Almarzooq Z, Lopes M, Kochar A. Virtual learning ptsd.va.gov/covid/COVID_providers_comm_leaders.
during the COVID-19 pandemic: a disruptive technol asp
ogy in graduate medical education. J Am Coll Cardiol. [32] Well-being in the time of COVID-19. Accessed May 11,
2020 April:S0735109720349172. Published online. 2020. https://dl.acgme.org/pages/well-being-in-the-time-
Doi: 10.1016/j.jacc.2020.04.015. of-covid-19
[16] Touch surgery - prepare for surgery. cited May 11, [33] Yong C. COVID-19: the isolation that has brought us
2020. https://www.touchsurgery.com/ together. J Am Coll Cardiol. 2020 April:
[17] Ganju A, Aoun SG, Daou MR, et al. The role of S0735109720349160. Published online. Doi: 10.1016/
simulation in neurosurgical education: a survey of 99 j.jacc.2020.04.014.
USA neurosurgery program directors. World [34] Bayham J, Fenichel EP. Impact of school closures
Neurosurg. 2013;80(5):e1–e8. for COVID-19 on the US health-care workforce and
[18] Choy I, Okrainec A. Simulation in surgery: perfecting the net mortality: a modelling study. Lancet Public
practice. Surg Clin North Am. 2010;90(3):457–473. Health. 2020;0(0). DOI:10.1016/S2468-2667(20)
[19] Hollander JE, Carr BG. Virtually perfect? 30082-7
Telemedicine for Covid-19. N Engl J Med. 2020;382 [35] Jacobs A, Richtel M, Baker M ‘At war with no ammo’:
(18):1679–1681. Doctors say shortage of protective gear is dire. The
[20] Hlavinka E. Psychiatrists anticipate mental health New York Times. https://www.nytimes.com/2020/03/
needs with COVID-19 – telemedicine an important 19/health/coronavirus-masks-shortage.html.
way to help. MedPage Today. Published March 24, Published March 19, 2020. Accessed 2020 May 15.
2020. Accessed 2020 May 11. //www.medpagetoday. [36] Ranney ML, Griffeth V, Jha AK. Critical supply
com/infectiousdisease/covid19/85576 shortages — the need for ventilators and personal
[21] Eno C, Correa R, Stewart NH, et al. Milestones protective equipment during the Covid-19 pandemic.
Guidebook for Residents and Fellows.:19. N Engl J Med. 2020;382(18):e41.
[22] Williams RG, George BC, Meyerson SL, et al. What factors [37] Shortage of personal protective equipment endanger
influence attending surgeon decisions about resident ing health workers worldwide. Accessed May 15, 2020.
autonomy in the operating room? Surg. 2017;162 https://www.who.int/news-room/detail/03-03-2020-
(6):1314–1319. shortage-of-personal-protective-equipment-
[23] Miller PW. Body language in the classroom. 2005;80 endangering-health-workers-worldwide
(8):28–30. Tech Alex. [38] Begging for thermometers, body bags, and gowns:
[24] Satell G. Why communication is today’s most impor U.S. Health care workers are dangerously
tant skill. Accessed May 16, 2020. https://www.forbes. ill-equipped to fight COVID-19. Time. Accessed
com/sites/gregsatell/2015/02/06/why-communication- May 15, 2020. https://time.com/5823983/corona
is-todays-most-important-skill/#30a30f3f1100 virus-ppe-shortage/
MEDICAL EDUCATION ONLINE 9