The change of the COVID-19 pandemic on medical education in Korea: a national survey of medical schools

Article information

Korean J Med Educ. 2023;35(4):349-361
Publication date (electronic) : 2023 December 1
doi : https://doi.org/10.3946/kjme.2023.272
1Department of Medical Education, CHA University School of Medicine, Pocheon, Korea
2Department of Internal Medicine, Inje University College of Medicine, Busan, Korea
3Department of Medical Humanities and Medical Education, School of Medicine, Kyungpook National University, Daegu, Korea
4Kyungpook National University Hospital, Daegu, Korea
Corresponding Author: Sanghee Yeo (https://orcid.org/0000-0002-6210-6789) Kyungpook National University School of Medicine, 90 Chilgokjungang-daero 136-gil, Buk-gu, Daegu 41405, Korea Tel: +82.53.950.4131 Fax: +82.53.423.1369 email: shyeo@knu.ac.kr
Received 2023 May 12; Revised 2023 August 18; Accepted 2023 September 8.

Abstract

Purpose

This study aims to investigate how medical schools in Korea managed their academic affairs and student support in response to the coronavirus disease 2019 (COVID-19) pandemic and their plans for the post-COVID-19 era.

Methods

An online survey was conducted, and a link to a questionnaire was distributed to all the administrators of the 40 medical schools in Korea. The final analysis data involved responses from 33 medical schools and 1,342 students. Frequency analysis, cross-tabulation analysis, Fisher’s exact test, and one-way analysis of variance were applied for statistical analysis.

Results

Regarding instruction methods, most medical schools in Korea transitioned from in-person learning to video-on-demand learning (51.5%) and real-time online learning (42.4%). Among the school leaders, 36.4% planned to continue offering online classes combined with in-person classes beyond the end of the pandemic. Among the students, the online class concentration and participation score was 3.0 points or lower, but the class understanding score was 3.6 points, above a moderate level.

Conclusion

Students cited the shorter times needed to attend school and being able to take classes repeatedly as advantages of online classes, and over one-third of medical schools intended to continue with a hybrid of in-person and online learning even after the COVID-19 pandemic restrictions end.

Introduction

In response to the rapid spread of coronavirus disease 2019 (COVID-19) across Korea from February 2020, the Ministry of Education recommended that medical schools discontinue all current course activities and postpone classes [1]. In response to this recommendation, medical schools that had already begun classes decided to discontinue or postpone lectures and clinical clerkships. However, the consensus was that classes could not be postponed further because it was necessary to follow the academic calendar and the schedule for the Korean Medical Licensing Examination; to accommodate the preexisting schedule, each medical school shifted from in-person to online classes and reduced opportunities for clinical clerkship or in-person clinical clerkship courses [2]. Online classes have been operated through video-on-demand (VOD) learning, real-time online learning, and online experiments and practice [3], and some clinical clerkship courses have been replaced with alternative activities [4-6]. In response to the prolonged COVID-19 infection conditions, the Korea Association of Medical Colleges (KAMC) distributed the “Guidance for medical students’ responses to COVID-19 in Korea” to Korea’s 40 medical schools in December 2020 to guide schools on continuing operations (lectures, assessments, administrative support, and so forth) during the pandemic conditions [7].

The COVID-19 pandemic and associated restrictions brought about the first implementation of online coursework in Korea’s medical schools. However, the issues brought about by this implementation were not unique to Korea; medical schools in every country reduced or suspended all in-person curriculum activities and switched to online coursework [3]. These conditions created ample opportunities for researchers to study the challenges, opportunities, and current conditions related to online classes in the COVID-19 environment at individual schools [8] and nationally [9].

In Korea as elsewhere, administrators at individual colleges assessed how best to maintain operations and meet students’ needs while adhering to COVID-19 pandemic restrictions on in-person academic activities. However, there has not to date been an examination of how medical schools nationwide responded to the pandemic restrictions. Against this backdrop, circumstances like the COVID-19 pandemic can lead to significant academic gaps for students. There is a need to understand how medical schools responded to the academic crisis and how well students adapted to emergency learning measures. Prolonged academic gaps can impact the annual supply of medical professionals and have macro-level implications for public health. Therefore, this study has two main objectives. Firstly, the study aims to investigate how schools first responded to the spread of infectious diseases like COVID-19, with the purpose of gathering foundational data for establishing future crisis response systems. Secondly, considering the uncertainty surrounding the possibility of resuming in-person classes for the semester after a delay of more than a month, the study aims to assess the success of the swift transition to emergency online learning. This transition was adopted as an alternative to in-person classes. The study also assesses whether the classes were effective, while also exploring the potential of online education post-COVID.

METHODS

To achieve this study’s aim, we administered a nationwide cross-sectional survey of students and administrators to all 40 medical schools in Korea. We administered the survey from April 26 to May 20, 2021, and received responses from a total of 33 medical school administrators and 1,344 premedical and medical students; from the latter, we excluded one student who did not give consent and one whose answers did not appear to be sincere. We used G*Power ver. 3.1.9.7 (Heinrich-Heine-Universität Düsseldorf, Düsseldorf, Germany; http://www.gpower.hhu.de/) to calculate the minimum student sample size for analysis because it was difficult to practically identify the source population. The necessary sample size for students was 324 persons when recalculated with six-group one-way analysis of variance (ANOVA), 95% confidence level, 5% margin of error, and effect size 0.25 (medium). The number of student respondents exceeded the necessary sample size calculated.

We developed the questionnaires for school administrators (one designated from each school) with reference to previous studies on online class experiences during the COVID-19 pandemic [9] and based on interviews with two physicians. The school questionnaire had 38 questions, consisting of only nominal scales: seven questions related to COVID-19 experiences, nine regarding online classes and management of academic affairs, 12 on student guidance and support, seven on student assessment, and three on teaching development. A representative of each school was asked to answer this questionnaire. The student questionnaire consisted of 31 questions (25 items rated on a 5-point scale, Cronbach’s α=0.992); there were five questions on online class experiences, 24 on satisfaction with online lectures and practices, and two regarding opinions on the post-COVID-19 direction of medical education.

In developing the study questionnaire, seven experts conducted four rounds of assessments for content validity: three who specialized in education and one each from neuropsychiatry, internal medicine, pediatrics, and family medicine; all experts were working at medical schools at the time. The most common way to verify content validity is a panel of experts [10], and Lynn [11] recommends a panel of five to 10 experts; we selected seven as panel members. The panel members discussed and refined the questionnaire items until they reached consensus on for each item; the agreed-upon items showed calculated content validity indices of 0.78 or higher [12].

The surveys were administered via a Google Forms link (Google LLC, Mountain View, USA), and only respondents who gave online consent at the beginning of the survey could complete it. All respondents were asked to answer each question only once. To guarantee anonymity, we did not collect any identifying information, but participants were invited to provide their email addresses if they wished to receive a gift coupon in return for completing the survey. Following the surveys, we analyzed the responses from the medical school administrators and students using frequency analysis, cross-tabulation analysis, Fisher’s exact test, and one-way ANOVA to analyze the differences in students’ satisfaction with various instructional methods.

We performed all statistical analyses using IBM SPSS Statistics for Windows ver. 25.0 (IBM Corp., Armonk, USA). The present study protocol was reviewed and approved by the institutional review board of Kyungpook National University Hospital (approval no., KNU-2021-0053). Informed consent was submitted by all subjects when they enrolled.

RESULTS

1. General characteristics of the respondents

Table 1 gives the general characteristics of the 33 medical schools and 1,342 premedical and medical school students who answered the questionnaires.

General Characteristics of Survey Respondents

2. School responses to COVID-19 pandemic measures

Table 2 outlines how the medical school leaders in this study responded to and accommodated Korea’s nationwide COVID-19 infection control restrictions (e.g., managing academic affairs, staffing online classes, and securing partnerships with hospitals for clinical clerkships).

How Did School Leaders Operate under COVID-19 Restrictions?

Among the 33 medical schools, the responsibility of decision-making regarding COVID-19 prevention and academic operations was predominantly carried out by responsible professors or deans (44.7%). This was followed by dedicated teams or committees, which accounted for 31.6%. About 70% of the responding medical schools developed their own guidelines for COVID-19 prevention measures. However, for class and academic guidelines, the most common response (51.5%) indicated adherence to the university headquarters’ guidelines. The distribution of COVID-19 prevention guidelines primarily took place preemptively between February and April, before the government announced social distancing measures in June 2021. During this period, 19 medical schools (57%) distributed their self-developed guidelines. Regarding the transition to online classes, 27 medical schools (81.8%) allocated resources and personnel to support the transition, and 26 medical schools (79.7%) reported smooth cooperation with hospitals for clinical training during the COVID-19 pandemic.

The Fisher’s exact test results indicated no significant differences among schools in the number of students, the organization forms, the regional timing of developing and releasing guidance on preventive measures against COVID-19 and guidelines on managing academic affairs, the staffing of online classes, or the cooperation of hospitals for clinical clerkships.

3. Curriculum changes to accommodate COVID-19 pandemic restrictions

Regarding the medical schools’ online instruction methods, 52% of the responding administrators mainly provided video lectures, and 42% focused on real-time online classes (Table 3). The platform most commonly used in real-time classes was Zoom (Zoom Video Communications Inc., San Jose, USA) (68%). Medical schools decided (36%) or considered deciding (61%) to simultaneously operate in-person and online classes even after the end of the COVID-19 pandemic.

Online Classes and Management of Academic Affairs

For the basic medical science practice, online and in-person classes were combined (73%), and 25% of the administrators reported that the clinical training curriculum had been the most difficult to operate; most of the medical schools (88%) reduced the scale and scope of curriculum operation. There were also some obstacles to having practical training in external institutions and meeting patients in person, but the training for clinical performance improvement using standardized patients or body models was relatively smooth. Fisher’s exact test results indicated no differences in the numbers of students, organization forms, region-specific online instructional methods, or operations of basic medical science practice and clinical clerkship training.

4. Student assessment under COVID-19 pandemic restrictions

Student assessments during COVID-19 are shown in Table 4. Among the schools, 20 (60.6%) conducted in-person mid-term or final exams, and 11 schools (33.3%) conducted a combination of in-person and online exams. Regarding clinical assessments, the most common response was in-person evaluations with 21 schools (63.6%), followed by report-based assessments (12.1%). The challenges associated with student assessments were mainly linked with securing exam venues and supervision due to social distancing measures for infection prevention (34.3%). Additionally, maintaining student safety and hygiene in exam venues (25.7%) posed difficulties. Seven schools (20%) reported challenges with online assessments during online classes. Regarding the introduction or continuation of online assessments post-COVID-19, more than half (53.1%) responded “no.” However, 49.4% showed positive responses or responses indicating ongoing discussions.

Student Assessments

5. Students’ assessment of their experiences with online learning

Table 5 shows student satisfaction by grade with lectures, discussions, experiments, and practice training. Students were highly satisfied with face-to-face online teaching for discussions, experiments, and practical training, but preferred VOD online for the lectures. One-way ANOVA to calculate differences in student satisfaction with the teaching methods between grades revealed significant differences for VOD, face-to-face, and blended learning lectures. For VOD, first- and second-year medical students, who mainly learn basic medicine and clinical medicine, were more satisfied than freshmen and prospective medical students (F=4.970, p<0.001). For face-to-face instruction, the first-grade premedical students reported higher satisfaction than that of first-, second-, and third-year medical students. In contrast, the third-year students who were completing their core clinical clerkship rotations had the lowest level of satisfaction with the face-to-face method, and there were also differences between the first- and second-year premedical students and the fourth-year medical students (F=8.271, p<0.001).

Student Satisfaction with COVID-19-Related Instructional Changes

DISCUSSION

We conducted this study in the form of a survey of medical school administrators and students to evaluate the overall effects of the COVID-19 pandemic on education at Korean medical schools; here, we discuss our results. First, there were no significant differences among the medical schools for location, school type, or entrance quota-specific countermeasures. Most schools had produced and distributed guidance on preventive measures against COVID-19 and on managing academic affairs when COVID-19 had initially emerged, immediately establishing personnel or organizations responsible for adjusting to changing demands. In addition, most schools had personnel dedicated to ensuring that online learning environments operated smoothly for students and professors. Globally, many medical schools and the Association for Medical Education in Europe presented guidelines on school management [13], production of learning materials [14], online class operations [15], practice [16], assessment [17], and leadership education [18].

Second, because the COVID-19 situation forced medical schools to shorten the duration of clinical clerkships or reduce the scope of the curricula, medical students demonstrated insufficient experience when they entered clinical practice. As noted earlier, in-person coursework that involved face-to-face interactions with patients faced some obstacles, although the practice courses using body models or standardized patients were implemented relatively smoothly. Medical school leaders took various measures to reinforce clinical clerkship programs. For example, Lee et al. [19] proposed role plays as an alternative practice method in to response to decreasing numbers of pediatric patients, increasing numbers of parents who refused to allow medical students to examine their children, and reduced numbers of ward rounds with three or more students.

Similar situations were faced by medical schools amid the COVID-19 pandemic across the world. The Association of American Medical Colleges recommended that US medical schools discontinue any student activities involving patient contact [20]. Thus, clinical clerkship training was replaced with remote medical treatment practice [4], virtual clerkships [5], or clinical simulations added to clerkships [6]. At this point, we want to stress the shortcomings of graduate medical education and clinical clerkships during the COVID-19 crisis. In this regard, providing students from the COVID-19 era with additional education programs as part of their medical internships is necessary. Additionally, we recommend future quantitative or in-depth qualitative cohort studies to measure the capabilities and professionalism of the doctors who were medical students during the COVID-19 pandemic era.

Third, leaders at most medical schools in Korea intended to keep providing online classes even after the end of the COVID-19 pandemic or were considering doing so. We predict that instead of operating regular classes online, as they did during the COVID-19 crisis, school administrators will utilize online learning environments for supplementary classes or remedial education to close learning gaps between students or offer advanced classes to academically talented students.

Samarasekera et al. found that during the COVID-19 crisis, medical schools had successfully introduced online learning using technology-oriented innovations [21], and we predict that the use of emergent technologies (e.g., artificial intelligence for adaptive learning, virtual simulation, and telehealth) for education will necessarily bring changes to post-COVID-19 medical education. Amid the spread of COVID-19, medical school leaders utilized a wide range of technologies to implement online learning, and scholars produced many reports on real-world applications of these technologies and teaching methods. For instance, McClure and William [22] in 2021 reported on the use of Gather, a metaverse platform, finding that it had been helpful for self-regulated learning.

Medical schools need to devise various teaching–learning strategies that could enable students to pay attention to online courses, given that many schools intend to utilize online classes in combination with in-person classes even after the end of COVID-19.

Fourth, many medical schools maintained in-person student assessments because of concerns about cheating on online student tests, although school leaders have used platforms such as Google Forms, Socritive (Showbie Inc., Edmonton, Canada), and Kahoot! (Clever Inc., Oslo, Norway) for formative assessments not related to academic records. To understand student responses to online testing, Yeo and Kim [23] analyzed students’ satisfaction with the online video tests conducted by graduate schools of medicine in Korea and found that students appreciated the easy access irrespective of location, the convenience, and the lack of travel time to test sites; however, they were concerned that unstable networks threatened their ability to complete their tests and expressed concerns about classmates’ cheating.

In fact, not only in Korea but around the world, school leaders expressed deep concerns about cheating during the COVID-19 pandemic [24]. However, schools in Korea used certain technologies to prevent cheating: keyboard authentication [25], PC cameras [26], face recognition [27], and motion detection [28]; nontechnical strategies to prevent cheating involved ethics statements for students and open-book exams [19]. In addition, there are reports where online assessments were conducted by Korean colleges related to health care [23]. Therefore, we conclude that fully online assessments can be conducted at medical schools and that medical school administrators expand online assessments in case of future disasters.

As a result of examining students’ satisfaction with online classes, they were satisfied with lectures in online classes as in other studies [29]; however, the discussions, experiments, and practice classes showed higher satisfaction with face-to-face classes. First-year premedical students preferred real-time face-to-face interactions with professors to VOD lectures. In contrast, the medical school students showed low overall satisfaction with all teaching methods except for VOD. First-year premedical students have described the first year of medical school as a critical transition during which they need to adapt simultaneously from being high-school students to being university and medical students [30]; we consider this the reason that these students need and benefit from more real-time interactions with their professors than students in other grades require. In contrast, first- and second-year medical students who are learning basic and clinical medicine seem to prefer repetitive individual learning through VOD.

The limitations of this study lie in the uneven grade-specific distribution of respondents, even though the link for the questionnaire was transmitted to medical students nationwide. There were many more first-year premedical students than students in any other grade. Nevertheless, this study is significant in that we received input from nearly all medical schools in Korea, our data referred to the initial stage of COVID-19, and we simultaneously targeted students and school leaders, the primary stakeholders in education.

In terms of future studies, we suggest that researchers conduct in-depth studies related to the study results stated above. We propose examinations of whether schools complied with their own COVID-19 guidelines. During the pandemic, medical schools promptly established emergency plans by referring to guidelines provided by various institutions in the areas of academic scheduling (classes and assessments), infection prevention, and clinical practice. Academic scheduling was based on the university’s guidance with input from KAMC, while individual medical schools created their own guidelines. Infection prevention followed guidelines from national agencies and hospitals, and clinical practice guidelines were set by hospitals, KAMC, and medical schools. Based on this experience, it was evident that effective decision-making involving multiple institutions is essential to successfully manage medical school operations during emergencies. This includes matters such as teaching and assessment methods, infection prevention, and clinical practice. To prepare for potential future pandemic scenarios, it will be necessary to identify decision-requiring matters, establish a hierarchy of decision-making for these issues, and develop “Emergency decision-making and academic operation measures” and relevant strategies.

We also propose, cohort studies of medical and graduate students who underwent training during the COVID-19 pandemic, studies on the effectiveness and long-term suitability of the variety of online COVID-19-era instruction and assessment methods for post-COVID-19 application, and studies on students’ emotional experiences during the COVID-19 crisis.

Acknowledgements

None.

Notes

Funding

This work was supported by Biomedical Research Institute grant, Kyungpook National Unviversity Hospital (2021).

Conflicts of interest

No potential conflict of interest relevant to this article was reported.

Author contributions

All authors contributed to set the concept and design of the research. SJN and SY contributed to data collection, analysis and interpretation. SJN and SY drafted the manuscript, reviewed, edited the manuscript. All authors read the manuscript critically, participated in revising the manuscript and approved the final manuscript.

References

1. Ministry of Education. Preparation of guidelines for academic operations to cope with COVID-19. https://www.moe.go.kr/boardCnts/viewRenew.do?boardID=294&boardSeq=79711&lev=0&searchType=null&statusYN=W&page=20&s=moe&m=020402&opType=N. Published 2020. Accessed October 9, 2021.
2. Ministry of Education. Announcement of academic management and support measures in the field of education to respond to COVID-19. https://www.moe.go.kr/boardCnts/viewRenew.do?boardID=294&boardSeq=79917&lev=0&searchType=null&statusYN=W&page=18&s=moe&m=020402&opType=N. Published 2020. Accessed October 9, 2021.
3. Rose S. Medical student education in the time of COVID-19. JAMA 2020;323(21):2131–2132.
4. Coffey CS, MacDonald BV, Shahrvini B, Baxter SL, Lander L. Student perspectives on remote medical education in clinical core clerkships during the COVID-19 pandemic. Med Sci Educ 2020;30(4):1577–1584.
5. Pollom EL, Sandhu N, Frank J, et al. Continuing medical student education during the coronavirus disease 2019 (COVID-19) pandemic: development of a virtual radiation oncology clerkship. Adv Radiat Oncol 2020;5(4):732–736.
6. Everard KM, Schiel KZ. Changes in family medicine clerkship teaching due to the COVID-19 pandemic. Fam Med 2021;53(4):282–284.
7. Korea Association of Medical Colleges. Guidance for medical students’ responses to COVID-19 in Korea. https://www.kamc.kr/main/index.php?m_cd=14&b_id=20210107171489765. Published 2021. Accessed October 11, 2021.
8. Theoret C, Ming X. Our education, our concerns: the impact on medical student education of COVID-19. Med Educ 2020;54(7):591–592.
9. Choi B, Jegatheeswaran L, Minocha A, Alhilani M, Nakhoul M, Mutengesa E. The impact of the COVID-19 pandemic on final year medical students in the United Kingdom: a national survey. BMC Med Educ 2020;20(1):206.
10. Moon SB. Successful dissertations and theses: a practical and comprehensive guide to content and process Seoul, Korea: Hakjisa; 2003.
11. Lynn MR. Determination and quantification of content validity. Nurs Res 1986;35(6):382–385.
12. Lee EH. Psychometric property of an instrument 1: content validity. Korean J Women Health Nurs 2021;27(1):10–13.
13. Muller D, Parkas V, Amiel J, et al. Guiding principles for undergraduate medical education in the time of the COVID-19 pandemic. Med Teach 2021;43(2):137–141.
14. Stojan J, Haas M, Thammasitboon S, et al. Online learning developments in undergraduate medical education in response to the COVID-19 pandemic: a BEME systematic review: BEME guide no. 69. Med Teach 2022;44(2):109–129.
15. Sandars J, Correia R, Dankbaar M, et al. Twelve tips for rapidly migrating to online learning during the COVID-19 pandemic. MedEdPublish 2020;9:82.
16. Kache S, Chisti MJ, Gumbo F, et al. COVID-19 PICU guidelines: for high- and limited-resource settings. Pediatr Res 2020;88(5):705–716.
17. Rahim AF. Guidelines for online assessment in emergency remote teaching during the COVID-19 pandemic. Educ Med J 2020;12(2):59–68.
18. McKimm J, Ramani S, Forrest K, et al. Adaptive leadership during challenging times: effective strategies for health professions educators: AMEE guide no. 148. Med Teach 2023;45(2):128–138.
19. Lee JY, Sung E, Lee J, Lim KY, Han S. Challenges and tasks facing online classes during the COVID-19 pandemic. J Educ Technol 2020;36(3):671–692.
20. Goldenberg MN, Hersh DC, Wilkins KM, Schwartz ML. Suspending medical student clerkships due to COVID-19. Med Sci Educ 2020;30(3):1273–1276.
21. Gaur U, Majumder MA, Sa B, Sarkar S, Williams A, Singh K. Challenges and opportunities of preclinical medical education: COVID-19 crisis and beyond. SN Compr Clin Med 2020;2(11):1992–1997.
22. McClure CD, Williams PN. Gather.town: an opportunity for self-paced learning in a synchronous, distance-learning environment. Compass J Learn Teach 2021;14(2):1–19.
23. Yeo S, Kim DJ. An analysis on the satisfaction of real-time online tests from a medical school by gender, age, and test area of students during COVID-19. J Learn Cent Curric Instr 2021;21(23):805–818.
24. Comas-Forgas R, Lancaster T, Calvo-Sastre A, Sureda-Negre J. Exam cheating and academic integrity breaches during the COVID-19 pandemic: an analysis of internet search activity in Spain. Heliyon 2021;7(10)e08233.
25. Ko J, Shim J, Kim H. Adaptive keystroke authentication method for online test. J Korea Multimed Soc 2008;11(8):1129–1137.
26. Ko J, Shim J, Kim H. A system for improving fairness of online test using camera. J Korea Multimed Soc 2009;12(10):1427–1435.
27. Kim B, Kim S, Park J, Han S, Seok H. Design of the online exam cheating prevention system through facial recognition technology. Paper presented at: Proceedings of Korean Industrial Engineering Association’s Autumn Conference; November 19, 2016; Seoul, Korea.
28. Ko J, Shim J, Kim H. A study of cheat prevention method for online test using image frame analysis. J Korean Inst Inf Technol 2009;7(5):313–320.
29. Wang C, Xie A, Wang W, Wu H. Association between medical students’ prior experiences and perceptions of formal online education developed in response to COVID-19: a cross-sectional study in China. BMJ Open 2020;10(10)e041886.
30. Picton A, Greenfield S, Parry J. Why do students struggle in their first year of medical school?: a qualitative study of student voices. BMC Med Educ 2022;22(1):100.

Article information Continued

Table 1.

General Characteristics of Survey Respondents

Respondents Category No. (% of respondents)
Medical schools
 Quota Fewer than 60 students 14 (42.4)
More than 60 and fewer than 100 10 (30.3)
100 or more 9 (27.3)
 School type National school 10 (30.3)
Private school 33 (69.7)
 Region Metropolitan area 12 (36.4)
Non-metropolitan area 21 (63.6)
 Total 33
Students
 Grade 1st-grade premedical student 356 (26.5)
2nd-grade premedical student 195 (14.5)
1st-grade medical student 252 (18.2)
2nd-grade medical student 249 (18.6)
3rd-grade medical student 144 (10.7)
4th-grade medical student 146 (10.9)
 Gender Male 771 (57.5)
Female 571 (42.5)
 Total 1,342

Table 2.

How Did School Leaders Operate under COVID-19 Restrictions?

Contents No. of schools (% of respondents)
1. Was there an organization/committee/faculty staff responsible for decision-making to organize preventive measures for COVID-19 and managing academic affairs?
Professor or dean in charge 17 (44.7)
Dedicated organization or committee 12 (31.6)
Clinical organization or committee 5 (13.2)
Other/none 4 (10.5)
2. What standards did the guidelines for preventive measures against COVID-19 follow?
Medical school’s guideline 23 (69.7)
Government’s guideline 8 (24.2)
The university headquarters’ guideline 1 (3.0)
Affiliated hospital’s guideline 1 (3.0)
3. What standards did the guidelines for lectures, practice training, and student guidance, and so forth follow?
Medical school’s guideline 7 (21.2)
This school’s guidelines or revision 17 (51.5)
KAMC’s guidelines or revision 4 (12.1)
The school’s, medical center’s, or KAMC’s revision 2 (6.1)
None 3 (9.1)
4. When were the guidelines distributed?
During the early stages of COVID-19, and its spread was related to ”Shincheonji” (name of religious group) (February 2021) 8 (24.2)
When the disease began to evolve to become a pandemic (March to April 2021) 11 (33.3)
When the government’s social distancing policy was announced (June 2021) 10 (30.3)
None 3 (9.1)
Missing 1 (3.0)
5. Were there any departments/personnel for online class support?
Yes 27 (81.8)
No 6 (18.2)
6. How cooperative were hospitals during clinical clerkship training?
Very cooperative 8 (24.2)
Somewhat cooperative 18 (54.5)
Moderate 7 (21.2)

COVID-19: Coronavirus disease 2019, KAMC: Korea Association of Medical Colleges.

Table 3.

Online Classes and Management of Academic Affairs

Contents No. of schools (% of respondents)
1. What online instructional method was used the most?
Uploading instructional videos 17 (51.5)
Real-time online learning 14 (42.4)
In-person learning 1 (3.0)
Prior presentations of videos and real-time online learning 1 (3.0)
2. What program for online classes was used the most?
Zoom 27 (67.5)
Google Meet 5 (12.5)
WebEx 3 (7.5)
Gotowebinar 1 (2.5)
MS teams 2 (5.0)
Own LMS 2 (5.0)
3. What training method was used for basic medicine science practice?
Online and in-person training 24 (72.7)
In-person training 6 (18.2)
Online training 3 (9.1)
4. What operation method was used for clinical clerkship training?
Reduction in the duration or scope 30 (90.9)
Implemented as planned 2 (6.1)
Others 1 (3.0)
5. What was considered insufficient for clinical clerkship training?
Preliminary medical examination and observation of ambulatory care 44 (43.1)
Extracurricular activities for practical training 26 (24.8)
Overseas dispatch and practical training 20 (19.0)
Training with standardized patient 9 (8.6)
Surgical training with model 3 (2.9)
6. Have you operated extracurricular training?
Totally suspended 18 (54.5)
Partially implemented 13 (39.4)
Implemented as planned 2 (6.1)
7. What was considered the most challenging in relation to managing academic affairs (multiple responses allowed)?
Operation and progress of clinical clerkship training 23 (25.3)
Method for student assessment 16 (17.6)
Teaching development for the execution of online classes 14 (15.4)
Personal assistance to support online classes 13 (14.3)
Preparation for online classes 13 (14.3)
Provisions of the equipment and space necessary for online classes 10 (11.0)
8. Do you have future plans for the partial introduction of online classes after the end of COVID-19?
None. Return to the pre-COVID-19 instructional methods 1 (3.0)
Provisions of some or many online classes 12 (36.4)
Under discussion 20 (60.6)

COVID-19: Coronavirus disease 2019.

Table 4.

Student Assessments

Contents No. of schools (% of respondents)
1. How did you implement mid-term or term-end examinations during the COVID-19 crisis?
Full in-person classes 20 (60.6)
Partial in-person examinations + partial online examinations 7 (21.2)
Mostly in-person examinations + partial online examinations 4 (12.1)
The transition from online examinations to full in-person examinations 2 (6.1)
2. What method was used to evaluate basic medicine science practice?
Full in-person classes 21 (63.6)
Replaced with report 4 (12.1)
Hybrid (partially online and partial in-person) classes 2 (6.1)
Online examinations 1 (3.0)
3. What was considered the most challenging in relation to student evaluation (multiple responses allowed)?
Securing test sites and supervisors due of social distancing 12 (34.3)
Prevention and control against COVID-19 for test sites and students 9 (25.7)
Implementation of formative evaluation in online classes 5 (14.3)
Students’ reluctance to undergo in-person examinations 3 (8.6)
Introduction and implementation of online examinations 3 (8.6)
Implementation of assessments using PBL TBL in online classes 2 (5.7)
There was nothing difficult, particularly 1 (2.9)
4. Do you intend to introduce or maintain an online assessment system even after the end of COVID-19?
Yes 8 (24.2)
No 17 (51.5)
Under discussion 5 (15.2)
Missing 3 (9.1)

COVID-19: Coronavirus disease 2019, PBL: Problem-based learning, TBL: Team-based learning.

Table 5.

Student Satisfaction with COVID-19-Related Instructional Changes

Instructional method Grade No. Satisfaction F Post Hoc (Tukey)
Lecture
 VOD 4.970*** b>a, c>a, b>e, c>e, d>e
1st-year premedical studenta 345 3.83±1.02
2nd-year premedical student 186 3.87±1.03
1st-year medical studentb 236 4.09±1.03
2nd-year medical studentc 229 4.13±1.03
3rd-year medical studentd 131 4.10±1.03
4th-year medical studente 129 3.73±1.14
Total 1,256 3.96±1.05
 Real-time online 0.995
1st-year premedical student 349 3.17±1.06
2nd-year premedical student 193 2.98±1.03
1st-year medical student 246 3.17±1.12
2nd-year medical student 245 3.19±1.10
3rd-year medical student 134 3.15±1.07
4th-year medical student 140 3.15±1.14
Total 1,307 3.14±1.08
 Face-to-face 8.271*** a>b, a>c, a>d, f>b, f>d, e>d
1st-year premedical studenta 199 3.50±1.05
2nd-year premedical studentf 132 3.43±0.96
1st-year medical studentb 173 3.07±1.06
2nd-year medical studentc 169 3.12±1.12
3rd-year medical studentd 98 2.83±1.15
4th-year medical studente 117 3.41±0.99
Total 888 3.25±1.08
 Blended learning 3.534** a>d
1st-year premedical studenta 188 3.29±1.03
2nd-year premedical student 120 3.11±1.03
1st-year medical student 169 2.99±1.07
2nd-year medical student 136 2.98±1.06
3rd-year medical studentd 87 2.84±1.02
4th-year medical student 84 2.94±0.99
Total 784 3.06±1.05
Discussion class
 Face-to-face 2.712* e>c
1st-year premedical student 30 3.43±0.90
2nd-year premedical student 29 3.24±0.99
1st-year medical student 24 3.17±1.01
2nd-year medical studentc 39 2.90±0.99
3rd-year medical student 19 2.79±1.13
4th-year medical studente 33 3.58±0.94
Total 174 3.20±1.01
 Online 1.269
1st-year premedical student 161 3.04±1.09
2nd-year premedical student 108 2.99±1.26
1st-year medical student 87 3.26±1.03
2nd-year medical student 121 3.24±1.11
3rd-year medical student 67 2.97±1.28
4th-year medical student 59 3.00±1.11
Total 603 3.09±1.15
Experiments and practice training
 Face-to-face 0.556
1st-year premedical student 64 3.73±1.01
2nd-year premedical student 52 3.69±0.94
1st-year medical student 109 3.56±1.13
2nd-year medical student 111 3.57±1.01
Total 336 3.62±1.04
 Online 0.405
1st-year premedical student 97 3.09±1.14
2nd-year premedical student 73 3.11±1.30
1st-year medical student 141 3.21±1.17
2nd-year medical student 106 3.25±1.04
Total 417 3.17±1.15

Data are presented as mean±standard deviation, unless otherwise stated. Statistically significant results are marked in bold.

COVID-19: Coronavirus disease 2019, VOD: Video-on-demand.

*

p<0.05.

**

p<0.01.

***

p<0.001.