Pre-clerkship students’ perception and learning behavior of online classes during coronavirus disease 2019 pandemic

Kang, Ye Ji; Kim, Do-Hwan; Ye Ji Kang; Do-Hwan Kim

doi:10.3946/kjme.2021.194

Korean J Med Educ > Volume 33(2); 2021 > Article

Kang and Kim: Pre-clerkship students’ perception and learning behavior of online classes during coronavirus disease 2019 pandemic

Short Communication

Korean J Med Educ 2021; 33(2): 125-131.

Published online: May 26, 2021

DOI: https://doi.org/10.3946/kjme.2021.194

Pre-clerkship students’ perception and learning behavior of online classes during coronavirus disease 2019 pandemic

Ye Ji Kang

, Do-Hwan Kim

Department of Medical Education, Hanyang University College of Medicine, Seoul, Korea

Corresponding Author: Do-Hwan Kim (https://orcid.org/0000-0003-4137-7130) Department of Medical Education, Hanyang University College of Medicine, 222-1 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea Tel: +82.2.2220.0693 email: mededkimdh@hanyang.ac.kr

Received March 8, 2021 Revised April 14, 2021 Accepted May 4, 2021

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Purpose

This study aims to analyze pre-clerkship medical students’ learning strategies and perceptions in online classes during the coronavirus disease 2019 pandemic.

Methods

To develop the survey items, 20 pre-clerkship students were interviewed about their learning experiences in the first semester of 2020. A total of 425 pre-clerkship students have participated in the survey, which comprised four parts (general experience, learning strategies, important features, and overall satisfaction).

Results

Before classes began, students generally had “neutral expectations” about online classes (2.90 out of 5). At the end of the semester, overall satisfaction with the curriculum was moderate (3.04 out of 5). Premedical students reported lower scores in “daily study hours” and “regular lifestyle” and higher scores in “experience of playing recorded lectures solely for an attendance check” (p<0.001). In addition, first-year premedical students not only showed significantly lower utilization of learning strategies compared to other grades (p<0.001).

Conclusion

Although pre-clerkship students mostly shared similar perceptions and behaviors in their learning regardless of grade level, some characteristics were either more prominent in premedical students on the whole or limited to first-year premedical students.

Keywords: COVID-19, Online education, Online learning, Undergraduate medical education, Pre-clerkship students

Introduction

The coronavirus disease 2019 (COVID-19) pandemic caused sweeping changes in political, economic, and social aspects worldwide—and education was no exception. Particularly, the pandemic has “forced” classes to be non-contact based online lectures. Unlike the past, the professors are no longer able to “choose” between contact and non-contact methods based on their learning objectives and the type of educational content. Previous studies have reported that students prefer online classes mostly because they are liberated from restrictions in time and space and save time moving between classrooms [1]. However, in the absence of other options, learning at home can be an isolating experience, and, as it has been pointed out, COVID-19 has affected the mental health of college students across various dimensions [2].

Although some reviews reported that synchronous distance education is associated with higher satisfaction than traditional education [3], current evidence is not enough to conclude that curriculums conducted fully online would yield similar results. Moreover, previous studies reported during COVID-19 focus on the clinical workplace or clerkship phases of the undergraduate medical education program [4,5]. However, changes in the pre-clerkship curriculum cannot be overlooked, since premedical and preclinical education serve as the foundation for the later stages of medical school education. To improve online classes that are most likely to continue after the pandemic, it is crucial to understand students’ responses to educational changes brought on by COVID-19.

Therefore, this study aims to analyze the learning behavior and perception of online classes among students in the pre-clerkship phase who participated in full-scale online classes conducted during COVID-19.

Methods

1. Setting

In February 2020, in response to the spread of COVID-19, Hanyang University College of Medicine (HYUCM) switched all its lecture-oriented courses to an online platform (Blackboard). All online classes were subsequently delivered through this platform. Professors were able to choose between live-synchronous and recorded-asynchronous methods, according to their preferences.

2. Development of the survey

First, focus group interviews were conducted for 20 pre-clerkship students to develop survey questions. In the semi-structured interview, students were asked about experiences and thoughts on the “online learning environment”, “changes in learning strategies after the online classes”, and “the situation changed to online classes”. The collected data were transcribed, coded, and analyzed, resulting in two main themes: perception of online classes and characteristics of learning behavior in online classes. The final survey questions were developed after pilot tests for groups of medical education experts and students. The survey consisted of the following parts: general experiences, learning strategies, important features, perception of the professors and changes in interactions, and overall satisfaction. The items were measured on a 5- or 6-point Likert scale, depending on the specifics.

3. Data collection and analysis

The survey was conducted from June to July 2020 on students across four grades from premedical course (PM1 and PM2) to medical student (M1 and M2). For each item, we analyzed differences between the four grades of students using one-way analysis of variance. When statistically significant differences existed, we used Tukey’s honestly significant difference test for the post-hoc comparison and calculated eta squared as measures of the effect sizes. For all statistical analyses, IBM SPSS Statistics for Windows ver. 26.0 (IBM Corp., Armonk, USA) was used.

4. Ethics statement

This study was approved by the Institutional Review Board (IRB) of Hanyang University (approval no., HYU-2020-081). The IRB of Hanyang University waived the need for explicit consent from participants.

Results

1. Demographic characteristics

A total of 425 students from four grades responded to the survey, an overall response rate of 96.2%. The average age of the respondents was 20.8 years, and 73.7% were male. There was no statistically significant difference in gender (p=0.648) or grade point average (GPA) when compared to the previous semester (p=0.637) between the grades.

2. General experiences of online classes

On average, the utilization of online classes during the period of secondary education before entering medical school was low (2.68 out of 5). Moreover, 32.7% of the students responded that they had “hardly used” online classes, which resulted in a bimodal distribution pattern. “Expectations for online classes before the start of the semester” were mostly negative for PM1. Premedical students had significantly fewer “daily study hours” (p<0.001) and less “regular lifestyle” (p<0.001) when compared with M1 and M2 students, and their “experience of playing recorded lectures solely for attendance check” was significantly higher (p<0.001) (Table 1).

3. Learning strategies

The learning strategies most frequently used by medical students was “pausing for the purpose of learning” (4.12 out of 5), followed by “increasing playback speed” (3.82 out of 5) (Table 2). “Watching while taking notes”, “pausing for the purpose of refreshment”, and “repeated viewing of specific sections” were also strategies respondents used in more than half of the lectures. The numbers of students who studied without watching lectures or watched with decreased playback speed were few. PM1 students showed significantly lower utilization than students in the other three grades (p<0.001).

4. Important features of online classes

Regarding the various elements of online classes (Table 3), “good voice quality,” “using the virtual pointer,” “complying with the scheduled upload date,” and “organizing the videos concisely” received higher than 4 points, indicating that they were seen as important by the students. Although “encouraging active student participation” during real-time lectures was valued as the least important feature (2.31 out of 5) overall, PM1 valued this significantly higher than students in the other three grades (p<0.001).

5. Overall satisfaction

Overall satisfaction with the curriculum was moderate (3.04 out of 5), and satisfaction with the recorded lectures exceeded that of real-time lectures across all grades (PM1: 2.90 versus 3.17; PM2: 2.56 versus 3.07; M1: 3.43 versus 3.66; M2: 2.41 versus 3.66). Medical students were significantly more satisfied with the curriculum than premedical students (p<0.001).

Discussion

The results of this study suggested that findings could be grouped divided into “educational phase-independent finding” and “educational phase-dependent finding”.

In general, the relative ranking of items in one domain was found to be broadly similar among grades. First, students used “increasing playback speed” in nearly 70% of the lectures. This finding is consistent with previous studies, which showed that students spent about 40% less time watching video feeds compared to those provided in the on-site live lectures format [6]. Instead, it seems that students used their spare time to take notes and search for material online. Second, our findings demonstrate that regardless of grades, the two most important elements in online classes are “good voice quality” and “use of virtual pointers”. Maslow’s hierarchy of needs, which states that one is motivated to pursue higher-order needs only when the lowest order of “physiological needs” are met [7], might be relevant to this finding. Unlike face-to-face lectures, in online settings, the transmission of quality audio and video becomes an additional prerequisite [8]; low quality lectures would significantly hinder learning. That is, in online classes, the immediate focus is on the satisfaction of lower-order needs, such as better audio and video quality. Only then can students seek higher-order needs, such as self-actualization and fulfillment, through the online curriculum.

Meanwhile, most of the items showed significant differences in responses between grades. These significant differences can be largely categorized into two types: first, those between premedical and medical students, and second, those between the PM1 and the other groups. The prominent characteristics of medical students, compared to premedical students, are: more daily studying hours; not viewing lectures simply for attendance checks; more active use of various learning strategies; and higher satisfaction with the curriculum. It has long been pointed out that premedical students often display problems related to unclear goals, poor identity as a medical student, and lowered motivation for learning. The current selection criteria of residency training programs, which only consider the GPA of the medical course, are assumed to be the principal cause [9]. Moreover, the demanding nature of the medical curriculum requires students to bear a significant workload. During the process, students usually adapt by aligning their behaviors with these external demands. In this regard, medical students’ studying strategies and resource management behaviors are consistent with the characteristics that reportedly contribute to high academic achievement [10].

Some items were discerned only in PM1 students. First, they utilized various learning strategies lesser, on average, when compared to students in other grades, and it suggests that so-called millennial students’ familiarity with technology does not necessarily guarantee its proficient use. Second, the students were less likely to make use of peer-to-peer collaboration while studying. The PM1 students might have struggled to form social relationships within the new environment of the medical school. The longer this situation prolongs, the more the probability of undeveloped collegiality negatively affecting PM1 students’ professional development.

A limitation of our study is that our data were obtained from a single institution and investigated students’ reaction but not actual knowledge acquisition. In conclusion, despite limitations, our study shows that premedical students, especially students who entered medical school during the COVID-19 pandemic, have different collective characteristics compared with their seniors while pre-clerkship students shared similar perceptions and behaviors in current situation. Future studies are needed to develop and implement educational strategies for PM1 students to support their learning as well as collegial interaction and socialization.

Acknowledgments

None.

Notes

Funding

None.

Conflicts of interest

No potential conflict of interest relevant to this article was reported.

Author contributions

DHK conceived the initial design of the study. YJK and DHK drafted the manuscript. DHK collected, analyzed, and interpreted the data. All authors read, critically reviewed, and approved the final manuscript.

Table 1.

General Experiences for Online Classes

Items	Total	PM1	PM2	M1	M2	p-value (eta-squaredl	Post-hoc
Before entering medical school, to what extent did you make use of online classes?^a),b)	2.68±1.43	2.82±1.46	2.68±1.38	2.53±1.35	2.67±1.52	0.544	-
Before the start of this semester, what were your expectations for online classes?^c)	2.89±1.02	2.57±0.97	2.99±1.00	3.14±1.10	2.88±0.94	0.001 (0.041)	PM1<PM2, M1
How many hours a day did you study on average, including watching online classes?^d)	2.63±1.38	1.80±0.77	1.68±0.93	3.47±1.23	3.66±1.17	<0.001 (0.441)	PM1<M1, M2
	2.63±1.38	1.80±0.77	1.68±0.93	3.47±1.23	3.66±1.17	<0.001 (0.441)	PM2<M1, M2
What proportion of lectures did you watch online with a friend?^e)	1.12±0.49	1.02±0.17	1.16±0.48	1.16±0.64	1.14±0.53	0.121	-
What proportion of recorded lectures have you played solely for the purpose of checking attendance?^e)	2.44±1.61	2.77±1.67	3.17±1.67	1.92±1.43	1.84±1.24	<0.001 (0.123)	M1<PM1, PM2
	2.44±1.61	2.77±1.67	3.17±1.67	1.92±1.43	1.84±1.24	<0.001 (0.123)	M2<PM1, PM2
How regular was your lifestyle during this semester?^f)	2.72±1.19	2.53±1.12	2.34±1.14	2.94±1.27	3.08±1.11	<0.001 (0.063)	PM1<M2
How regular was your lifestyle during this semester?^f)	2.72±1.19	2.53±1.12	2.34±1.14	2.94±1.27	3.08±1.11	<0.001 (0.063)	PM2<M1, M2

Data are presented as mean±standard deviation.

PM: Premedical course, M: Medical student.

^a) 1 (hardly used), 2 (somewhat under-used), 3 (moderate), 4 (somewhat used), and 5 (very often used).

^b) 32.7% (range, 29.1%-37.1%) of students responded "hardly utilized" and showed bimodal distribution.

^c) 1 (very negative), 2 (somewhat negative), 3 (neither negative nor positive), 4 (somewhat positive), and 5 (very positive).

^d) 1 (<3 hours), 2 (3-6 hours), 3 (6-9 hours), 4 (9-12 hours), 5 (12-15 hours), and 6 (15≤hours).

^e) 1 (almost none), 2 (about 20%), 3 (about 40%), 4 (about 60%), 5 (about 80%), and 6 (almost all).

^f) 1 (not regular at all), 2 (not regular), 3 (moderate), 4 (regular), and 5 (very regular).

Table 2.

Learning Strategies in Online Classes

Items^a)	Total	PM1	PM2	M1	M2	p-value (eta-squared)	Post-hoc
Pausing for the purpose of learning (note taking, online searching, etc.)	4.12±1.15	3.69±1.27	4.07±1.09	4.32±1.08	4.41±1.01	<0.001 (0.058)	PM1<M1, M2
Increasing playback speed	3.82±1.26	4.04±1.18	3.59±1.26	3.71±1.30	3.95±1.25	0.033 (0.021)	PM2<PM1
Watching while taking notes for oneself.	3.62±1.34	3.09±1.41	3.88±1.24	4.10±1.17	3.43±1.32	<0.001 (0.086)	PM1<PM2, M1
Pausing for the purpose of refreshment (short-term rest, stretching, etc.)	3.45±1.35	3.13±1.45	3.30±1.20	3.69±1.34	3.71±1.30	0.002 (0.035)	PM1<M1, M2
Repeated viewing of specific sections of a lecture	3.44±1.37	3.01±1.32	3.41±1.38	3.76±1.29	3.61±1.38	<0.001 (0.042)	PM1<M1, M2
Intentionally adjusting the viewing order of the lectures, not following the original timetable	2.88±1.4	2.85±1.54	2.89±1.37	2.82±1.36	2.95±1.34	0.923	-
Discussing the contents of lectures with classmates^b)	2.65±1.35	1.79±0.88	2.82±1.24	2.89±1.41	3.15±1.43	<0.001 (0.148)	PM1<PM2, M1, M2
Sharing notes with classmates^b)	2.52±1.54	1.23±0.61	2.33±1.18	3.38±1.52	3.23±1.60	<0.001 (0.313)	PM1<PM2
Sharing notes with classmates^b)	2.52±1.54	1.23±0.61	2.33±1.18	3.38±1.52	3.23±1.60	<0.001 (0.313)	PM2<M1, M2
Re-viewing the entire lecture	1.94±1.24	2.30±1.28	2.37±1.32	1.62±1.20	1.43±0.80	<0.001 (0.112)	M1<PM1, PM2
Re-viewing the entire lecture	1.94±1.24	2.30±1.28	2.37±1.32	1.62±1.20	1.43±0.80	<0.001 (0.112)	M2<PM1, PM2
Watch lectures while referring to the notes shared from classmates	1.96±1.32	1.21±0.69	1.61±1.01	2.40±1.43	2.67±1.46	<0.001 (0.199)	PM1, PM2<M1
	1.96±1.32	1.21±0.69	1.61±1.01	2.40±1.43	2.67±1.46	<0.001 (0.199)	PM1, PM2<M2
Inquiring to the professor by after class (e.g. sending e-mail)^b)	1.43±0.77	1.54±0.80	1.39±0.80	1.52±0.85	1.27±0.57	0.040 (0.020)	-
Studying only with notes shared from colleagues without actually watching the lecture	1.27±0.70	1.11±0.48	1.33±0.7	1.35±0.81	1.30±0.76	0.046 (0.019)	-
Decreasing playback speed	1.23±0.61	1.11±0.50	1.29±0.73	1.29±0.67	1.22±0.49	0.095 (0.015)	-
Total	2.75±0.55	2.41±0.54	2.74±0.55	2.95±0.51	2.91±0.44	<0.001 (0.148)	PM1<PM2, M1, M2
Total	2.75±0.55	2.41±0.54	2.74±0.55	2.95±0.51	2.91±0.44	<0.001 (0.148)	PM2<M1

Data are presented as mean±standard deviation.

PM: Premedical course, M: Medical student.

^a) 1 (hardly used), 2 (used in about 25% of classes), 3 (used in about 50% of classes), 4 (used in about 75% of classes), and 5 (used in almost all classes).

^b) Learning strategies applicable to both the recorded and real-time lectures.

Table 3.

The Important Features of Online Classes

Items^a)	Total	PM1	PM2	M1	M2	p-value (eta-squared)	Post-hoc
Ensuring good voice quality	4.49±0.80	4.35±0.78	4.34±1.02	4.55±0.68	4.72±0.62	0.001 (0.038))	PM1<M2
Ensuring good voice quality	4.49±0.80	4.35±0.78	4.34±1.02	4.55±0.68	4.72±0.62	0.001 (0.038))	PM2<M2
Using the virtual pointer to identify the sentence or the part of the screen being explained	4.30±0.84	4.00±0.79	4.09±0.96	4.50±0.78	4.65±0.62	<0.001 (0.104)	PM1<M1, M2
	4.30±0.84	4.00±0.79	4.09±0.96	4.50±0.78	4.65±0.62	<0.001 (0.104)	PM2<M1, M2
Complying with the scheduled upload date^b)	4.18±0.94	4.00±0.93	3.85±1.02	4.42±0.83	4.47±0.82	<0.001 (0.078)	PM1<M1, M2
Complying with the scheduled upload date^b)	4.18±0.94	4.00±0.93	3.85±1.02	4.42±0.83	4.47±0.82	<0.001 (0.078)	PM2<M1, M2
Organizing the videos concisely around key content^b)	4.14±0.84	3.97±0.74	3.98±0.99	4.32±0.79	4.31±0.76	0.001 (0.041)	PM1<M1, M2
Organizing the videos concisely around key content^b)	4.14±0.84	3.97±0.74	3.98±0.99	4.32±0.79	4.31±0.76	0.001 (0.041)	PM2<M1, M2
Including specific examples that help students' understanding	3.84±0.84	3.83±0.79	3.73±0.92	3.93±0.84	3.90±0.80	0.318	-
Indicating key content clearly, such as learning objectives	3.90±0.89	3.86±0.84	3.67±0.97	4.17±0.78	3.90±0.88	0.001 (0.040)	PM2<M1
Providing additional learning material to help students' understanding	3.33±1.03	3.43±0.88	3.11±1.07	3.54±1.06	3.27±1.06	0.012 (0.026)	PM2<M1
Having a Q&A system for feedback, such as bulletin boards or instant messenger	3.37±1.06	3.40±0.91	3.17±1.13	3.82±0.92	3.10±1.14	<0.001(0.069)	PM1, PM2, M2<M1
Explaining the lecture material in detail	3.18±1.09	3.41±0.94	3.38±0.92	3.08±1.16	2.82±1.24	<0.001 (0.048)	M2<PM1
Utilizing techniques to hold the attention of students, such as questioning	3.00±1.13	3.12±1.02	3.25±1.10	2.75±1.22	2.85±1.12	0.004 (0.032)	M1<PM2
Encouraging active student participation^c)	2.31±1.08	2.82±1.01	2.22±1.04	2.33±1.09	1.85±0.95	<0.001 (0.105)	M2<PM2, M1
Encouraging active student participation^c)	2.31±1.08	2.82±1.01	2.22±1.04	2.33±1.09	1.85±0.95	<0.001 (0.105)	PM2, M1<PM1

Data are presented as mean±standard deviation.

PM: Premedical course, M: Medical student.

^a) 1 (not important at all), 2 (not important), 3 (moderate), 4 (important), and 5 (very important).

^b) Only applicable to asynchronous recorded lectures.

^c) Only applicable to real-time lectures.

References

1. Sit JW, Chung JW, Chow MC, Wong TK. Experiences of online learning: students’ perspective. Nurse Educ Today 2005;25(2):140-147.

2. Palloff RM, Pratt K. Lessons from the virtual classroom: the realities of online teaching. 2nd ed. Hoboken, USA: John Wiley & Sons Inc; 2013.

3. He L, Yang N, Xu L, et al. Synchronous distance education vs traditional education for health science students: a systematic review and meta-analysis. Med Educ 2021;55(3):293-308.

4. Lee YM, Park KD, Seo JH. New paradigm of pediatric clinical clerkship during the epidemic of COVID-19. J Korean Med Sci 2020;35(38):e344.

5. Choi B, Jegatheeswaran L, Minocha A, Alhilani M, Nakhoul M, Mutengesa E. The impact of the COVID-19 pandemic on final year medical students in the United Kingdom: a national survey. BMC Med Educ 2020;20(1):206.

6. Demetriadis S, Pombortsis A. E-lectures for flexible learning: a study on their learning efficiency. J Educ Technol Soc 2007;10(2):147-157.

7. Kusurkar RA, Croiset G, Mann KV, Custers E, Ten Cate O. Have motivation theories guided the development and reform of medical education curricula?: a review of the literature. Acad Med 2012;87(6):735-743.

8. Dong C, Goh PS. Twelve tips for the effective use of videos in medical education. Med Teach 2015;37(2):140-145.

9. Lee YM. It is time to reconsider the unnecessary division of premedical and medical studies. Korean J Med Educ 2018;30(4):279-281.

10. Abdulghani HM, Al-Drees AA, Khalil MS, Ahmad F, Ponnamperuma GG, Amin Z. What factors determine academic achievement in high achieving undergraduate medical students?: a qualitative study. Med Teach 2014;36 Suppl 1:S43-S48.