Introduction
Generation Z generally refers to the demographic cohort born between 1995 and 2012 [1], to which most of medical students today belong. Generation Z is the first to have access to the Internet and social networking using ubiquitous technologies [1,2], and they live and work differently than earlier generations. Knowing how this new generation of students engage in learning is critical to promote their learning. Therefore, medical faculty must know this new generation better to offer medical education suited to their learning needs [3].
The literature indicates some differences in how the generation Z perceive and engage in learning from their predecessors, in large part, due to the impact of technology on their living and learning. As digital natives, the generation Z prefer more personalized, flexible learning and learning environments that they can actively participate and learn independently [4]. The Generation Z tends to have shorter attention spans; thus, bite-sized, interactive, and visually engaging learning materials are more likely to capture their interest [5,6]. Today’s students have a broader concept of learning spaces and resources than previous generations [5]; thus, they have more choice of when and where to learn and what resources to use for learning. Generation Z’s proficiency in navigating the digital landscape goes beyond passive consumption of information, and they have high expectations regarding the immediate access to and delivery of information [7]. Still, they tend to lack information literacy in determining the credibility of their information sources [5].
There has been an increase in medical students’ engagement in e-learning since the coronavirus disease 2019 pandemic [8,9]. Several recent studies have examined medical students’ use of and preferences in e-learning. Lau and Bates [10] reviewed the literature on the current use of e-learning in basic medical education in the United States and Europe and found that about half of the studies explored e-learning for individualized learning and self-study purposes. Delungahawatta et al. [11] systematically reviewed studies on the scope and impact of e-learning on medical students. The authors found that multimedia, case-based learning, question banks, and quizzes were the most common e-learning resources in clinical medicine. In another study, medical students reported animated videos and simultaneous drawings as the most effective learning resources for retaining information [12]. Also, some studies found that question banks offered by off-the-shelf commercial learning platforms were popular with medical students and it was associated with their performance in licensing examinations [13,14].
Although there have been some studies on medical students’ use and preferences of e-learning, research is scant that offers insights for the design of e-learning environments suited for the needs of today’s students. This study investigated medical students’ perceptions and use of e-learning to identify their needs and provide suggestions for the design of e-learning from the perspectives of the generation Z.
Methods
This study used a mix of qualitative and quantitative research methods to triangulate data sources and to gain an in-depth understanding of medical students’ perceptions of and needs for e-learning. First, a focus group interview (FGI) was conducted with medical students. Second, the FGI participants were also surveyed on their perceptions of e-learning. Third, log data from the e-learning portal were analyzed to investigate medical students’ actual use of e-learning resources.
1. Study participants and setting
The study sample was medical students who were registered users of the e-learning portal offered by the consortium of Korean medical schools, e-MedEdu (www. mededu.or.kr). This e-learning portal offers a repository of over 1,800 online resources, which are contributed by over 250 faculty members since 2008 and are shared with 36 medical schools across the nation. Approximately 38,000 medical students are registered users in this portal, with over 200,000 annual website visits. The content areas spanned the basic medical education curriculum but most concern clinical education, which include videos on clinical procedures and patient encounters. Other video resources included lecture videos and online modules, and the portal also contains text-based clinical cases with some images and videos, clinical images, sounds, and assessment items. Users can retrieve resources from the repository by either using their own search terms in the search engine or browsing them by categories of subject areas or resource types.
This study sample was selected to ensure the representativeness of medical students from diverse backgrounds and demographics as well as medical schools of varying sizes and locations across the country. As all students at the 36 medical schools around the nation in Korea are registered at e-MedEdu, its users are representative of the national cohort of medical students. Among these users, medical students who had participated in a competition for student-created educational videos hosted by e-MedEdu were recruited for this study. In this annual competition, medical students created educational videos as a group under the supervision of medical faculty. In the year 2022, 44 students of 13 teams from six medical schools received awards. Those who had participated in this competition were selected for this study as they were motivated to use learning resources actively as to create the ones by themselves, which was previously reported elsewhere [15]. Such backgrounds were expected of the participants in this study to gain insights from them by reflecting on their experiences. The participants were invited to this study via e-mail and those who agreed participated in the study.
2. Research instruments and procedures
Participants were invited to an FGI conducted in October 2022 in a large seminar room with a roundtable setting in Seoul, South Korea. The FGI was conducted in a semi-structured interview format using eight questions regarding how and when students used e-learning, their perceived benefits of and challenges regarding its use, and suggestions for improving e-learning resources and systems (Appendix 1). Three researchers, one of whom was the author, facilitated the interviews in a way that promoted interactions among the participants. The interview lasted 45 minutes and was audio-recorded and transcribed for data analysis.
Furthermore, the participants were also invited to a survey using a questionnaire to investigate their perceptions about the importance of and satisfaction with e-learning as a needs assessment approach by identifying the gaps between the two. The questionnaire was developed by the author and two investigators reviewed the items to establish content validity and provided feedback for revisions. The questionnaire comprised 10 items with two subscales. The first subscale assessed medical students’ needs for e-learning resources and included five items on various types of resources. The second subscale comprised four items for assessing medical students’ needs for an e-learning system, which included perceived convenience of use, usefulness for learning, the quality of contents, and needs for a learning management system that tracks learning activities. On each item in the questionnaire, participants indicated their perceived levels of importance and satisfaction using a 5-point Likert scale, where 1=very unimportant/very unsatisfied and 5=very important/very satisfied. Cronbach’s α for two sub-scales were at the acceptable level, which were 0.82 and 0.89, respectively. The questionnaires were administered in a paper-based format at the end of the FGI session.
Finally, log data from the e-learning portal was obtained to identify medical students’ preferences in terms of resources that they seek out most frequently. To that intent, two sources of log data were obtained: first, search terms used by users in the search engine of the portal; second, the numbers of visits on resources. Log data on the search terms were retrieved from the portal for 3 months from October to December 2022. Information on the number of visits on each resource in the portal over the past 12 years from 2011 to 2023 were obtained from the server, and among them top 100 resources with the most visits were retrieved for analysis.
3. Data analysis
The interview data were analyzed using a thematic analysis method to identify emerging themes [16]. Initial thematic analysis was conducted by the author by coding and grouping data sources, and subsequent discussions were held by the research team for extraction and finalization of themes. Each investigator conducted initial coding, and disagreement was discussed until consensus was reached. To establish study trustworthiness, the results of the thematic analysis were audited by a panel of medical educators.
Next, descriptive statistics were performed on the survey data by calculating the differences in participants’ responses regarding their perceived importance and quality of e-learning to identify the gaps between the two. Reliability analysis (Cronbach’s α) was performed to evaluate the internal consistencies of items. IBM-SPSS Statistics for Windows ver. 27.0 (IBM Corp., Armonk, USA) was used for the data analysis. Finally, the log data obtained from the website were analyzed by calculating the frequencies of the search terms used.
4. Ethical considerations
The study was conducted by obtaining permission from the Institutional Review Board (IRB) of Dongguk University, Gyeongju IRB (DGU IRB 20221025). Informed consent forms were waived because this study was considered to cause minimal harm or discomfort to participants. Instead, the participants were informed that they could withdraw from the study at any time without any negative consequences.
Results
1. Participant demographics
Among the 44 medical students invited to the FGI, 30 agreed to participate. The demographics of the participants are outlined in Table 1. Among these 30 participants, 16 were female and 14 were male, and all of them belonged to generation Z, who were between 22 and 25 years old. Of those, 19 were in clinical years (year 3 and 4 students), and 11 were in the preclinical years (year 1 and 2 students). The participants were affiliated with five medical schools located across the nation. All participants were registered users of the e-learning portal under investigation (e-MedEdu); however, their experiences with it varied.
2. Most popular e-learning resources
A total of 2,762 search terms were retrieved from the log data at e-MedEdu. Search terms with similar subjects were grouped, which resulted in 64 categories. Fig. 1 illustrates the top 25 search terms. Among these most popular search terms, 87% (n=2,415) were on physical examinations, and 12% (n=325) were on surgical or emergent procedures. Only one topic pertained to patient encounter (i.e., examining a patient with alcohol problem). All of the top 100 resources with the highest number of visits were videos. 98% (n=98) of those were on clinical procedures, which includes various topics of physical examinations and surgical emergent procedures, and 2% (n=2) were on patient encounters.
Besides learning resources at e-MedEdu, participants mentioned that they used Google (Google LLC, Mountain View, USA) and YouTube (Google LLC, San Bruno, USA) for searching general medical knowledge, UpToDate (UpToDate Inc., Waltham, USA) for information on clinical algorithm, and Digital 3D Atlas available from various publishers for learning anatomy. Participants also mentioned several mobile applications they were using for learning. For instance, some used apps for memorizing study materials, such as flash cards and mnemonics. Some used a mobile app to share schedules to foster collaboration among study group members.
3. Medical students use of e-learning: motivators, challenges, and suggestions
The following themes have emerged from the analysis of interview data.
1) Preference for multimedia over texts
Participants favored multimedia learning resources that were not available in traditional textbooks and found them useful for studying subjects that could not be easily grasped by reading textbooks alone.
“When I need to study a subject where images or videos are useful, such as the cardiovascular system, I frequently use video resources that explain the points that are muddy for me to understand. Also, when I learned the cardiovascular system, [the] teachers introduced us learning resources on heart and lung sounds at e-MedEdu.”
In particular, participants noted that they used clinical videos most frequently and found them very useful for their learning.
“When I want to study clinical procedures, it is usually not easy to find video resources on them. Videos at e-MedEdu are useful for my learning.” Another participant stated“, When I took the neurology course, [the] teachers told us to see videos to learn neurologic exams and that was helpful.”
2) Advantages of using resources recommended or created by medical faculty
Participants noted that they were motivated to use the e-learning resources recommended by their teachers. They also mentioned the advantages of using e-learning resources created by medical faculty as trustable sources of learning.
“In one class, the professor told us to look into some resources at e-MedEdu when we wanted additional information. That helped us [become] aware of such resources and we can trust their quality as they were recommended by teachers.”
“I can’t say the quality of videos available on social media are good. I can easily find video resources on medical knowledge and clinical procedures on social media, but sometimes I wonder whether the information that they deliver is accurate. I can trust the quality of resources at e-MedEdu.”
3) Interest in e-learning resources as video content creator
Some participants mentioned they created video contents as their extracurricular experiences, and such experiences made them more engaged in e-learning resources.
“I am a member of a student group for creating videos in my medical school. So, I got interested in looking into e-learning resources to see how they were created.”
4) Preference for short video clips highly relevant to their learning needs
Participants preferred video clips with a shorter length, similar to those on social media. Most video clips available on e-MedEdu are 10 minutes or longer in duration, which was too lengthy for the participants.
“I’d like to focus on the segment of the video clip that I really need to learn, and not all of it. But, the video resources (at e-MedEdu) are too lengthy and are not segmented into more detailed topics, so it’s not easy to get into the part of the clip that I want to see. I think that (segmentation into more detailed topics) will help us learn more efficiently in our busy curriculum.”
Some participants suggested that adding sub-categories would be helpful for them to easily find the contents that match their specific learning needs.
“Frankly speaking, I rarely used it (the e-learning portal). In retrospect, say, if I wanted to learn heart sounds, I don’t have time to learn everything on that. Instead, I want to find resources on a more specific topic that I need to learn now. Yet, at e-MedEdu, there is no detailed sub-category to help us browse specific subjects.”
4. Participants’ perceived importance of and satisfaction with e-learning
Among the 30 medical students who attended the FGI, 27 returned the questionnaire (90% response rate). Table 2 presents the participants’ responses on their perceived importance of and satisfaction with e-learning in terms of its contents and system. Participants responded that clinical videos (mean=4.67) and audio clips (mean=4.30) were the most important learning resources. Participants agreed that the convenience in use was important for their use of e-learning, and that the contents were of high quality and useful for learning (mean=4.63). There were largest gaps in participants’ perceived importance of (A) and satisfaction with (B) e-learning in terms of the convenience in use (A–B=1.15) and quality of content (A– B=0.67).
Discussion
This study investigated generation Z medical students’ perceptions of e-learning to provide suggestions for its design tailored to their learning needs. The results showed that participants favored multimedia learning resources that were not readily available in traditional textbooks for studying subjects that could not be easily grasped by reading textbooks alone. In particular, participants preferred video resources, with the most frequent searches on physical examinations and clinical procedures. These findings are congruent with the characteristics of generation Z students, who are known to prefer seeking information through videos over reading long texts [5,6]. Moreover, previous studies have shown that videos are effective learning resources for medical students [17,18].
Moreover, this study found some differences in the popularity of use in video resources. Clinical videos which demonstrated physical examinations and clinical procedures were far more popular than other types of videos such as lecture videos and online modules. This finding seems to reflect medical students’ preference for short videos. Lecture videos tend to be longer than clinical videos, thus these findings are consistent with the learning styles of the generation Z who prefer shorts bite-sized information in learning materials [5,6].
This study showed medical students’ preference of learning resources recommended by their teachers. Although today’s students often use informal learning resources other than their course materials [19,20], this study shows they still prefer those created or recommended by instructors as credible sources of information. This finding is consistent with the assertion made by some researchers that generation Z students tend to lack information literacy in determining the credibility of their information sources [5]. This finding also highlights the importance of medical teachers’ role as resource developers in medical education [21].
Some participants were also motivated to use video resources as they were engaged in creating videos for extracurricular activities. Students’ creation of videos for learning is an example of student engagement in learning at the creative amplification level according to the Passive-Interactive-Creative-Replaces-Amplifies-Trans forms (PICRAT) model of technology integration [9,22]. Medical teachers need to pay attention to such teaching and learning activities to foster active engagement among generation Z students.
This study also revealed that students felt convenience in use was the most important factor in their use of e-learning, yet they were least satisfied with it. These findings are in line with the characteristics of generation Z who are accustomed to easy access to information in ubiquitous and mobile technology environments [5]. This study provides insights into the perspectives, styles, and preferences of e-learning of generation Z medical students. Today’s students have a much broader concept of learning spaces and resources than previous generations [5]. Still, Seemiller and Grace [6] contended that current campus environments do not fully meet the needs, interests, and learning preferences of generation Z students. Similarly, this study’s findings indicate that the current e-learning environment is not well suited to the needs of the new generation of medical students. To bridge this gap, the results highlight the need for improvement in the design and development of e-learning resources that are aligned with the practices and preferences of today’s medical students.
First, this study calls for better navigational design to provide more convenient access to the resources that closely match students’ specific learning needs. In doing so, it is suggested that a feature be added to the e-learning portal that recommends resources relevant to the student’s search terms, which is similar to the one in social media. Moreover, well-designed categorization of resources is fundamental to implementing such an e-learning system that automatically recommends relevant resources for the user. Besides, more segmentation of video resources into shorter pieces are recommended to allow students to easily skip or navigate to the specific points that want to tap into.
Second, this study reaffirms the importance of the role of medial teachers as resource developers. Although it is necessary to build up a comprehensive repository of resources that are credible and relevant to medical students’ learning needs, it consumes a great deal of faculty and institutional resources to develop learning resources for all subject areas needed for medical students. Thus, collaboration among medical schools is fundamental for building up such a comprehensive depository of resources.
Several limitations should be acknowledged when considering the results of this study, which also have implications for future studies. First, this study focused on the e-learning environment provided by Korean medical schools. Thus, the findings may not be generalizable to other types of e-learning that the e-learning portal under investigation is not currently offering. Future research is warranted to explore medical students’ needs for e-learning using emerging technologies, such as virtual patients, virtual or augmented reality, metaverse, and artificial intelligence. In particular, there might be some differences in medical student perceptions and use of e-learning across cultural or regional contexts. Thus, future study is recommended on medical student needs for e-learning across different contexts. Second, although the participants’ experiences in using the e-learning portal varied somewhat, they were likely highly motivated to use e-learning as to engage in creating learning resources by themselves. Thus, the findings may not be generalizable to those with little experience in e-learning. Also, the survey was conducted as a preliminary study with a small sample. Future studies with larger sample sizes are warranted to enhance the validity and reliability of the instrument.
In conclusion, this study highlights the needs for an e-learning environment closely aligned with the practices and preferences of today’s students. This study calls for better design and development of e-learning to offer more convenient browsing and searching of resources that are highly relevant to students’ specific learning needs. Also, strategic plannings are suggested to build up a comprehensive repository of resources that are credible and relevant to medical students’ learning needs.