Purpose This developmental study explored the conceptual feasibility and applicability of a metaverse-based clinical assessment platform as a complementary tool to conventional objective structured clinical examinations in undergraduate medical education.
Methods A targeted literature review and expert consensus process were conducted to identify domains of clinical competence in which metaverse technologies could provide added value. Based on these findings, prototype virtual patient simulations were developed within a metaverse environment. Large language models (LLMs) were integrated to support dynamic, interactive history-taking simulations, and pilot modules for physical examination were also created.
Results Integration of LLMs into virtual patient scenarios enabled realistic, context-sensitive medical interviews, facilitating interactive dialogue between examinees and simulated patients. In contrast, physical examination modules faced technical limitations, particularly in replicating procedures requiring tactile or haptic feedback, such as palpation and percussion. Nevertheless, the metaverse environment enabled delivery of consistent and reproducible scenarios, supporting objective assessment of communication and diagnostic reasoning skills.
Conclusion Metaverse-based simulations augmented by LLMs offer a promising approach to scalable and standardized clinical assessment, particularly within cognitive and interpersonal competency domains. Although current technological constraints limit the fidelity of physical examination simulations, rapid advancements in immersive and haptic technologies may help overcome these barriers in the near future. Further research is needed to evaluate the educational efficacy, validity, and feasibility of deploying such platforms in summative, high-stakes assessment contexts.
Purpose Although there have been studies emphasizing the re-education of North Korean (NK) doctors for post-unification of the Korean Peninsula, study on the content and scope of such re-education has yet to be conducted. Researchers intended to set the content and scope of re-education by a comparative analysis for the scores of the preliminary examination, which is comparable to the Korean Medical Licensing Examination (KMLE).
Methods The scores of the first and second preliminary exams were analyzed by subject using the Wilcoxon signed rank test. The passing status of the group of NK doctors for KMLE in recent 3 years were investigated. The multiple-choice-question (MCQ) items of which difficulty indexes of NK doctors were lower than those of South Korean (SK) medical students by two times of the standard deviation of the scores of SK medical students were selected to investigate the relevant reasons.
Results The average scores of nearly all subjects were improved in the second exam compared with the first exam. The passing rate of the group of NK doctors was 75%. The number of MCQ items of which difficulty indexes of NK doctors were lower than those of SK medical students was 51 (6.38%). NK doctors’ lack of understandings for Diagnostic Techniques and Procedures, Therapeutics, Prenatal Care, and Managed Care Programs was suggested as the possible reason.
Conclusion The education of integrated courses focusing on Diagnostic Techniques and Procedures and Therapeutics, and apprenticeship-style training for clinical practice of core subjects are needed. Special lectures on the Preventive Medicine are likely to be required also.
Citations
Citations to this article as recorded by
Evaluating North Korean academic medicine’s contributions to the international medical literature: a bibliometric study Andrew Holzman, Yongbin Kim, Jaewoo Park, Douglas Rappaport Science Editing.2025; 12(2): 96. CrossRef
Challenges Experienced By North Korean Refugee Doctors in Acquiring a Medical License in South Korea: A Qualitative Analysis Shin Ha, Hui Ran Choi, Jong Koo Lee, Yo Han Lee Journal of Continuing Education in the Health Professions.2019; 39(2): 112. CrossRef
From Jeongseong to “Three-Minute Care”: Healthcare Transitions in North Korea and the Cultural Adjustment of North Korean Refugee Doctors in South Korea 박영수, 박상민, Hae Won Lee Korea Journal.2017; 57(4): 118. CrossRef
PURPOSE The aim of the study was to introduce our experience of establish task-based learning outcomes for core clinical clerkships.
METHODS We first define our educational goal and objectives of the clinical clerkship curriculum according to knowledge, cognitive function and skill, and attitude. We selected clinical presentations and related diseases with expert panels and allocated them to core clinical departments. We classified doctor's tasks into 6 categories: history taking, physical examination, diagnostic plan, therapeutic plan, acute and emergent management, and prevention and patient education. We described learning outcomes by task using behavioral terms.
RESULTS We established goals and objectives for students to achieve clinical competency on a primary care level. We selected 75 clinical presentations and described 377 learning outcomes.
CONCLUSION Our process can benefit medical schools that offer outcome-based medical education, especially for clinical clerkships. To drive effective clerkships, a supportive system including assessment and faculty development should be implemented.
Citations
Citations to this article as recorded by
Physiotherapy students’ rating on lecturers’ and supervisors’ clinical education attributes Nana Kwame Safo-Kantanka, Jonathan Quartey, Samuel Koranteng Kwakye Hong Kong Physiotherapy Journal.2024; 44(02): 79. CrossRef
Navigating protean career paths in medical education: insights from outstanding medical educators in South Korea Bora Lee, Danbi Lee, Hyekyung Shin, Sohee Park, Eunbae B. Yang BMC Medical Education.2024;[Epub] CrossRef
Survey for faculty on the current status and improvement needs of the clinical clerkship curriculum in one school of Korean medicine Kyung-Ho Park, Sung-Uk Ma, Hye-Yoon Lee, Eui-Hyoung Hwang Journal of Korean Medicine.2024; 45(4): 57. CrossRef
Preliminary Regulations for Effective Implementation of Integrative Education in Korean Medicine College Gyoo-yong Chi Journal of Physiology & Pathology in Korean Medicine.2023; 37(5): 93. CrossRef
Visualization of unstructured personal narratives of perterm birth using text network analysis Jeung-Im Kim Korean Journal of Women Health Nursing.2020; 26(3): 205. CrossRef
What is the current orientation of undergraduate medical education in Korea? Do-Hwan Kim, Eun Jeong Kim, Jinyoung Hwang, Jwa-Seop Shin, Seunghee Lee Korean Journal of Medical Education.2015; 27(2): 87. CrossRef
Developing Course Outcome to Achieve Exit Outcome: Applying Hauenstein's theory Yoon Young Hwang, Sun Hee Kim, Min Sun Chu The Journal of Korean Academic Society of Nursing Education.2015; 21(2): 155. CrossRef
Development of a portfolio for competency-based assessment in a clinical clerkship curriculum HyeRin Roh, Jong-Tae Lee, Yoo Sang Yoon, Byoung Doo Rhee Korean Journal of Medical Education.2015; 27(4): 321. CrossRef
New Challenges for Korean Medical Education: Enhancing Students’ Abilities to Deal with Uncertain Ill‐Defined Problems Ikseon Choi, Bo Young Yoon Korean Medical Education Review.2014; 16(3): 111. CrossRef
Outcome-Based Curriculum Development at Inje University College of Medicine Jong-Tae Lee, Byoung Doo Rhee, Hye Rin Roh Korean Medical Education Review.2013; 15(1): 31. CrossRef
Research in Medical Education: Transforming Ideas into Action Eun Kyung Chung Korean Journal of Medical Education.2012; 24(1): 1. CrossRef
PURPOSE To evaluate the educational effectiveness of practice-based program for procedural skills at Kangwon National University College of Medicine.
METHODS In 2005, we conducted the training program composed of 19 procedural skills for third-year medical students during their first semester clerkship. The 14-week training used simulation models and was held for 3 hours per week, one hour for didactic session and 2 hours for practical exercise. A lecture was given only for wound dressing. OSCE, consisting of four 5-minute stations, was administered to analyze the students' achievement. 53 third-year students were given a survey following skills training and OSCE.
RESULTS Most students reported that the practice-based program was interesting and helpful in learning procedural skills. Students preferred practice to didactic medium.
Students were satisfied with the faculty's instruction, but suggested that the training should be providedprior to clerkship. OSCE had an overall reliability coefficient (Cronbach's alpha) of 0.78. The mean score in the dressing case was lower than those in other cases.
CONCLUSION The practice-based program for procedural skills was effective in motivating students' learning as well as improving theirtechnical skills. Self-directed exercises and appropriate feedback are more effective training tools than lectures.
Citations
Citations to this article as recorded by
Trends in Acupuncture Training Research: Focus on Practical Phantom Models Jung Eun Jang, Yeon Sun Lee, Woo Seok Jang, Won Suk Sung, Eun-Jung Kim, Seung Deok Lee, Kyung Ho Kim, Chan Yung Jung Journal of Acupuncture Research.2022; 39(2): 77. CrossRef
Development of guide to clinical performance and basic clinical skills for medical students HyeRin Roh, KeunMi Lee, Eunkyung Eo, Young Sun Hong, Hakseung Lee, Byung Woo Jang, Byoung Doo Rhee Korean Journal of Medical Education.2015; 27(4): 309. CrossRef
Students' Perception of Their Achievement of Clinical Competency for Patient Safety Yang Hee Kim, Hye Rin Roh Korean Journal of Medical Education.2007; 19(3): 207. CrossRef
Implementation of Student Internship with Intern-Level Responsibility Hye Rin Roh, Gibong Chae, Jeong Hee Yang Korean Journal of Medical Education.2007; 19(1): 47. CrossRef