Original Article
DOI : https://doi.org/10.3946/kjme.2009.21.1.23
Korean J Med Educ. 2009; 21(1): 23-33.
Published online 2009 March 31.
doi: https://doi.org/10.3946/kjme.2009.21.1.23
Experience of Implementation of Objective Structured Oral Examination for Ethical Competence Assessment
Hye Rin Roh1, Ja-Kyoung Kim2, Jong-Yun Hwang3, Sung Bae Park1, and Sang Wook Lee4
1Department of Surgery, School of Medicine, Kangwon National University, Chuncheon, Korea.
2Department of Pediatrics, School of Medicine, Kangwon National University, Chuncheon, Korea.
3Department of Obstetrics & Gynecology, School of Medicine, Kangwon National University, Chuncheon, Korea.
4Department of Urology, School of Medicine, Kangwon National University, Chuncheon, Korea.
Corresponding Author: Email: kjaky@kangwon.ac.kr
Received 2008 October 25;    Accepted 2009 January 16.
ABSTRACT
PURPOSE: We developed an objective structured oral examination (OSOE) case to assess the medical ethics of students. The aim of this study was to assess the reliability of OSOE with generalizability theory. METHODS: One 10-minute OSOE that contained key questions was developed. The evaluation sheet consisted of 4 domains: moral sensitivity, moral reasoning, decision making, and attitude. The total number of items was 13. The numbers of checklist items and global rating items were 11 and 2, respectively. Items and key questions were validated by 6 professionals. Standardization of the raters and the pilot study was performed before the OSOE. Fifty-four third-year medical students participated in the OSOE. The OSOE was duplicated, and 2 professors assessed 1 student independently. Each station lasted 8 minutes and was followed by a 2-minute interval,during which raters completed the checklist forms. We analyzed the reliability of the OSOE with the GENOVA program. RESULTS: The reliability (generalizability coefficient) was 0.945, and the interrater agreement was 0.867. The type of item, checklist or global rating, was the largest variance component. The reliability of the checklist alone was 0.668 and that of the global rating alone was 0.363. CONCLUSION: The OSOE is reliable and can be used to assess ethics. More research should focus on achieving validity.
Keywords : Medical ethics;Educational measurement;Clinical competence;Statistics as topic