| Home | E-Submission | Sitemap | Contact us |  
top_img
Korean J Med Educ > Volume 28(1); 2016 > Article
Yeo and Chang: Students’ perceptions and satisfaction level of hybrid problem-based learning for 16 years in Kyungpook National University School of Medicine, Korea

Abstract

Purpose:

Kyungpook National University School of Medicine has been implementing hybrid problem-based learning (PBL) since 1999. The aim of this study was to investigate the changes in the students’ perceptions and satisfaction levels of hybrid PBL.

Methods:

The target period of our study was from 1999 to 2014, and target subjects were second-year medical students in Kyungpook National University School of Medicine. The survey was conducted at the end of semester. We had a focused interview with group leaders and some volunteer students.

Results:

As for the scores regarding students’ overall satisfaction with PBL, there was significant improvement in 2005 compared to 2002, but the scores decreased and no differences between the survey years noted after 2005. The students’ preference ratio for the once a week PBL sessions, tutor presence, synchronization of contents, and arrangement of PBL sessions and related lectures was 60%–80%, 50%–90%, 52%–96%, and 78%–93%, respectively.

Conclusion:

In order to increase students’ satisfaction with hybrid PBL and to improve the perception of it, firstly, it is necessary to arrange the date and the time of PBL sessions so that students can concentrate on PBL. Secondly, PBL cases should be selected and arranged to be well synchronized with the ongoing lectures. Finally, it is important to create a safe atmosphere so that students can engage actively in PBL sessions.

Introduction

Problem-based Learning (PBL) began to be implemented at some medical schools with innovative curriculum in Asia during the 1970s after Howard Barrows pioneered PBL program at the McMaster University Medical School in the late 1960s [1]. Twenty-three medical schools in Korea have adopted PBL as an experimental or a formal course since the 1990s [2]. The hybrid PBL curriculum of Kyungpook National University School of Medicine (KNUSOM) has been designed to run concurrently with a conventional curriculum over the past decade since it was adopted as a two credits pass/fail course in 1999 [3].
The available reports have involved the principle and practice of PBL [4], development and the application of PBL [5], case reports of implementation or experience of PBL [3,6,7,8,9,10,11,12], its evaluation [3,7,8,9,13], and self-directed learning readiness [14,15]. Through these studies a better understanding and sharing of their experiences of PBL could be promoted. It is still a challenge to the adoption and implementation of PBL with some variations to suit each medical school situation and needs.
This article reports our 16-year experiences of hybrid PBL regarding the level of the students’ satisfaction with PBL, the students’ preference for the number of PBL sessions per week, the arrangement of PBL sessions and lectures, and the preference for the tutor presence at PBL session. We believe that this study could help medical schools adopt and develop PBL.

Subjects and methods

1. Subjects

Our survey subjects were second year medical students who participated in the PBL curriculum of KNUSOM. The questionnaire was completed by 685 students out of 716 PBL participants (Table 1).
Seven survey topics we categorized were students’ overall satisfaction, longitudinal or block style of PBL operations, frequency of PBL sessions, arrangement of PBL case, synchronization of contents, tutor presence, and grading method (Table 2).

2. Methods

The questionnaire survey and focused interviews were conducted at the end of the semester. Group leaders and some volunteer students were interviewed using open-ended questions. The interview was recorded and analyzed with the approval.
The questionnaire was developed using closed-ended items modified from surveys which had been reported in previous studies [3,4,8,12]. The internal reliability of the questionnaire items was verified by Cronbach α coefficient. The items were answered using a 5-point Likert scale (1=strongly disagree to 5=strongly agree) in 2002 and 2005. Since 2009, a 7-point scale (1=strongly disagree to 7=strongly agree) was used. Different scales used in different years were synchronized into a 5-point scale by a statistics program, so as to be analyzed for inter-year variability.
The differences in students’ overall satisfaction levels between years were assessed by one-way analysis of variance after extracting the same five items from the annual PBL questionnaire (Table 3). The internal reliability of five items by Cronbach α was 0.631 (in 2002), 0.956 (in 2005), 0.763 (in 2009), 0.627 (in 2010), 0.714 (in 2012), and 0.721 (in 2014). Another frequency and descriptive analysis was also conducted. All data were analyzed with SPSS version 22.0 for Window (SPSS Inc., Chicago, USA) and p<0.05 was considered significant.

Results

1. Students’ overall satisfaction levels of PBL

The mean scores of students’ overall satisfaction levels based on a 5-point scale were 3.51 points (in 2002), 4.26 points (in 2005), 3.86 points (in 2010), 3.95 points (in 2012), and 3.84 points (in 2014). A significant improvement was noted in 2005 compared to 2002 but the score decreased significantly after 2005 (Table 3, Fig. 1).
The mean scores of the first item (“I am satisfied with PBL”) in 2002, in 2005, in 2010, in 2012, in 2014 were 3.68 points, 4.26 points, 3.88 points, 4.05 points, and 3.44 points, respectively. The score of 2005 was significantly higher than that of 2002 but the score decreased significantly in 2010 and in 2014 (Table 3, Fig. 1).
The mean scores of the second item (“I am satisfied with my tutor”) in 2002, in 2005, in 2010, in 2012, in 2014 were 3.31 points, 4.25 points, 3.31 points, 3.65 points, and 3.62 points, respectively. The score of 2005 increased significantly than that of 2002, but after 2005, the score decreased significantly (Table 3, Fig. 1).
The mean scores of the third item (“I am very active in PBL sessions”) in 2002, in 2005, in 2010, in 2012, in 2014 were 3.81 points, 4.30 points, 4.04 points, 4.06 points, and 4.14 points, respectively. The score of 2005 was significantly higher than that of 2002. There were no significant differences after 2005 (Table 3, Fig. 1).
The mean scores of the fourth item (“I do self-directed learning for PBL”) in 2002, in 2005, in 2010, in 2012, in 2014 were 3.33 points, 4.23 points, 3.75 points, 3.90 points, and 3.92 points, respectively. The score of 2005 increased significantly than that of 2002, but after 2005, the score became lower significantly (Table 3, Fig. 1).
The mean scores of the fifth item (“Team members are cooperative and helpful for each other”) in 2002, in 2005, in 2010, in 2012, in 2014 were 3.42 points, 4.27 points, 4.31 points, 4.08 points, and 4.06 points, respectively. A significant improvement was noted after 2002. There was no significant difference after that (Table 3, Fig. 1).

2. Students’ preference for the style of PBL operations: longitudinal versus block

In the 2002 and 2005 survey, approximately 70% of students preferred “the longitudinal” to “the block.” Many students were prone to spent time in reviewing lecture materials and preparing for their exams during the block PBL period. Therefore the block style was replaced by the longitudinal PBL.

3. Students’ preference for the frequency of PBL sessions per week

Approximately 60% to 80 % of students preferred to meet once a week: 63.4% in 2009, 79.1% in 2010, 65.1% in 2012, and 57.0% in 2014. Only 2% to 10% students preferred to meet twice week.

4. Arrangement of PBL session and related lecture: before or after lectures

Approximately 78% to 93% of students preferred to have PBL sessions after related lectures: 78.0% in 2009, 88.7% in 2010, and 92.5% in 2012.

5. Synchronization of contents of PBL case and ongoing lecture: dependent versus independent

Approximately 52% to 96% of students showed a preference for using the PBL case well correlated with the contents of concurrent lectures: 95.9% in 2002, 52.3% in 2009, and 64.3% in 2010.

6. Students’ preference for having a tutor at PBL session: with tutor versus without tutor

Approximately 50% to 91% of students preferred the presence of a tutor in the group: 54.1% in 2009, 49.6% in 2010, 90.6% in 2012, and 80.4% in 2014. Students who preferred to have a tutor asserted that the presence of a tutor itself could create a better learning environment. On the other hand, many students claimed that they had experienced unsafe atmosphere, difficulty in adjusting to different PBL facilitation skills of tutors due to the insufficient standardization of tutor (Table 4).

7. Students’ preference for the grading system: pass/fail versus grading

The tools for student assessment consisted of tutor assessment, learning report, modified essay questions (MEQs), peer assessment, responding questionnaire, drawing case mapping and schema, and attendance (Table 5). Approximately 49% to 94% of students were in favor of pass/fail system over a grading system: 48.5% in 2002, 93.6% in 2009, 93.6% in 2010, 93.6% in 2012, and 89.7% in 2014. Regarding peer assessment, students disclosed that they gave the same score to each other in most cases. Therefore, peer assessment proved not to serve as a reliable assessment tool.

Discussion

We define the PBL run concurrently with a lecture-based traditional curriculum as hybrid PBL in this article. The analysis of the changes in the students’ perceptions and satisfaction levels of 16-year hybrid PBL showed that students preferred once-a-week PBL to twice or more PBL per week throughout the semester. This can be interpreted as a way of means for students to choose to lessen the burdens on hybrid PBL at a medical school. Kim et al. [5] also mentioned that when a medical school introduces PBL in a traditional curriculum, it is desirable to impose the least amount of burden on students.
Our results showed that most students preferred the contents of the PBL case to be synchronized with ongoing lectures, and the case to be studied after the related lectures. The possible explanation of preference is that students want to reduce the time and efforts required to study the PBL case and want to be activated the discussion during the PBL session using the knowledge they have learned in previous lectures.
In our study, the students’ opinions on the tutor presence were widely distributed (approximately 50%–96%). Students appeared to welcome a tutor who could understand the philosophy and process of the PBL. Park et al. [11] reported that students evaluated the role of tutor as somewhat negative and good facilitation skills of discussion and process of the PBL is strongly required. Hur & Kim [16] reported that the discussion was often interrupted by improper tutor intervention and the important role of tutors was to facilitate open discussion and to create a safe environment. According to Nanda & Manjunatha [17], tutors who are too strict could generate stress and pressure among students and an uncomfortable atmosphere can disrupt students’ open-minded thought. There is no need for tutor in a PBL session if the tutor is too strict. For this reason, investigators claim that tutors need more training to conduct the PBL. These studies support our results of the students’ preference for having a tutor and students’ perceptions toward tutor.
In our study, the tools for assessment included tutor and peer assessment, learning report, MEQs, responding questionnaire, drawing case mapping and schema, and attendance. Our results revealed that peer assessment proved not to serve as a reliable assessment tool. According to Kim et al. [18], peer assessment could be used as an effective assessment tool for students’ performance in PBL when peer evaluation score is not included in the grades. User-friendly peer evaluation can be used to screen for maladjusted students when students understand the purpose and feedback method of peer assessment well and the questionnaire of peer review is well constituted. Most of the students in our school preferred the pass/fail assessment to grading after 2002. The result regarding preference for grading is consistent with that of Chung et al. [12].
In summary, our results indicate that in order to increase students’ satisfaction with hybrid PBL and to improve the perception of it, firstly, it appears to be necessary to arrange the date and the time of PBL sessions so that students can concentrate on PBL. Secondly, PBL cases should be selected and arranged to be well synchronized with the concurrent lectures. Finally, it is important to create a safe atmosphere so that students can engage actively in PBL sessions. It is strongly recommended that the tutor should play a role to facilitate the group’s thinking and discussion and to guide the PBL process.

Acknowledgments

None.

Notes

Funding
This research was supported by Kyungpook National University Research Funds, 2012.
Conflicts of interest
None.

Fig. 1.

Student’s Overall Satisfaction Level of Problem-Based Learning

PBL: Problem-based learning.
kjme-28-1-9f1.gif
Table 1.
Survey Participant
2002 2005 2009 2010 2012 2014 Total
No. of Participants 134 139 110 113 110 110 716
No. of Respondents 127 122 109 113 106 108 684
Responding rate (%) 94.8 87.8 99.0 100 96.3 98.1 95.7
Table 2.
Topic and Target Year of Survey
Survey topic 2002 2005 2009 2010 2012 2014
Student’s overall satisfaction level
Students' preference between longitudinal style vs. block style
Students' preference for frequency of PBL sessions per week
Arrangement of PBL session and related lecture
Synchronization of contents of PBL case and ongoing lecture
Students' preference for tutor attendance at PBL session
Students' preference for the grading system

PBL: Problem-based learning.

Table 3.
Student’s Overall Satisfaction Level of Problem-Based Learning
Survey item Year No. Mean score SD SD F p Scheffe
I am satisfied with the PBL 2002 (a) 127 3.68 0.916 0.081 22.506* 0.000 a<b, d
2005 (b) 122 4.26 0.557 0.050 b>c, e
2010 (c) 113 3.88 0.530 0.050 c>e
2012 (d) 106 4.05 0.653 0.063 d>e
2014 (e) 108 3.44 0.835 0.080
I am satisfied with my tutor 2002 (a) 127 3.31 0.870 0.077 28.305* 0.000 a<b, d
2005 (b) 122 4.25 0.621 0.056 b>c, d, e
2010 (c) 113 3.31 0.791 0.074 c<d
2012 (d) 106 3.65 0.829 0.080
2014 (e) 108 3.62 0.817 0.079
I am very active in PBL sessions 2002 (a) 127 3.81 0.710 0.063 9.485* 0.000 a<b, e
2005 (b) 122 4.30 0.585 0.053
2010 (c) 113 4.04 0.557 0.052
2012 (d) 106 4.06 0.659 0.064
2014 (e) 108 4.14 0.648 0.062
I do self-directed learning for PBL 2002 (a) 127 3.33 0.713 0.063 28.786* 0.000 a<b, c, d, e
2005 (b) 122 4.23 0.614 0.056 b>c, d, e
2010 (c) 113 3.75 0.675 0.064
2012 (d) 106 3.90 0.661 0.064
2014 (e) 108 3.92 0.725 0.070
Team members are cooperative and helpful for each other 2002 (a) 127 3.42 0.771 0.068 38.837* 0.000 a<b, c, d, e
2005 (b) 122 4.27 0.499 0.045
2010 (c) 113 4.31 0.568 0.053
2012 (d) 106 4.08 0.643 0.062
2014 (e) 108 4.06 0.681 0.066
Total of above five items 2002 (a) 127 3.51 0.509 0.045 42.452* 0.000 a<b, c, d, e
2005 (b) 122 4.26 0.405 0.037 b>c, d, e
2010 (c) 113 3.86 0.393 0.037
2012 (d) 106 3.95 0.462 0.045
2014 (e) 108 3.84 0.512 0.049

SD: Standard deviation, PBL: Problem-based learning.

* p<0.05.

Table 4.
Student’s Perception toward Tutor Attendance at Problem-Based Learning Session
Positive Negative
Tutors guide discussion and prevent from going to the wrong direction. Discussion is often interrupted by improper tutor intervention.
Tutors help students understand key points with proper advice or information. Conflicts over the PBL process often caused by the frequent changes and different facilitation skills of tutors.
Tutors facilitate keeping track of the PBL process by proper intervention. Tutors sometimes fail to guide the right direction and session becomes distracted.
Tutors assist students to approach the issues schematically. Students often hesitate to talk in front of tutors or are intimidated by tutors.
Tutors help students have organized wrap-up of discussion. Tutors are sometimes too aggressive in questioning and make students embarrassed and helpless.

PBL: Problem-based learning.

Table 5.
Tools for Student Assessment in Problem-Based Learning
Year Tutor assessment Learning report MEQ Peer assessment Responding questionnaire Case mapping Attendance Others
2002 50 20 20 - 10 - - -
2003 - 30 50 - 10 - - 10
2004 50 30 - - 10 - - 10
2005 50 40 - - 10 - - -
2006 50 - 10 10 - 10 10 10
2007 50 30 - - 10 10 - -
2008 50 30 - - 10 10 - -
2009 50 - 10 10 10 10 10 -
2010 50 - 10 - 10 10 20 -
2011 40 - 10 - 10 20 20 -
2012 40 - 10 - 10 20 20 -
2013 40 - 10 - 10 20 20 -
2014 40 - 10 - 10 20 20 -

Data are presented as percentage.

MEQ: Modified essay question.

References

1. Barrows HS. Problem-based learning applied to medical education. Springfield, USA. 2000.

2. Korean Association of Medical College. The report of medical college education: 2005–2006. Vol. 14. Seoul, Korea: Korean Association of Medical College; 2009.

3. Chang BH, Lee YC, Kim BW, Kang DS, Kwak YS, Kang E, Seo KS, Kim IK, Lee JM, Jeong SH, Kim JY, Kim IS, Kim HJ. The implementation of problem-based learning in Kyungpook National University School of Medicine and its evaluation. Korean J Med Educ 2001;13:91-105.
crossref
4. Kim YJ, Kang PS, Lee CK, Park JH. The principle and practice of PBL. Korean J Med Educ 2000;12:1-14.
crossref
5. Kim S, Yang EB, Lee SK, Kang HC, Lee MS. The development and the application of problem-based learning curriculum. Korean J Med Educ 1998;10:309-321.
crossref
6. Eun HC, Kim BK, Kim JG, Baik SH. Comparative study of problem-based learning (PBL) experiences in different learning groups. Korean J Med Educ 1997;9:119-128.
crossref
7. Lee JT, Choi JS, Kim SH, Paik NW. the experience and evaluation of problem-based learning in Inje University College of Medicine. Korean J Med Educ 1998;10:351-362.
crossref
8. Kim JJ, Lee KJ, Won JH, Lee DH, Ahn ET. PBL practice and its evaluation in Soonchunhyang Medical School. J Soonchunhyang Med Coll 2002;8:39-47.

9. So YH, Lee YM, Ahn DS. An student's evaluation of the implementation of problem-based learning. Korean J Med Educ 2005;17:49-58.
crossref pdf
10. Chae SJ, Lee DS, Lee YS. Causal analysis and improvement strategies of the problems in implementing a pbl program in integrated curriculum. Korean J Med Educ 2003;15:35-43.
crossref pdf
11. Park EH, Park JH, Park YN. The experience of problem-based learning in Keimyung University College of Medicine. Korean J Med Educ 2000;12:261-270.
crossref
12. Chung IW, Shin CJ, Hahn HS, Song YJ. The practice and evaluation of problem-based learning in College of Medicine, Chungbuk National University. Korean J Med Educ 1999;11:285-295.
crossref
13. Kim JH, Kim JY, Son HJ, Choi YH, Hong KP, Ahn BH, Uhm DY, Chin YE, Seo JD. A qualitative evaluation of problem-based learning curriculum by students' perceptions. Korean J Med Educ 2004;16:179-193.
crossref pdf
14. Chae SJ, Shin JS, Lee YS. Comparison of the academic achievement by self-directed learning readiness levels in a hybrid problem based learning course. Korean J Med Educ 2004;16:281-288.
crossref pdf
15. Yune SJ, Im SJ, Lee SH, Baek SY, Lee SY. Effects of differences in problem-based learning course length on academic motivation and self-directed learning readiness in medical school students. Korean J Med Educ 2010;22:23-31.
crossref pmid pdf
16. Hur Y, Kim S. Teaching and learning strategies of PBL. Korean J Med Educ 2002;14:145-156.
crossref
17. Nanda B, Manjunatha S. Indian medical students' perspectives on problem-based learning experiences in the undergraduate curriculum: one size does not fit all. J Educ Eval Health Prof 2013;10:11.
crossref pmid pmc pdf
18. Kim JY, Son HJ, Lee JH, Kim JH, Hong KP. Educational implication of peer evaluation in problem-based learning. Korean J Med Educ 2005;17:275-284.
crossref pdf
Editorial Office
The Korean Society of Medical Education
(204 Yenji-Dreamvile) 10 Daehak-ro, 1-gil, Jongno-gu, Seoul 03129, Korea
Tel: +82-2-2286-1180   Fax: +82-2-747-6206
E-mail : kjme@ksmed.or.kr
About |  Browse Articles |  Current Issue |  For Authors and Reviewers
Copyright © 2024 by Korean Society of Medical Education.                 Developed in M2PI