Effectiveness of training intervention to improve medical student’s information literacy skills

Article information

Korean J Med Educ. 2016;28(4):391-395

Publication date (electronic) : 2016 December 1

doi : https://doi.org/10.3946/kjme.2016.44

Mohammadhiwa Abdekhoda^1,2, Afsaneh Dehnad^,3, Mahmood Yousefi⁴

¹Department of Medical Library and Information Sciences, School of Health Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran

²Iranian Center of Excellence in Health Management, School of Health Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran

³Department of Foreign Language, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran

⁴Department of Management and Health Services, School of Health Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran

Corresponding Author: Afsaneh Dehnad (http://orcid.org/0000-0001-9874-3045) Department of Foreign Language, School of Health Management and Information Sciences, Iran University of Medical Sciences, Valiaser ave. Rashid yasemi ave., Iran Tel: +98-04133251378 Fax: +98-04133251378 email: afsanehdehnad@gmail.com

Received 2016 July 5; Revised 2016 September 13; Accepted 2016 October 17.

Abstract

Introduction

Search skills and strategies play an important role in locating relevant information since the emergence of evidence-based medicine (EBM) by health care staff; however, there are many medical students graduating from medical schools without acquiring these skills which are crucial in their career lives [1,2].

Recently, “medical information systems” course has been integrated into the curriculum of medical education, and is often perceived as a prerequisite of learning about the practice of EBM. Several research studies have been applied in several studies to survey the impact of training intervention on students’ skills in online search [3].

However, there is a small, but growing research on identifying what is the best practice in educating students and clinicians to conduct effective search. For example, Ghali et al. [4] carried out a before and after study by teaching mini courses in EBM for medical students in four sessions focusing on writing clinical questions, searching Medline, having critical appraisal, and applying evidence. The results of this study showed significant improvement in students’ search skills in the four aforementioned areas [4].

This study aimed to assess the efficiency of delivering a 4-month course of “effective literature search” among medical postgraduate students for improving their attitudes and skills regarding online literature search.

Subjects and methods

This was a cross-sectional study administrated in October 2015 and January 2016 subsequently. This prepost design was intended to assess the effect of one-semester training intervention of “effective literature search” among medical postgraduate students of Tabriz University of Medical Sciences.

The participants in this study were postgraduate students who participated in 4-month course of “effective literature search.” As for the sample, from 197 postgraduate students (n=197), 90 students were selected by stratified randomized sampling scheme, with stratification for master of science (MSc) students (65%), and doctor of philosophy (PhD) students (35%).

In October 2015, before the training begins, students’ perception toward online search, and their search skills were assessed by a researcher-made questioners and on the basis of a literature review. The survey included structured questionnaire in four areas addressing in prior paragraph. “Totally agree,” “agree,” “neutral,” “disagree,” and “totally disagree,” formed the questionnaire which was based on a 5-point Likert scale.

Five faculty members of medical education department confirmed the content and face validity of the study instrument. Cronbach’s α coefficient revealed a high degree of internal consistency (0.9). Also, the reliability of the questionnaire was measured by test-retest (0.9).

Participants took part in 12 training sessions, in which familiarity with medical resources and databases, design search strategy and conduct a search, and applying search and meta search engine, were presented by highly qualified teacher (HQT).

In January 2016, after a 4-month course of “medical information systems,” students’ perception and their search skills were reassessed. Participants took part in a practice test that was conducted by HQT. In practice test, the students’ information literacy competency in designing search strategy, formulating search questions, finding keywords, applying Boolean logic and using other search functions such as search filtering and transaction were assessed.

All data from pre- and post-survey were entered in SPSS software using a t-test to compare score changes in four areas form before intervention versus after intervention. Table 1 shows the questions used in the survey measuring the various components of the study.

Table 1.

Demographic Details of the Students Participated in the Present Study

Demographic information of the study showed that the majority of the participants (70.2%) were female (Table 2). More than 45 percent of participants were in the age range of 25 to 30 with the mean age of 27.3. The data also showed more than 64 percent of students had MSc. Table 3 shows that there was a significant change in students’ attitude which improved considerably toward online literature search after the training. The data from Table 3 also showed students’ familiarity with medical resources and databases as well as their ability to apply search strategies and skills improved significantly. Likewise, there was a significant change in students’ ability to apply search and meta search engines.

Table 2.

Demographic Information of the Participants

Table 3.

Students Competency Score across Online Literature Searching before and after Intervention

Conclusion

The finding of this study provides considerable evidence that training in online literature search has a marked effect on students’ attitude and skills which are vital for the efficient use of online databases.

In terms of the impact of training intervention on students’ attitude and their perception toward online literature search, the data shows a significant change after the intervention. This finding is in line with the findings of several studies reporting improvement in student’s perception and the performance after training [5,6,7,8,9].

Concerning the impact of training intervention on students’ familiarity with medical resources and databases, the results of paired samples test indicated a significant improvement after the intervention. Likewise, Ren [6], Kroustallaki et al. [10] found that training had a significant impact on users’ familiarity with resources and databases [7]. Therefore, training intervention and information skills training are worthwhile and effective methods to efficient use of information and resources, provided students put skills into practice.

Regarding the impact of training on students’ ability to develop search strategies, Table 2 shows significant improvement after training. This finding supports the findings of Ghali et al. [4], Eldredge et al. [8], and Kroustallaki et al. [10] reporting training had direct and significant effect on users’ ability of query formulation and information selection.

Finally, concerning the impact of training intervention on students’ ability in applying search and meta search engine, the results showed a significant change in students’ skills. Students’ ability in performing efficient search engine selection, using Boolean logic operator, and applying search strategies based on search engines tips improved significantly after training. Similarly, Ghali et al. [4] and Gruppen et al. [3] found that training had direct and significant impact on users’ ability in applying search and meta search engine.

Although the findings of this study adds to the literature in supporting the role of training in improving students’ attitude and skills, the limited number of participants, and students’ self-reported behavior changes are the limitations of the study.

In conclusion, our study suggests that training is an effective method for delivering information literacy skills to students and has a significant impact on students’ competency in efficient use of online resources. The results of this study showed students’ attitude toward online literature searching, their familiarity with medical resources and databases, their ability in developing search strategy and applying search and meta search engine significantly improved after the intervention providing them a great opportunity to practice search skills and improve health care services on the ground of evidence based medicine.

Article information Continued