Construction and validation of a mentoring questionnaire based on Islamic culture

Article information

Korean J Med Educ. 2019;31(2):159-172

Publication date (electronic) : 2019 May 30

doi : https://doi.org/10.3946/kjme.2019.127

Morteza Khaghanizadeh¹, Husein Taqavi^,1,2, Abbas Ebadi¹

¹Behavioral Sciences Research Center, Life Style Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran

²Faculty of Educational Sciences & Psychology, University of Mohaghegh Ardabili, Ardabil, Iran

Corresponding Author: Husein Taqavi (https://orcid.org/0000-0001-5943-8806) Faculty of Educational Sciences & Psychology, University of Mohaghegh Ardabili, Ardabil, 56199-11367, Iran; Behavioral Sciences Research Center, Life Style Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran Tel: +98.9146238286 Fax: +98.4533520457 email: husen324@gmail.com

Received 2018 October 27; Revised 2019 January 26; Accepted 2019 March 25.

Abstract

Introduction

The realization of individual, organizational-institutional, and social goals, defined for each educational system as well as overcoming possible challenges ultimately depend on cognitive, skill, and attitudinal development of learners; Furthermore, preparing competent professional agents, in addition to structure-based approaches such as formal academic programs, requires taking into account the social and interactive approaches, which Wenger [1] regards as the ‘community of practice.’ These formal procedures of preparation as such need people’s interaction, leading to the formation of emergent learning systems.

Instead of immediate attention to professional development, these approaches concentrate on professional identity development; by using such structures as mentoring, they explain professional identity development. They also emphasize the fact that human learning occurs in interaction with others and observing and imitating them, social learning approach explains learners’ development [2]. Mentoring represents one of such strategies for development of competencies.

According to Kram [3] mentoring is defined as a dynamic relationship between younger and senior individuals that possesses the potential to enhance career and psychosocial development of both the mentor and the protégé. In the Kram [3] model, career functions and psychosocial functions are considered as the two major factors of mentoring which role modeling is considered as part of the second factor. While reviewing earlier studies, Johnson [4] divided mentors’ capabilities into three main classes of cognitive, emotional, and relational abilities. In addition, skills or competency development, psychosocial or socio-emotional support, and career development are regarded as the other categories [5].

Reviewing the studies from 1983 indicates that reflection, coaching, counseling, assessment, role modeling, colleague/fellow learner, parenting mediating, making friend, and finally teaching can be considered as the most significant components of mentoring [6,7]. Furthermore, challenging, acceptance, confirmation, exposure and visibility [3,8], interaction with the application of relational skills [4], and active listening [9] are other components which have been mentioned in a number of studies.

Numerous tools have been developed in order to assess these components. For instance, Noe [8] questionnaire with 29 items in the form of nine components, Fleming et al. [10] questionnaire with 26 items to measure six components, and the mentoring effectiveness questionnaire developed by Anderson et al. [11], which contains 18 items in order to measure five components, have all been credible questionnaires in this field.

Thus, the development of these tools highly suggests that different angles and aspects of mentoring have been largely clarified in various studies; however, given the dependency of research findings on the context, in particular, in education as a cultural matter, such findings cannot form the basis for making any decisions regarding educating professional agents, without taking into account the cultural conditions and environment. In addition, it should be noticed that the major aim of educational systems is to learn and nurture educated individuals. This issue is intertwined with the values of society [12].

Hence, due to the Islamic cultural principles and the current values associated with them in the Islamic countries, identification of mentoring components, as a developmental strategy in the medical field, seems necessary.

In addition to the cases mentioned previously, any intervention to higher education first and foremost, requires sufficient data to act as an observing tool in order to describe the status quo and consequently, plan for the desired situation and a questionnaire is considered as one of the efficient, inexpensive, and credible tools for obtaining this type of data. Therefore, the current study seeks to develop a tool to quantify and also introduce the associated psychometric properties in regard to contextual texts of Islamic mentoring and seek to determine the validity of the components of mentoring component extracted from Islamic texts.

Methods

A descriptive survey research method was utilized in this study and data were collected using Islamic mentoring questionnaire. The population of the study includes two groups of Ph.D. students in Baqiyatallah University of Medical Sciences and Tehran University of Medical Sciences (in the Islamic Republic of Iran); the required sample for collecting quantitative data was selected from students who already had a thesis. Stratified random sampling was used; because of the uncertainty of the study population number, In order to determine the sample volume, ‘the ratio of sample volume to the number of variables’ method in factor analysis studies was employed (two to 10 cases for each variable), which the respective ratio is within the limits in this study.

Subsequently, 300 questionnaires were distributed among participants in this study, where the completion rate was at 85%. At the next step, following the data screening, before and after data entry in the used software, 42 questionnaires were disregarded for the further proceedings. Finally, 213 completed questionnaires by students were then used for the final analysis. The Research Ethics Committee of Baqiyatallah University of Medical Sciences approved the study (IRB approval no., IR.BMSU.REC.1395.61). The demographic characteristics of participants are presented in Table 1.

Table 1.

Demographic Characteristics of Participants

Islamic mentoring questionnaire was used in order to collect data. Since the aim of the our study was to develop a tool for studying the mentoring based on Islamic culture, the literature regarding the Islamic mentor and mentee relations were initialy analyzed in order to investigate the features and properties of this type of mentoring. These studies consist of theoretical texts, conducted studies, practices, instructions, policies, and developed plans [13]. In order to extract the indicators of Islamic mentoring in the current study, Quran as well as Hadith by Imams referenced in Usul al-Kafi, Wasael Al-Shia, and Nahj al-Balaghah were investigated. Other reliable Islamic texts and research reports were investigated, which were obtained by studying first-hand references of educational approaches related to the Islam prophet, Imams, and Shiite clergyman. Other references which were evaluated include educational guidelines and methods proposed by prominent Islamic scholars and researchers. The procedure in which the content of these guidelines were investigated was as follows: (1) specifying related descriptors for mentoring and determining keywords; (2) specifying references, finding, and classifying them; (3) ranking Islamic texts, library articles, and conducted studies based on their importance; (4) analytical investigation of Islamic texts and preparing a summary and main points; (5) comparing and matching the proposed definitions and points and identifying the main properties and related details; (6) extracting codes and classifying them (more than 300 codes); (7) identifying the main categories (25 categories); and (8) developing themes while the identified categories are being integrated, encountered and their respective relations are being identified (nine themes).

Accordingly, in the current study, Islamic Mentoring refers to developmental relationships between supervisors as experienced individuals and students as an inexperienced individuals which status is determined on the basis of nine components that were extracted from Islamic texts and sources. The components of Islamic Mentoring, their definitions, and related items of the developed questionnaire were presented in Table 2 and Appendices 1, 2.

Table 2.

Islamic Mentoring Components Definitions and Related Items

After the themes were extracted and the related characteristics and details were identified, the concepts and features, which acted as the indicators and were extracted as the primary codes in the previous section, were divided into measurable concepts. Then, multiple clauses were developed for each of them, which finally converted into questionnaire items. (1) Preparing question bank: At first three to six items were designed with regard to the identified characteristics for mentoring in Islamic texts and conducted studies as well as developed questionnaires. (2) Scoring system and preparing the necessary instructions: While reviewing the previous questionnaires, the proposed instruction by Hooman [14] was referred in order to determine the system of scoring; as a result multiple choice system were selected based on the Likert scale (from always to never) were selected. Two letters and instructions were developed; for the content validity evaluators and final respondents of the questionnaire, respectively. (3) Evaluating the content and factor validity of designed questionnaire: In order to ensure the content validity, clarity, and fitness of each item in the questionnaire and comprehensiveness of the entire questionnaire was initially examined, where experts assigned a score of 1 to 4 to each item in terms of clarity and fitness. The comprehensiveness of the entire questionnaire was also measured by a two-choice question. Furthermore, according to the Lynn [15] recommendations with respect to the diversity and number of experts, the required data in this field were collected from three groups of statistics and measuring experts (three individuals), education experts (three individuals), and Islamic teaching and education (four individuals). (4) Lawshe [16] criterion was employed in order to make decisions with respect to keeping, modifying or eliminating the items. A consensus of 62% by the experts was considered as the minimum acceptable value for the item to be remained in the questionnaire. In such a way that if 62% of the experts evaluated each item acceptable in terms of fitness and clarity, the item was considered valid. (5) Factor validity, as a form of construct validity, was assessed to evaluate the validity of the questionnaire. After screening and replacing the missing values, the obtained data of 213 participators were assessed using confirmatory factor analysis.

Results

After completing the forms of content validity assessment of the 113-item questionnaire, their validity was evaluated with respect to the acceptable values [16]. Therefore the items, which have been given score 3 or 4 by at least 62% of experts in regard to their ‘relevance’ and ‘clarity,’ remained intact and the rest of them were eliminated. Consequently 28 items out were eliminated out of the initially available 113. In addition, the items which were given a score 3 by experts for their relevance and clarity, were edited and modified once again. Moreover, the questionnaire comprehensiveness was also measured through yes or no response to these questions: (1) Do you think the questionnaire is comprehensive? and (2) Do you think the total number of items is adequate?

All 10 experts assessed that the questionnaire is comprehensive and the total number of items is adequate. The significance of the correlation matrix was checked prior to conducting the factor analysis. In addition, the Kaiser-Meyer-Olkin (KMO) Measure of Sampling adequacy was performed to analyze the feasibility of factor analysis and was determined at 0.941. The results of Bartlett’s test of sphericity also indicated that enough significant correlation exists between the items (x̄=12,185.004, degree of freedom [df]=2,415, and p<0.001). Therefore, due to the results obtained from the KMO test and Bartlett’s test, data correlation was considered appropriate for the factor analysis.

Additionally, the correlation of all components with respect to the entire scale was calculated to meet the other condition of factor analysis, i.e., the rate of components communality with the main factor, which revealed that the minimum obtained correlation is 0.53. Moreover, the correlation between each component is significant yet incomplete, which indicated the independence of mentoring developing factors (Table 3).

Table 3.

The Correlation Coefficient of Mentoring Questionnaire with Subscales

The initial factors were extracted in the second phase of factor analysis. In addition, first order confirmatory factor analysis was conducted using LISREL (Scientific Software International Inc., Lincolnwood, USA) in order to evaluate 85 items of Islamic mentoring questionnaire, which nine main factors can be achieved. Table 4 shows standardized parameters of factor loads and determination coefficients and t-values.

Table 4.

Standardized Factor Loads, Determination Coefficient and t-Statistic (N=213)

As shown in Table 4, except in 15 items, estimation of standardized parameters of factor loads, determination coefficients, and t-values indicate that the rest of model parameters were all significant and a considerable amount of variance was estimated (the value of R² within 0.44 to 1). To confirm whether proposed subscales (or categories) form the emerged themes or not, second-order confirmatory factor analysis was used.

Fitness indexes are shown in Fig. 1. The chi-square index in samples larger than 100 is often significant. Therefore, it may not be the most appropriate index for assessing model fitness in this study. A successful fitness can be achieved if the ratio of chi-square index to the df is less than 3. In addition, if the indexes of goodness-of-fit index (GFI), adjusted GFI, and comparative fit index are larger than 0.95 and root mean square error of approximation is less than 0.08, a desired and proper fitness can be obtained.

Fig. 1.

Factor Analysis of Islamic Mentoring Questionnaire and Assessing Goodness of Fit

Chi-square=1,660.17, p<0.05, GFI=0.96, adjusted GFI, 0.95, root mean square error of approximation=0.057.

GFI: Goodness-of-fit index.

The obtained values for the mentioned indexes show totally good fitness of data with the model. To estimate the reliability of questionnaire, internal consistency method, from Cronbach’s α coefficient was used. The reliability coefficient in this study for whole test and subscales was acceptable. The obtained coefficients for the components were as follows: (1) role modeling with eight items at 0.79, (2) challenging with eight items at 0.90, (3) coaching with 11 items at 0.94, (4) encouraging with six items at 0.91, (5) consulting with nine items at 0.89, (6) protection with five items at 0.89, (7) care and reverence with nine items at 0.88, (8) good behavior and facilitating with nine items at 0.813, and (9) scientific networking with five items at 0.894. Finally, Cronbach’s α coefficient for the entire questionnaire was also obtained as 0.97.

Discussion

Mentoring is basically performed to assist and develop the students. Mentoring is expected to provide psychological and scientific support and emotional calmness. Moreover, developing scientific and cognitive skills of mentees, nurturing positive identity in them [3,6,8,17], and mentee development lead to the promotion of professional and emotional competency and self-respect, which in turn, results in the success of mentees.

In mentoring interactions, mentees have opportunities in order to continuously observe mentor’s scientific and professional behaviors. This leads to facilitation and modification of the mentee’s learning. Psychological and scientific support also strengthens previous learning and helps the student to manage challenges. According to Strauss et al. [18], successful mentoring were characterized by reciprocity, mutual respect, clear expectations, personal connection, and shared values.

The components of Islamic mentoring questionnaire, which is based on Islamic culture, are highly similar to other findings in the literature. Roll modeling, challenging, coaching, consulting, protection, and scientific networking have emerged as the significant aspects of mentoring. However, existing differences should not be neglected. For instance, in the current study, alongside of good temper are two of the emphatic components in Islamic studies. This component means ‘don’t be overbearing, have good behaviors, nice words and good debate’ in mentoring. Among these subcomponents, overbearing has been only focused on international studies, for example in the National Science Academy of America, 1997, cited in Akili [19]. Similar situation exists in terms of other components, i.e., respect and attention. Among the emphasized subcomponents of this component, i.e., identifying and considering the mentees’ characteristics, respecting mentee and intimacy in relations, only the last one has been explicitly confirmed in international studies [3,8,9]. In addition components such as openness [20], intellectuality, wisdom [9], and cognitive abilities [4] have been considered to be developed for mentoring, which did not appear as independent themes in the current study.

In addition to the above mentioned cases, the evaluated components, in the form of nine components, were extracted from Islamic literature and texts. Natural difference of Islamic paradigm and the ruling academic field on the international scale, in terms of responding to the main questions about human nature and his education, in spite of general similarities considered in the confirmatory mentoring Islamic components based on previous studies, several differences in nature aroused between these two paradigms, which requires attention in the interpretation of the current study findings.

Vertical type of mentoring was also noticed in the current study. As Kram and Isabella [21] proposed many years ago, given two important components in mentoring, i.e., developing relations and experience, these relations can also occur horizontally between peers or inside a group situation.

The psychometric properties of designed questionnaire were also confirmed using a survey of experts, internal consistency, Cronbach’s α, content validity, and factor validity. However the other indicators of questionnaire validity such as concurrent and criterion validity have not been determined which can be the subject of future studies. Moreover, the results of the current study were obtained from the data collected from the students of medical sciences faculties. Its application in other situations requires evaluations, which other methods such as concurrent validity should be taken into account as well. Despite such limitations, the developed questionnaire generally seems to have required validity for measuring the mentoring relations.

In terms of the practical purposes and considering the importance of individuals being able to get to know each other and find compatibility in mentoring relationships, the significance of defining and classifying professional and expertise records of professors can help the students to choose the professors which are capable of meeting their needs. This leads to compatibility between the professors and students. Furthermore, the developed tool in the current study can be used for assessing and proposing feedback to professors and clarifying their weaknesses and strengths in mentoring and help them and their respective institutions to plan for overcoming their weaknesses. It can be also a basis for obtaining objective data with regard to the outputs of mentoring programs and assessing considerable levels of their effectiveness. Moreover, mentors and their mentees can potentially use the findings for further identifying each other and clarifying their disagreed points. Finally, they can identify their needs and expectations and adapt them with the needs, responsibilities and abilities of opposite party.

Article information Continued