|Year : 2022 | Volume
| Issue : 1 | Page : 51-61
Psychometric properties of the persian version of the health professionals education in patient safety survey
Niloufar Alidousti-Shahraki1, Sedigheh Farzi2, Mohammad Javad Tarrahi3
1 Student Research Center, Faculty of Nursing and Midwifery, Isfahan University of Medical Sciences, Isfahan, Iran
2 Nursing and Midwifery Care Research Centre, Department of Adult Health Nursing, Faculty of Nursing and Midwifery, Isfahan University of Medical Sciences, Isfahan, Iran
3 Department of Epidemiology and Biostatistics, School of Health, Isfahan University of Medical Sciences, Isfahan, Iran
|Date of Submission||08-May-2021|
|Date of Decision||24-Sep-2021|
|Date of Acceptance||04-Oct-2021|
|Date of Web Publication||23-Mar-2022|
Isfahan University of Medical Sciences, Isfahan
Source of Support: None, Conflict of Interest: None
Background: Safe care requires acquiring special competencies. Suitable instruments are needed to evaluate such competencies. Objectives: This study aimed to assess the psychometric properties of the Persian version of the Health Professionals Education in Patient Safety Survey (H-PEPSS). Methods: A methodological study was conducted in 2020, on the students who were spending their last year of study in nursing, medicine, pharmacy, midwifery, surgical technology, and anesthesia, in the Isfahan University of Medical Sciences. The H-PEPSS was translated into Persian based on the Brislin translation model. Face validity, content validity index (CVI), and content validity ratio (CVR) were examined. The construct validity of the scale was assessed using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Cronbach's alpha coefficient and interclass correlation coefficient were also calculated as reliability criteria. Results: The face validity of the Persian translation of H-PEPSS was confirmed by a panel of experts, and the items' impact scores were greater than 1.5. Three items were modified, and the CVI of the scale was calculated at 0.91. Besides, the items' CVR ranged from 0.64 to 1.00. In EFA, six factors were extracted, which shows the competencies the students possessed both in the classroom and clinical setting, which then were confirmed through the CFA. All items had a factor loading value greater than 0.4. Goodness-of-fit indices were obtained: Root Mean Square Error of Approximation (RMSEA) = 0.064, Tucker-Lewis Index (TLI) = 0.922, and Comparative Fit Index (CFI) = 0.931 for the classroom and RMSEA = 0.076, TLI = 0.912, and CFI = 0.923 for clinical setting. The Cronbach's alpha of the scale was 0.936 for the classroom and 0.949 for the clinical setting. Conclusions: The Persian version of H-PEPSS includes six factors with 23 items. This scale is a valid and reliable instrument for assessing patient safety education in the classroom and clinical setting.
Keywords: Health personnel, Iran, Patient safety, Psychometrics, Students, Survey
|How to cite this article:|
Alidousti-Shahraki N, Farzi S, Tarrahi MJ. Psychometric properties of the persian version of the health professionals education in patient safety survey. Nurs Midwifery Stud 2022;11:51-61
|How to cite this URL:|
Alidousti-Shahraki N, Farzi S, Tarrahi MJ. Psychometric properties of the persian version of the health professionals education in patient safety survey. Nurs Midwifery Stud [serial online] 2022 [cited 2022 May 19];11:51-61. Available from: https://www.nmsjournal.com/text.asp?2022/11/1/51/340536
| Introduction|| |
Patient safety (PS) is a significant indicator of quality improvement in health care systems. PS means preventing and reducing the occurrence of adverse events and consequences that might harm the patient while providing care. According to the World Health Organization, 10% of the hospitalized patients experience adverse events, and this rate is 18% in the Eastern Mediterranean region, where Iran is located. It is believed that 83% of these events are preventable. Annually, 134 million people in middle- to low-income countries receive unsafe care, of whom 2.6 million die. Moreover, about 15% of hospital expenditures are spent on treating safety hazards.
Despite the important role of nurses in patient care and safety, a systematic review has reported that a majority of errors are made by nurses, mostly due to high workload, inadequate night sleep, and high stress.,
To improve PS, the Iran Ministry of Health and Medical Education has developed hospital accreditation standards to ensure PS and required health care centers to implement PS metrics. However, some studies in Iran have shown that the status of PS indicators is unfavorable., Providing safe care requires PS competencies. Hence, such competencies should be integrated into health professional education that prepare health care providers. In particular, it should be ensured that health care students who are about to graduate and enter the health care system are eligible to provide safe care for their patients. To this end, a valid and reliable instrument must be used to measure safe care competencies and ensure apposite PS training and feedback.
We found 12 valid and reliable instruments in the field of PS, some of which were in Spanish or Korean, and mostly focused on students' attitudes toward PS or on the assessment of PS knowledge and attitude. One of the commonly used scales of PS competence is the Health Professionals Education in Patient Safety Survey (H-PEPSS). The H-PEPSS is a self-report instrument that assesses PS competence both in the classroom and in the clinical setting. It was developed by Ginsburg et al. to measure health professionals' perceptions of their own PS competency at entry into practice. The original scale is in English and has been translated into several other languages including Italian, Dutch, Chinese, and Turkish, and its validity and reliability have been verified.,,,,, Due to the lack of Persian instruments to assess health professionals' perceptions of their competence in PS, the present study was conducted to fill this gap.
| Objectives|| |
This study aimed to evaluate the psychometric properties of the Persian version of H-PEPSS.
| Methods|| |
Design and study population
A methodological study was conducted from August to October 2020 in two phases including translation and evaluation of psychometric properties of the H-PEPSS.
Phase I. The translation phase
After obtaining permission from the primary designer of the H-PEPSS, the translation process was performed based on the Brislin translation model. Two bilingual translators who were fluent in Persian and English performed the translation and backtranslation of the scale. Initially, the first translator who also was an expert in PS translated the original version of the scale from English into Persian. Then, the second translator, who did not know about the original scale, backtranslated the Persian translation of the scale into English. This new English translation along with the original English scale and the Persian translation was shared with a group of experts to fix the bugs and confirm the analogy of the two English versions and the congruence of the Persian translation with them.
Phase II. Evaluating the psychometric properties of the scale
This phase included assessing the face validity, content validity, construct validity, internal consistency, and the test-retest stability of the translated scale.
Face validity assessment
The face validity was examined using both qualitative and quantitative methods. Firstly, we inquired about the standpoints of 15 experts. In the qualitative method, experts were requested to check the tool items for their readability, difficulty, appropriateness, grammar, and writing style and also for any ambiguity, inconsistency, misunderstandings, and inappropriate wording. In the quantitative method, experts were invited to comment on the significance of each item according to a five-point Likert scale ranging from “5: absolutely important” to “1: not important.” Then the items' impact scores were calculated via the following formula (impact score = importance × frequency [%]). Items with impact scores greater than 1.5 were retained in the scale. Furthermore, for sure, the Persian translation was provided to 20 eligible students to give feedback on its content and readability and address its potential bugs. The ambiguities were then resolved based on their feedback.
Content validity assessment
The content validity was examined using both qualitative and quantitative methods. In the qualitative method, experts were asked to express their views on the comprehensibility, clarity, simplicity, importance, and necessity of the items, as well as the adequacy of the items in the tool. For the quantitative content validity, the content validity index (CVI) and content validity ratio (CVR) were calculated. To calculate the CVI, according to the Walts and Bausell method, 11 experts were requested to comment on each item in terms of simplicity, relevance, and clarity through a four-point Likert scale. Then, items with a CVI ≥0.79 were accepted, those with a CVI between 0.70 and 0.79 were revised, and those CVI <0.7 were eliminated. The average CVI of all items was calculated as the overall scale CVI (S-CVI).
For CVR, which is calculated by the following formula, the same 11 experts were also commented on the necessity of each item on a three-point Likert scale ranging from “3: necessary” to “1: not necessary.” Considering the number of experts in Lawshe's table, the minimum acceptable value of CVR was 0.59.
In this formula, ne is the number of specialists who have selected the “required” option, and N refers to the total number of specialists.
Construct validity assessment
Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were used to determine the construct validity of the Persian scale. For assessing the construct validity, participants were selected among the students of the health professions of the Isfahan University of Medical Sciences. Students who were in their last year of study in nursing, medicine, pharmacy, midwifery, surgical technology, and anesthesia and agreed to take part in the study were recruited. The sample size was calculated based on the number of items in the scale. It is recommended to select 5 to 20 subjects per item. Hence, as the H-PEPSS includes 23 items, the minimum acceptable sample size is 115. However, we decided to select eight subjects per item and then multiplied it by 0.06 to compensate for the probable dropouts. The final sample size was estimated at 195. Then, we recruited 195 ones for assessing EFA and an additional 195 ones for the assessment of CFA. We first assessed the EFA and then the CFA. A quota sampling method was used to calculate and recruit the needed samples in proportion to the total eligible subjects in each major. The students who participated in the EFA were removed from the sampling frame when we recruited the subjects for the CFA.
Data were collected using H-PEPSS from August to October 2020. This scale was developed by Ginsburg et al., and the original version is in English. The H-PEPSS consists of two sections. The first section consists of 5 items related to demographic variables such as age, sex, semester, the field of study, and passing a course on PS. The second section includes 23 items about the competencies needed for maintaining the PS namely teamwork with other health professionals (6 items), effective communication (3 items), managing safety risks (3 items), understanding human and environmental factors (3 items), recognize, respond to, and disclose adverse events and close calls (4 items), and safety culture (4 items).
After coordinating with the faculties, the students' contact numbers were received from the class representatives in each faculty, and the selected students were added to the groups we already have created in WhatsApp and Telegram messengers. Then, text messages including information about the study aims, tips for completing the questionnaire, and the link to the questionnaire was sent to students as Google Forms. Three reactions were observed after sending these text messages to the students: (1) quick response to the text message and completing the questionnaire, (2) immediate rejecting (i.e. denial to participate), (3) nonresponse. Students who were not generally responsive were excluded from the study, and since a convenient sampling was carried out in each quota, people with immediate rejection and nonresponse were replaced with another one from the same quota. This was continued until the needed sample size was reached in each quota. In general, the scale was sent to a total of 724 eligible students to receive the required sample size in EFA and CFA phases, respectively. The students were requested to respond to each item separately based on the PS knowledge they possessed in the classroom and the clinical setting.
EFA and CFA
The Kaiser-Meyer-Olkin (KMO) measure and Bartlett test were used to evaluate the suitability of the data for factor analysis. The correlation between the main variable (PS) and factors and the correlation between factors and items (1–23)—calculated using the factor loading through CFA—are presented in [Figure 1] and [Figure 2]. If the factor loading value in any of the above cases is less than 0.4, the item should be eliminated. To determine the goodness of fit in this model, the Root Mean Square Error of Approximation (RMSEA), Comparative Fit Index (CFI), and Tucker-Lewis Index (TLI) were used. RMSEA values less than 0.06–0.07 are usually considered acceptable., For CFI and TLI, values greater than 0.9 indicate acceptable goodness of fit.,
The reliability of H-PEPSS was assessed using the internal consistency and the test-retest stability assessment methods. The internal consistency assessment was performed with the participation of 40 eligible students. A Cronbach's alpha ≥0.7 was considered acceptable. For test-retest stability assessment, the questionnaire was completed by 40 students twice at a two-week interval, and interclass correlation coefficient (ICC) was calculated.
This study was approved by the Ethics Committee of the Isfahan University of Medical Sciences (IR.MUI.RESEARCH.REC.1399.357). Verbal and written consent was obtained from the participants. To maintain confidentiality, a numeric code was used instead of participants' names. Permission for psychometric assessment was obtained from the original developer of the scale, Dr. Liane Ginsburg.
In addition to the aforementioned analysis methods, descriptive and inferential statistics including mean, standard deviation, frequency and percentage, ICC, Cronbach's alpha, test-retest, EFA, and CFA were used to analyze the data. The Kolmogorov-Smirnov test was used to determine the normality of the data. In the test-retest method, a paired t-test was used to compare the mean scores of six domains in the classroom and clinical setting between the primary and secondary completion. CFA was performed using the M plus software, and other statistical calculations were performed using the SPSS software (version 16; SPSS Inc., Chicago, IL, USA). The statistical significance was set at <0.05.
The results of face validity assessment
In the face validity assessment, the necessary changes were applied to the items through discussion among experts, and two items (items 3 and 14) were modified accordingly. The items' impact scores varied between 3.5 and 3.62. Therefore, no items were removed from the scale.
The results of content validity assessment
In determining qualitative content validity, necessary changes were applied through discussion among experts. Then, three items (items 1, 5, and 20) were modified. In the quantitative methods, the items' CVI scores varied between 0.72 and 1.00. Items with a CVI score of 0.7–0.79 were revised. No items were removed. The S-CVI was 0.91. Besides, the items' CVR ranged from 0.64 to 1.00.
The results of construct validity assessment
Characteristics of participants
The mean age of the students was 24.25 ± 2.54 years, ranging between 21 and 45 years. Among the 390 students, 45.1% were males, 42.1% and 22.7% were medical and nursing students, respectively [Table 1], and no one had passed a PS course.
Exploratory factor analysis
The descriptive statistic, correlation coefficient, and Cronbach's alpha of the Persian version of H-PEPSS have been presented in [Table 2]. The KMO value was 0.90 in the classroom and 0.92 in the clinical setting. Also, the significance level in the Bartlett test was <0.001 indicating the adequacy of the data for factor analysis. In the EFA, six similar factors were extracted for both the classroom and the clinical setting [Table 3] and [Table 4], which were the same as the domains in the original scale. The total variance explained was 75.01% and 79.06% for the competencies possessed in the classroom and the clinical setting, respectively. The highest factor loading values were related to the “recognize, respond to and disclose adverse events and close calls” domain both for the competencies possessed in the classroom and the clinical setting. The lowest factor loading values were related to “managing safety risk” and “teamwork with other health professionals” in the classroom and the clinical setting, respectively.
|Table 2: The descriptive statistics, correlation coefficient, and Cronbach's alpha of the Persian version of the Health Professionals Education in Patient Safety Survey|
Click here to view
|Table 3: Exploratory factor analysis of Persian version of the Health Professionals Education in Patient Safety Survey (in the classroom)|
Click here to view
|Table 4: Exploratory factor analysis of the Persian version of the Health Professionals Education in Patient Safety Survey (in the clinical setting)|
Click here to view
Confirmatory factor analysis
In CFA, the factor loading values of all items and factors were >0.4 [Figure 1] and [Figure 2]. Therefore, all 23 items were confirmed. Moreover, the highest factor loading value was related to factor 5 (i.e. 0.851 for the classroom and 0.874 for the clinical setting). The RMSEA value of the adjusted models was 0.064 for the classroom and 0.076 for the clinical setting. Also, CFI values for classroom and clinical settings were 0.931 and 0.923, respectively. Furthermore, the TLI value was 0.922 for the classroom and 0.912 for the clinical setting. All these values indicate the model's acceptable goodness of fit [Table 5].
The results of reliability assessment
The Cronbach's alpha of the scale was 0.936 for the classroom and 0.949 for the clinical setting. The ICC coefficients were 0.966 and 0.937 for the classroom and for the clinical setting, respectively, indicating a very good correlation between the values of the pre- and post-test, for both learning settings. The paired t-test showed that the students' mean scores for the classroom (t = 1.833, P = 0.074) and for the clinical setting (t = 0.841, P = 0.405) were not significantly different [Table 6].
| Discussion|| |
The H-PEPSS has been designed by Ginsburg et al. and has been translated into several languages.,,,, In the present study, the Persian translation of the H-PEPSS showed a good face validity. The original English language scale consists of 23 items in six subscales. None of the Persian translated items were removed in face validity assessment; however, the word sharing in the item “sharing authority, leadership and decision-making” was replaced by the word “participation.” Therefore, this item was modified as “participation of health team members in authority, leadership, and decision-making.” Also, for the item “safe use of health technology,” a well-known example was added for a better understanding, and the item was modified to “safe use of health technologies such as medical equipment and computer systems, etc.”
In content validity assessment, the criterion for an acceptable CVR was 0.59 according to Lawshe's table. The CVR of items in the Persian version of the scale ranged between 0.64 and 1.00, and, therefore, no items were deleted, but the items “Team dynamics and authority/power differences” and “the ways in which health care is complex and has many vulnerabilities” were edited due to a CVI score of less than 0.79. Taskiran et al. and Huang et al. have also translated the H-PEPSS into Turkish and Chinese languages and reported acceptable CVI for the items in the Turkish and Chinese versions of the scale.,
After confirming the content validity, the Persian scale was administered to 390 students for factor analysis. Six factors were extracted in EFA, which were the same as the original scale and also the same as the studies conducted in Turkey, China, and Italy.,,, Due to the acceptable factor loading values of all items, no item was deleted in CFA. This finding is congruent with what was reported in a study conducted in Turkey. However, seven items were removed during the CFA in the studies conducted in China, Italy, and Duch.,,
In the present study, the highest factor loadings in the classroom and clinical environment were related to the subscale of “recognize, respond to and disclosure of adverse events and close calls,” while the lowest factor loadings in the classroom and clinical environment were in the “managing safety risks” and “teamwork with other health professionals” subscales. However, in the Turkish version of H-PEPSS, the highest and the lowest factor loading values in both the classroom and clinical setting were related to “understanding human and environmental factors” and “teamwork with other health professionals” subscales, respectively. Also, the goodness-of-fit indices such as CFI, TLI, and RMSEA were calculated and confirmed the fitness of the model examined in the current study. However, more acceptable values of goodness-of-fit indices were reported in a study that examined the Dutch version of H-PEPSS.
The Cronbach's alpha of the Persian H-PEPSS was greater than 0.93, illustrating the excellent internal consistency of the Persian scale. This finding is congruent with what was reported in studies conducted in Turkey and Italy., However, the Cronbach's alpha values reported by Huang et al. and Bergs et al. were lower than the values in the present study., Furthermore, the ICC values confirmed the high stability of the Persian H-PEPSS. However, none of the similar studies reported the ICC of H-PEPSS., Similar to our results, Taskiran et al. found no significant difference between the mean scores of H-PEPSS when they administered it two times in one group. Our results, along with some earlier studies that examined PS competence,,, evaluated the effectiveness of training programs on improving this competency,, show that the H-PEPSS is a valid and reliable instrument for assessing PS competence.
The present study has strengths and limitations. For the first time, we translated and assessed the psychometric properties of H-PEPSS. This study was conducted in a university to homogenize students' learning environment. Due to the cancellation of formal training methods during the coronavirus disease 2019 (COVID-19) pandemic, it was not possible to communicate face to face with the participants in clinical or classroom settings, and it was a limitation of this study.
| Conclusion|| |
In this study, a Persian version of H-PEPSS was prepared. This scale has 23 items in six domains. The Persian H-PEPSS is a valid and reliable instrument for assessing health professionals' perceptions of PS competence at entry into practice. It can help the education system to assess how health care teachers (i.e. nurse educators, medical educators, etc.) teach PS to their students in the classroom and clinical setting. This scale can be used as a PS training guide and as an instrument to assess the students before, during, and immediately after the internship to ensure that graduates have the necessary qualifications to provide PS.
The author is grateful to the final year health professional students of the Isfahan University of Medical Sciences in 2020, as well as the educational managers and other participants who helped us in this study.
Financial support and sponsorship
This study was conducted as a Master's thesis in nursing and financed by the Vice Chancellor for Research of Isfahan University of Medical Sciences, project number: 399328.
Conflicts of interest
There are no conflicts of interest.
| References|| |
Ravaghi H, Barati-Marnani A, Hosseini AF, Takbiri A. The relationship between health care providers' perceptions of patient safety culture and patients' perceptions of medical errors in teaching hospitals in Tehran. J Health Manag 2012;15:57-68.
World Health Organization. http://www.emro.who.int/entity/patient-safety/index.html (last access on 06 April 2020).
World Health Organization. https://www.who.int/news-room/campaigns/world-patient-safety-day/2019 (last access on 06 April 2020).
Huang FF, Shen XY, Chen XL, He LP, Huang SF, Li JX. Self-reported confidence in patient safety competencies among chinese nursing students: A multi-site cross-sectional survey. BMC Med Educ 2020;20:32.
Vaziri S, Fakouri F, Mirzaei M, Afsharian M, Azizi M, Arab-Zozani M. Prevalence of medical errors in iran: A systematic review and meta-analysis. BMC Health Serv Res 2019;19:622.
Sadat Z, Aboutalebi MS, Alavi NM. Quality of work life and its related factors: A survey of nurses. Trauma Monthly 2017;22.
Aghaei Hashjin A, Kringos DS, Manoochehri J, Ravaghi H, Klazinga NS. Implementation of patient safety and patient-centeredness strategies in iranian hospitals. Plos One 2014;9:e108831.
Babamohamadi H, Nemati RK, Nobahar M, Keighobady S, Ghazavi S, Izadi-Sabet F, et al
. Evaluation of patient safety indicators in Semnan city hospitals by using the patient safety friendly hospital initiative (PSFHI). Glob J Health Sci 2016;8:39161.
Najafpoor J, Broomandfar S, Zahiri M. Evaluation of patient safety indicators in ahvaz poblic hospitals based on World Health Organization's patient safety protocol. Health Manag 2014;5:47-58.
Ginsburg L, Castel E, Tregunno D, Norton PG. The H-PEPSS: An instrument to measure health professionals' perceptions of patient safety competence at entry into practice. BMJ Qual Saf 2012;21:676-84.
Taskiran G, Eskin Bacaksiz F, Harmanci Seren AK. Psychometric testing of the turkish version of the Health Professional Education in Patient Safety Survey: H-PEPSSTR. Nurse Educ Pract 2020;42:102640.
Huang FF, Song JH. An assessment of the reliability and factorial validity of the Chinese Version of the Health Professional Education in Patient Safety Survey (H-PEPSS). Front Psychol 2019;10:2183.
Mira JJ, Navarro IM, Guilabert M, Poblete R, Franco AL, Jimenez P, et al
. A Spanish-language patient safety questionnaire to measure medical and nursing students' attitudes and knowledge. Rev Panam Salud Public 2015;38:110-9.
Lee NJ, An JY, Song TM, Jang H, Park SY. Psychometric evaluation of a patient safety competency self-evaluation tool for nursing students. J Nurs Educ 2014;53:550-62.
Bressan V, Stevanin S, Bulfone G, Zanini A, Dante A, Palese A. Measuring patient safety knowledge and competences as perceived by nursing students: An italian validation study. Nurse Educ Pract 2016;16:209-16.
Bergs J, Peeters K, Kortleven I, Creemers S, Ulenaers D, Desmedt M, et al
. Translation and validation of the dutch version of the Health Professional Education in Patient Safety Survey amongst nursing students in Belgium: A psychometric analysis. Plos One 2021;16:e0247869.
Brislin RW. Back-translation for cross-cultural research. J Cross Cult Psychol 1970;1:185-216.
Polit DF, Beck CT. Nursing research: Principles and methods. Philadelphia, PA: Lippincott Williams & Wilkins; 2012.
Ebadi A, Zarshenas L, Rakhshan M, Zareiyan A, Sharifnia SH, Mojahedi M. Fundamentals of scale validation in health sciences. Tehran: Jame'e negar; 2016.
Lawshe CH. A quantity approach to content validity. Pers Psychol 1975;28:563-75.
Tavsancil E. Measuring Attitudes and Data Analysis with SPSS. 5th ed. Ankara. Turkey: Nobel Akademi Press; 2014.
Grove SK, Burns N, Gray J. The practice of nursing research: Appraisal, synthesis and generation of evidence. Elsevier Health Sciences; 2012.
Shi D, Lee T, Maydeu-Olivares A. Understanding the model size effect on SEM fit indices. Educ Psychol Meas 2019;79:310-34.
Trizano-Hermosilla I, Alvarado JM. Best alternatives to cronbach's alpha reliability in realistic conditions: Congeneric and asymmetrical measurements. Front Psychol 2016;7:769.
Colet PC, Cruz JP, Cruz CP, Al-Otaibi J, Qubeilat H, Alquwez N. Patient safety competence of nursing students in saudi arabia: A self-reported survey. Int J Health Sci (Qassim) 2015;9:418-26.
Hwang JI, Yoon TY, Jin HJ, Park Y, Park JY, Lee BJ. Patient safety competence for final-year health professional students: Perceptions of effectiveness of an interprofessional education course, J Inter Prof Care 2016;30:732738.
Torkaman M, Sabzi A, Farokhzadian J. The effect of patient safety education on undergraduate nursing students' patient safety competencies. Int Q Community Health Educ 2020;26:26-7.
Gleason KT, Commodore-Mensah Y, Wu AW, Kearns R, Pronovost P, Aboumatar H, et al
. Massive open online course (MOOC) learning builds capacity and improves competence for patient safety among global learners: A prospective cohort study. Nurse Educ Today 2021;104:104984.
[Figure 1], [Figure 2]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5], [Table 6]