The Cross-cultural Adaptation And Psychometric Assessments Of Nursing Simulation Teaching Evaluation Tool—CCEI

Objective:According to the cross-cultural adaptation,item analysis,reliability and validity test analysis of the Creighton Competency Evaluation Instrument(CCEI),to explore the applicability of Chinese revised version of CCEI in the domestic nursing simulation teaching,and provide a comprehensive and reliable evaluation tool for teaching evaluation.Methods:After obtaining the consent of the Creighton University research group,we got the original English version CCEI and the related literature and information.Refer to the "Guidelines for the process of cross-cultural adaptation of self report measures",take "translation—synthesis—back—translation—expert committee review—pretesting—formed preliminary version" approach,on the CCEI was cross-cultural adaptation.At the same time,combined with the actual situation,two rounds of expert consultation was included.In our university,The convenience sampling method was used to evaluate the teaching situation of 612 students in 2 grades(grade 2012,grade 2013),which was composed of 120 groups.SPSS 17.0 and AMOS 21.0 were used for data entry and statistical analysis to test the items,reliability and validity.Results:1.Cross-cultural adaptation The Chinese revised version of CCEI has 4 fators and 23 items,including assessent 3items,communication 5 items,clinical judgment 9 items and patient safety 6 items.It uses the Likert-5 scale,the higher the score,the stronger the ability to show.2.Item analysis By using 5 different statistical method to test 23 items:descriptive statistics index finds that item discrimination of item 3 is low;item difficulty coefficient shows item difficulty is a little small;comparison of extreme groups shows each item has a good discrimination.The other two methods——items total correlation tests each item has significant correlation with its factor(P<0.001),the value is far more than 0.3;and the result of factor loading judgment can be acceptable,all is bigger than 0.71.This shows that most of the items are ideal,some of the item difficulty and discrimination should be improved in the future.3.Validity Content validity and construct validity are used to test its validity.(1)Content validity:after strict translation process,8 experts in different fields joined in the consultation.I-CVI are between 0.875 and 1,S-CVI is 0.984.(2)Construct validity: using two methods,one is the correlation coefficient,the correlation coefficient between each dimension is between0.245 and 0.589,the correlation coefficient between each dimension and the total score is ranged from 0.661 to 0.871(P<0.01).And the second is confirmatory factor analysis,2cis293.78,df is 224,2c/df is 1.312,GFI is 0.858,AGFI is 0.838,NFI is 0.912,NNFI is 0.962,CFI is 0.966,RMSEA is 0.052,and all the fitting indexs have reached the standard.The above shows that better structure validity of Chinese revised version of CCEI.4.Reliability The reliability of the revised Chinese version of CCEI is tested by the Cronbach's alpha coefficient and the inter-rater reliability of two raters.The overall Cronbach's alpha is0.937,and the dimensions of Cronbach's alpha is ranged from 0.847 to 0.951,and the inter-rater reliability is 0.882(P<0.01).The tool has good reliability.Conclusion:1.The Chinese revised version of CCEI has good reliability,validity and item analysis results,can adapt to domestic nursing simulation teaching evaluation,and measure the team simulation performance of undergraduate nursing student accurately and fastly.2.Item discrimination and difficulty of some items,the overall reliability and validity,and the implementation of simulation evaluation can still be improved.Multisite studies are suggested,large sample sizes in more than one geographic location will provide valid data for reliability and validity statistics for the Chinese version of CCEI,moving simulation science forward.