Construction Of Evaluation Index System Of Virtual Simulation Experiment Teaching On Nursing

ObjectiveUsing the CIPP evaluation model(Context,Input,Process,and Product)as a theoretical guide,this study aims to construct an evaluation index system for nursing virtual simulation experimental teaching and clarify the weights of the indicators at all levels.The goal is to provide evidence-based support for a comprehensive,systematic,and objective evaluation of nursing virtual simulation experimental teaching,and to offer guidance for nursing educators and administrators to develop and enhance nursing virtual simulation experimental teaching.MethodsPart Ⅰ: Forming a pool of entries for the nursing virtual simulation experimental teaching evaluation index system.(1)Systematically review relevant literature on virtual simulation experimental teaching evaluation and the use of virtual simulation experimental teaching in nursing in both domestic and international medical fields.Integrate relevant evaluation theories,tools,and policy documents about virtual simulation experimental teaching to obtain evaluation indexes and form an initial framework for the evaluation index system of virtual simulation experimental teaching in nursing.(2)Conduct semi-structured interviews with teaching administrators,teachers,laboratory center personnel,and nursing students from undergraduate nursing colleges and universities that have carried out virtual simulation experimental teaching in China using purposive sampling method to understand the requirements for carrying out virtual simulation experimental teaching in nursing from different perspectives,and to analyze the incorporated indicators for the evaluation of virtual simulation experimental teaching in nursing,supplement and improve the indicator system framework obtained based on the literature review.Part Ⅱ: Construction of the nursing virtual simulation experimental teaching evaluation index system.(1)We plan to invite 23 experts to conduct Delphi expert consultation,organize,analyze and revise the evaluation index system according to expert opinions,and finally determine the evaluation index system for nursing virtual simulation experiment teaching.(2)Based on the mean importance assigned to each indicator by the experts,use the Analytic Hierarchy Process(AHP)to calculate the weights of indicators at all levels and to determine the final weight of each indicator in the index system.ResultsPart Ⅰ:(1)Guided by the four dimensions of CIPP evaluation model,we analyzed and summarized the results of literature research,and initially formed the evaluation index framework of nursing virtual simulation experiment teaching,including 11 first-level indicators and 25 second-level indicators.(2)We interviewed3 teaching managers,2 experimental center staff,4 teachers and 21 nursing students from 8 undergraduate nursing colleges in 7 provinces and cities in China.According to the results of semi-structured interviews,8 new secondary indicators were added,1secondary index was merged and 7 secondary indicators were modified.The item pool of nursing virtual simulation experiment teaching evaluation index system included 11 first-level indexes and 32 second-level indexes.Part Ⅱ:(1)We invited 22 experts from 17 universities and 2 tertiary hospitals in15 provinces and cities to conduct two rounds of expert consultation.The recovery rates of the two rounds of expert consultation were 95.65% and 100%,the authority coefficients were both 0.90,and the coordination coefficients were 0.120 and 0.209,respectively.Finally,the evaluation index system of nursing virtual simulation experiment teaching was formed,including 13 first-level indicators and 30 secondlevel indicators.(2)We used the analytic hierarchy process to determine the weight of indicators at all levels.The weight of the first-level indicators ranged from 0.025 to0.141,among which "N8 students’ participation in the process evaluation","N9teachers’ teaching evaluation",and "N10 students’ learning effect evaluation" had the highest weight coefficients(0.141,0.110,0.110).The weight coefficient of "N11teacher literacy related evaluation" was the lowest(0.025).The weight of secondary indicators ranged from 0.003 to 0.077.ConclusionsThis study used the CIPP evaluation model as a guide to construct a teaching evaluation index system throughout the whole process of nursing virtual simulation experimental teaching,which is scientific and reliable,and can provide reference for the teaching work of nursing colleges before,during and after the implementation of virtual simulation experimental teaching.In addition,the results of index weight at all levels show that the evaluation index system of nursing virtual simulation experiment teaching constructed in this study was consistent with the view of CIPP evaluation model that teaching evaluation should be for the purpose of improvement,and was consistent with the background of nursing virtual simulation experiment teaching in its infancy.It can provide a theoretical basis for the key content and direction of nursing virtual simulation experiment teaching evaluation in the future,and also provide a reference for the key content of nursing virtual simulation experiment teaching construction and implementation.