Construction And Empirical Study On The Evaluation Index System Of Medical MOOC Construction Quality

Background: As a new type of digital resource,MOOC has become integral part to the implementation of the "Internet+ Education" strategy and to the sharing of high-quality educational resources.The Ministry of Education has put forward the guidelines for constructing and certifying online open courses,aimed to strengthen the quality inspection and evaluation of online courses.As for medical education,to meet the needs of new medical education reform in China,medical colleges are making and sourcing medical MOOC in large scales,by using online teaching methods to improve the quality of medical personnel training.However,the quality has always been the bottleneck restricting the development of MOOC.Given that the quality standards of MOOC in foreign countries are not applicable in China,yet the unified standard of MOOC has not yet been formulated in China.Literature review and investigation have reported four key problems of MOOC in China,namely,unidentified evaluation index,unstandardized evaluation criteria,tangled evaluation content and insufficient evaluation accuracy.To optimize the quality of medical MOOC,it is urgent to establish a set of standards and tools for evaluating construction quality of medical MOOC,by studying the quality factors of medical MOOC.Objectives: Aiming at the needs of education management department for the identification and quality supervision and evaluation of medical MOOC,according to the idea of classified evaluation and accurate evaluation,medical subjects are taken as the unit,this study focused on the two key issues of "what to evaluate" and "how to evaluate" in the quality evaluation of medical MOOC construction,studied the quality evaluation framework of medical MOOC construction,searched for the quality elements and quality characteristics of medical MOOC construction,and constructed the quality evaluation index of medical MOOC construction,which can provide resource specifications for the construction of medical MOOC in schools,provide tools and means for education management departments to carry out curriculum quality supervision,and provide applicable evaluation basis for Chinese medical MOOC learners to select and evaluate courses.Methods: According to the research paradigm of comprehensive evaluation method,following the research ideas of investigating the construction quality evaluation needs of medical MOOC,analyzing the construction quality elements,establishing the index pool and constructing the evaluation index system.Firstly,the literature analysis method was used to clarify the construction quality evaluation needs of medical MOOC,and analyze the three aspects of understanding the construction quality of MOOC at home and abroad,MOOC evaluation and medical MOOC evaluation under the background of medical curriculum reform.Based on the research status of three topics,the quality problems and the lack of evaluation methods in the construction of medical MOOC are clarified.Secondly,Survey method was used to investigate the expectation of 4235 learners on the construction quality of medical MOOC by using questionnaire.Combined with total quality management theory,quality function deployment theory and CIPP theory,the quality evaluation framework of medical MOOC construction is constructed by referring to European QRF quality framework and Chinese dual perspective curriculum evaluation model.Thirdly,the grounded theory research method is used to study the quality element model of medical MOOC construction.Under the guidance of grounded theory and QFD theory,this study investigated the real quality data of 1118 medical MOOCS in China,extracts the quality elements of medical MOOC construction including design dimension,teaching dimension and service dimension,and constructs the quality evaluation element model of medical MOOC construction.Fourthly,the quality evaluation index pool of medical MOOC construction was constructed by questionnaire survey and principal component analysis.On the basis of the European QRF quality framework,we absorbed the national requirements for curriculum construction and medical education reform,and identified four sources of quality evaluation indicators of medical MOOC construction.74209 quality evaluation indicators of medical MOOC construction were collected by4322 learners,651 MOOC designers,371 MOOC instructors and 332 MOOC servers.After correlation and principal component analysis,a total of 140 indicators were selected to evaluate the quality of MOOC construction.Fifthly,Delphi expert consultation method and AHP were used to construct the quality evaluation index system of medical MOOC construction.On the basis of compiling the index system,31 domestic experts in the fields of medical education,management,computer science and psychology were invited to adopt Delphi expert consultation method.After four rounds of consultation and revision,the authority of experts,the concentration of experts' opinions and the coordination coefficient of opinions were counted.The revision of the quality evaluation index system of medical MOOC construction was completed,and the AHP layer was adopted.The importance matrix was established by sub analysis method,and the weight of each index item was defined.Sixthly,the empirical research method was used to complete the empirical study of the construction quality evaluation index system of medical MOOC.16 experts and 7354 medical MOOC learners were selected to try out the index system for16 medical MOOCS of S Province and 65 medical MOOCS of Z region platform.Results: Through a three-year study,firstly,a structural model of medical MOOC construction quality elements is designed which includs 3 dimensions and 17 core factors,the model accurately reflects the quality elements of medical MOOC construction;Secondly,a quality evaluation index of medical MOOC construction is build,which includes 3 first-class indicators,13 second-class indicators,32 third-class indicators and109 index items,and is usful as a quantitative evaluation tool.Thirdly,a framework model of medical mooc construction quality evaluation is build,and form an evaluation method suitable for education management departments and learners.Innovative achievements have been achieved in three aspects: first,the quality evaluation index system of medical MOOC construction reflecting the characteristics of Chinese curriculum quality has been constructed.In order to break the conventional practice of designing general MOOC evaluation index system at home and abroad,the latest requirements of Chinese curriculum quality in three aspects of "golden curriculum","curriculum ideological and political education" and new medical education are integrated into the scale of evaluation index items,and 17 evaluation indexes of medical MOOC construction quality reflecting the special indexes of medical education are found.Secondly,the quality element model of MOOC construction is put forward.The quality element structure and quality characteristics of medical MOOC were constructed from three dimensions of design,teaching and service,which combined with the characteristics of medical MOOC,17 key elements of the quality of medical MOOC construction were proposed,such as curriculum objectives,MOOC positioning,medical education concept,medical teaching content,resource design,medical ethics,MOOC platform function,MOOC teaching staff,medical teaching methods,medical MOOC teaching activities Assessment and certification,learner service,learning situation analysis,resource update,platform operation and maintenance,security protection,humanistic care.Third,the quality evaluation framework of medical MOOC construction is put forward,a quality evaluation framework of medical MOOC construction is constructed,which is oriented to two kinds of evaluation subjects(roles),four evaluation links and three kinds of evaluation contents(data),and solves the problems of "what to evaluate" and "how to evaluate" in the identification and quality supervision of medical MOOC.Conclusion: Education,science,reliability and usability are the four key characteristics of MOOC construction quality.The quality evaluation of medical MOOC construction has urgent user needs.The purpose of evaluation is to assist the supervision of medical MOOC resources,standardize the construction and encourage the application.The main body of evaluation is education management department and learners.The quality elements of medical MOOC construction mainly include design quality,teaching quality and service quality,which are mainly reflected in curriculum objectives,MOOC positioning,medical education concept and medical teaching Content,resource design,medical ethics,MOOC platform function,MOOC teaching staff,medical teaching methods,medical MOOC teaching activities,assessment and certification,learner service,learning situation analysis,resource update,platform operation and maintenance,safety protection,humanistic care 17 key elements,among which medical education concept,medical teaching content,medical ethics,humanistic care are the unique elements of medical MOOC quality Special elements.The quality evaluation index system of medical MOOC construction mainly includes three first-class indexes,13 second-class indexes,32third-class indexes and 109 index items.Among them,teaching design ability,production equipment and tools,and presentation mode of teaching content are the core indexes of the quality evaluation of medical MOOC construction.The index system has good reliability and structural validity,which can effectively evaluate the construction quality of medical MOOC.