| BACKGROUNDWith the development of medical technology, the content of medical teaching is added, but the number of class is fixed. Although the period of study in school to medical student is longer than other students, it can't catch the needs of medical education. With the increasing size of college enrollment, medical teaching resources are scared. So, it is important to improve teaching method to help the student to master the knowledge in a short time.Online teaching resource library is a teaching collection of a variety of media information and knowledge systems which based on curriculum requirements. E-learning resource library materials in general, including the media library (text, graphics, images, audio, video, animation, models, etc.), teaching materials and library (multi-media teaching materials, television teaching materials, web materials), case library, test database and so on. Online teaching resource library is the basic teaching of academic professional website information base.As the online learning resource base have a series of advantages, the Ministry of Health Science and Technology Department of Education organized a medical teaching material production project in March 2005. The project constructed by the People's Health Publishing House is responsible for the concrete implementation plan invested more than 200 million yuan. The project is divided into more than 50 sub-projects, a total of more than 20 medical schools and more than 80 professors involved in the development of various projects. So far the project has been successfully completed. However, while the number of building resource pool is large,there are still a lot of problems through accesses to information, the main deficiencies come from the following aspects:First, the utilization rate of resources is low and the teaching objectives are not clear; second, there are no unified technical specifications and standards for storing resources. Although the state has promulgated the teaching resource library CELTS series of standards, due to various reasons, some resources can't be shared; Third, some builders emphasis on quantity rather than the contents of the library quality. So it is lead to that a lot of Resource Library have been build upon, but they had not been modified, and its contents are often unable to update; Forth, the "information isolated island"phenomenon is seriously, and the library retrieval system is "fragmented" repeated construction phenomenon is serious, all of these cause a large number of waste of human and material resources;Fifth, the collect channel is too small, if people want to look at some special resources, they need to produce their own or buy it, which makes a comprehensive resource library of content is difficult to promote; Sixth, a resource audit and evaluation practices are still very far from perfect. There does not have a practical, workable evaluation methods or procedures currently.In order to make medical teaching resource library for more effective audit and evaluation, we will look into this large group of users accept the asperts'evaluations.OBJECTIVE1. The study is to establish a "medical teaching resource library user evaluation" selection criterion, and make the good "medical teaching resource bank" to be the most extensive promotion and application.2. The study is to establish a "medical teaching resource library user evaluation"system, and evaluate the teaching resources which are being built on or have been built. It can give some proposals and improve the quality of library construction.OBJCTS AND METHODSIn this study, expert survey method (Delphi method) is used. Under normal circumstances, the accuracy of results of the consultation and participation as a function of the number of consultations, within certain range accuracy increases while the number rising, when the number nearly 15, the accuracy of the outcome is very limited. Some studies believe that the selected expert is generally no more than 50 people. After comprehensive consideration, this study selected 22 experts. The expert selection criteria as follows:Bachelor degree or above, more than 10 years of professional work experience.The questionnaire consists of 66 entries formed by the literature review and expert interviews, which including references to the National Information Technology Standardization (CELTS-41.1) and the criterion of Modern Educational Technology of Guangdong Province, "151 Project"professional resource library construction norms and combined with modern medical profession the characteristics of the formation of a user evaluation of medical education resource library. After 3 rounds of expert consultations, we collected the advices and analysed the data, then carried out the screening of indicators.We also used the analytic hierarchy process (AHP) to determine the weight of indicators at all levels and establish "medical evaluation of teaching resources and library users "table.At last we conducted the reliability and validity of the evaluation form.We selected 10 teachers who are familiar with "Medical teaching resources".And then sent out questionnaires to them.The questionare includes four aspects.Such as the contents of the resource base, layout structure, services and subjective satisfaction. Convenience sampling method was used to select 220 medical students and ask them to evaluate the teaching resource library. Evaluation forms were released by the researchers, and with a week to recover.Descriptive statistics was used to analyze demographic constitution of experts.Mean and coefficient of variance was used to describe the experts'opinion of the importance of the item; and coefficient of Kendall's W, percentage of questionnaire received and the authority degree of experts were used to examine the reliability and representation of expert consultation.In the process of inspect the questionnaire's reliability and validity, the internal consistency of questionnaire was examined by calculating Cronbach alpha;construct validity was evaluated by factor analysis and correlation analysis.The data was analyzed by using Excel 2003 Version and SPSS13.0 statistical software.RESULTS1. The reliability and representation of the expert consultationSelection of experts is the key to the success of Delphi method. The experts of this study are from Shanghai, Guangzhou, Nanjing, Shenzhen, Qingdao, Xi'an, Harbin, Jilin, eight cities in 13 colleges and universities, and their majors are educational technology and medical education. The total number of expert is 22,10 of them are male.All the experts are at the age of 35～62 (46.9±8.2); their work experience years are between 10～40 (24.9±9.6); the number of education technology experts is 13 and medical education is 9; professors or senior engineers is 14, associate professor is 7, lecturer is 1, Ph. D.is 7, master's degree is 8, undergraduate is 7.The reliability of the consultation outcome depends on the enthusiasm, level of authority and the degree of experts' coordination. The recovery rate indicated the positive coefficient of experts. The recovery rates of three rounds of surveys were 80%,75% and 95%. Pundits coefficients were higher than 0.8. The general experts believe that Cr≥0.70 as acceptable reliability.Above all, the expert forecast is based on practical experience and theoretical foundations. The coordination factor is 0.302 of the third round of experts' consultation, statistical test P<0.001, with statistical significance, indicating the coordination of expert advice is good, desirable results.2. Screening evaluation index system and establish levels of index weightThe importance of alternative indicators of the degree measurement method based on Likert 5 points (Likert5-scale) which is divided into five levels.In the study, we choose indicators by three factonthe levels of importance is greater than 3.5, the coefficient of variation as the selection criteria is lower than 0.25 and the choice rate is greater than 70%.Analytic Hierarchy Process (AHP) is used to determine the first level indexs'weight, using the relative importance of evaluation method, using high and low scores to determine Saaty scale, and construct the structure comparison matrix, and then tested its logical consistency. The results showed that in the indicator system, the indicators are meet the logical consistency requirements.Expert scoring method is used to detemine the weight of the second indexes. Probability theory was used to calculate the multiplication of indicators at all levels.The weights of first level indexes are as follows:resource content is 0.5478, layout design is 0.2404, application service is 0.1472 and user satisfaction is 0.0646.The dimension of the indicator system designed by all experts.3. The reliability and validity testing of the "Medical teaching resource library user evaluation index system"The "Medical teaching resource library user evaluation. form"was devided to two copies respectively for teachers and students. The Cronbach a coefficient of the teachers' form is 0.894 and the students' form is 0.932.Both of them have high reliability degree. It indicates that the evaluation of entries have good internal consistency between indexes.The content validity of the index system is good.Using factor analysis, four factors were extracted, the cumulative contribution rate is 56.816%, factor analysis results match the basic structure and the questionnaire has good validity.CONCLUSIONThe research consulting 22 experts in medical education and educational technology areas. Also, the "medical student evaluation of teaching resources database table"for reliability and validity is tested.It also give a good analysis of the meaning of evaluation form build.1. The initial establishment of the medical teaching resource library user evaluation index systemThe index system mainly includes four aspects:content, layout design, services, subjective satisfaction. The establishment of evaluation system contributes to the construction and development of medical teaching resource library.2. Initially verified the "medical teaching resource library user evaluation index system"Using expert survey method and analytic hierarchy process to establish the medical teaching resource library user evaluation index system and determine the weight coefficient of all levels of indexes.Expert survey method and AHP method ensured the scientific objectivity and accuracy of the research results. The measured surveys to teachers and students made the system reasonable and feasible.3. The significance of establishment of "Medical teaching resource library user evaluation index system"With the development of educational technology, many institutions recognize the importance and usefulness of the network. More and more teaching resources library were established, but its evaluation index set has not been reported.The "Medical teaching resource library user evaluation index system" based on the user's point of view. As the whole resource pool is a product, needs its biggest customers-students and teachers to assess their value, so that construction can improve the resource library quality. The whole meaning of the establishment of evaluation index system is mainly manifested in:(1) The content of the evaluation of resources, enabling building a database of information collected during the early that have an outline, can put the most useful information to the resource library. It takes an instructive role for the construction of the entire resource library. (2) For the resource base which has been completed, the use of the evaluation index system also can evaluate the resource base and find the inadequate of the construction.It can promote the medical resource base integrity of the building and normative. (3)It can enhance the professional courses and the integration of educational technology to achieve the perfect combination of cross-disciplinary, complementary. (4) It can contribute to the medical teaching resource library trends and reform program guide.
|
PDF Full Text Request