Research On The Construction Of Quality Evaluation Index System Of Intelligent Pre-diagnosis System Based On User Perspective

BackgroundThere is a shortage of medical resources in China,but medical waste phenomena such as minor illnesses to see a doctor,oversizing of small prescriptions are very serious.According to the estimates of the relevant departments,the waste of medical resources in China accounts for more than 30%of the total medical expenses,and that of serious areas can reach 40%-50%.One of the root causes of medical resources waste is that patients lack basic medical knowledge,and they cannot directly make an objective estimate of their condition before visiting the hospital.When they visit the doctor,they cannot talk to the doctor about the severity of the disease.The advent of intelligent pre-diagnosis systems made it possible for patients to make basic medical judgment before attending a doctor.However,domestic m-health services are still in the development stage.The quality of m-health applications is uneven,and there is a lack of evaluation of m-health applications in the industry.At present,there are some related studies evaluating the accuracy of intelligent pre-diagnosis systems in foreign countries.However,the accuracy of domestic intelligent pre-diagnosis systems is still unknown.Only the relevant satisfaction survey results are reported in the quality evaluation,and the quality of intelligent pre-diagnosis systems is also lack of relevant systematic research.Therefore,to establish a set of indicators to evaluate the quality of intelligent pre-diagnosis system using existing theories,which is to better assess the quality of service of domestic intelligent pre-diagnosis system,has become the focus of our exploration project.ObjectiveFrom the user's point of view,we develop a set of indicators to evaluate the quality of intelligent pre-diagnosis system,which provide technical support for the improvement and evaluation of intelligent pre-diagnosis system in the future,and provide reference for the quality evaluation of m-health services.MethodsBased on the traditional medical service quality evaluation theory and Technology Acceptance Model theory,we establish the quality evaluation index system of intelligent pre-diagnosis system using Delphi method,and weighting the indicators using the Analytic Hierarchy Process.Contents(1)To develop a theoretical model for intelligent pre-diagnosis system quality evaluation.On the basis of traditional medical service quality evaluation theory and technology acceptance Model theory,a theoretical model for quality assessment of intelligent pre-diagnosis system is proposed.(2)To establish an intelligent pre-diagnosis system quality evaluation index system.Through multiple rounds of Delphi expert consultations,the initially established index system is continuously revised and improved,and the quality evaluation index system of the intelligent pre-diagnosis system is finally established.(3)To weight the indicators of the intelligent pre-diagnosis system quality evaluation index system.We use the analytic hierarchy process to weight the established indicators at all levels,and finally establish a complete set of intelligent pre-diagnosis system quality evaluation index system.Results(1)Based on the "structure-process-result" theory and technology acceptance model,this study constructed an intelligent pre-diagnosis system quality evalution model,and believed that the quality of intelligent pre-diagnosis system mainly depends on its usefulness,ease of use,and accuracy.(2)In this study,21 experts were invited to participate in the questionnaire consultation and a total of three rounds were conducted.The active coefficients of the experts for each round questionnaire were 1.00,0.95 and 0.90,respectively,and each coefficient as high.The arithmetic mean of expert judgment coefficient(Ca),familiarity(Cs),and authority coefficient(Cr)are all higher than 0.7,and the standard deviations are 0.11,0.11,and 0.10,respectively.Based on the above indicators,the authority of the experts invited by this study is high.(3)After two rounds of Delphi expert consultations,the intelligent pre-diagnosis system index system was finally established,which includes 3 first-level indicators and 11 second-level indicators.After two rounds consultations,the expert opinions of indicators were relatively concentrated,the Kendall coefficient of whole indicators(W=0.398)and each level(level one W=0.496,level two W=0.364)are all significant?so the evaluation Index system is reasonable.(4)Consistency tests were performed on the expert's judgment matrix,whose consistency ratios were should within the acceptable range at CR<0.1.The judgment matrix all passed the consistency test.(5)Overall ranking of the quality evaluation index system of intelligent pre-diagnosis system:First-level indicators were ranked as pre-diagnosis results(0.5962),interaction performance(0.2266),and pre-diagnosis use value(0.1772);second-level indicators were ranked as pre-diagnosis results Accuracy(0.3234),Popularity of pre-diagnosis protocol(0.1752),triage guidance(0.0997),Comprehensiveness of pre-diagnosis protocol(0.0976),Symptom list(0.0670),Language expression(0.0651),Disease knowledge(0.0499),Interview time(0.0408),response ability(0.0344),additional services(0.0275),interface design(0.0194).Conclusion(1)After two rounds index system of Delphi consultation,we developed an index system for quality evaluation of intelligent pre-diagnosis systems.The first-level 3 indicators are system interactive performance,pre-diagnosis results and use value;the second-level 11 indicators are symptom list,interface design,language expression,inquiry time,response ability,pre-diagnosis results accuracy,Popularity of pre-diagnosis protocol,Comprehensiveness of pre-diagnosis protocol,disease knowledge,triage guidance and additional services.(2)From the results of the third round of indicator weight consultation,we can see that as a pre-diagnosis system,its core quality lies in the pre-diagnosis results with a weight of 0.5962;followed by the interactive performance with a weight of 0.2266;and last with the use value,whose weight is 0.1772.(3)In this study,the ease of use ability,accuracy and usefulness as a breakthrough point of the evaluation intelligent pre-diagnosis system.As a result,the Kendall coordination coefficient of whole indicators and each level are all significant?so the evaluation index system is reasonable.