Establishment And Application Of Quality Evaluation System For Reports Of Childhood Immunization Information System In Yunnan Province

Objectives:To study and establish an index system suitable for evaluating the quality of CIIS reports in Yunnan Province,to provide a basis for scientific and objective evaluation of CIIS report quality,and to lay a theoretical foundation for improving report quality.Methods:Through the literature research method,determine the establishment principle of the evaluation system,form an alternative index database;establish the basic framework of the evaluation system through expert interviews;use the Delphi method to construct the CIIS report quality evaluation system in Yunnan Province;use the analytic hierarchy process to determine each The weights and combination weights of the indicators;the reliability and validity of the evaluation system are tested by mathematical statistics.Results:1.The principles for the establishment of the evaluation system are:scientific,representative,operability,quantitative and qualitative combination,and dynamic.2.The preliminary framework of the evaluation system is:3 first-level indicators,10 second-level indicators,and 28 third-level indicators.3.After two rounds of Delphi expert consultation,the expert positive coefficient is greater than 0.95,the authoritative coefficient is higher than 0.7,and the coordination coefficient W is greater than 0.4.4.The establishment of the Yunnan Provincial CIIS Report Quality Evaluation System consists of three first-level indicators:integrity,timeliness,and accuracy;12 secondary indicators are:basic information integrity rate,basic information integrity Rate,child case reporting rate,vaccination unit upload rate,case upload success rate,vaccination unit upload time rate,case upload time rate,heavy card rate,information sampling compliance rate,basic information modification rate,vaccination information modification rate,estimated empty card rate The 26 three-level indicators are:basic information integrity rate≥90%,basic information integrity rate<90%,vaccination information integrity rate≥ 90%,vaccination information integrity rate<90%,child case reporting rate≥90%,children Case report rate<90%,vaccination unit upload rate≥90%,vaccination unit upload rate<90%,case upload success rate≥90%,case upload success rate<90%,vaccination unit upload time rate>50%,case upload Timely rate>50%,case uploading time rate<50%,no heavy truck,heavy card rate ≤1‰,heavy card rate>1‰,information sampling compliance rate≥90%,information sampling compliance rate<90%,basic letter Modification rate(?)10%Basic information editing of>10%,modification rate information vaccination<5%inoculation rate information modification>5%,no empty card,an empty card rate(?)10%empty card of>10%.5.The weight coefficients of the three first-level indicators are 0.297,0.164,and 0.539,respectively,and all judgment matrices have passed the consistency test;6.The reliability test results of the evaluation system are good,the Cronbach coefficient α=0.624,the structural validity test extracts 3 common factors,the cumulative variance contribution rate is greater than 70%,and the three common factors evaluation fields and systems are three levels.The content of the indicator is more consistent.7.According to the application results of the evaluation system,the quality of CIIS report in Yunnan Province in 2018 was significantly higher than that in 2016 and 2017.The difference was statistically significant(P=0.005,0.013).The basic information integrity rate and vaccination information of CIIS report in Yunnan Province in 2018 The quality of the complete rate and heavy card rate report was higher than that of 2016,and the difference was statistically significant(P=0.012,0.025,0.038),and the application results were consistent with the actual work.Conclusions:Based on the principles of scientificity,representativeness,operability,quantitative and qualitative combination,and dynamics,this study established the Yunnan CIIS report quality evaluation system,including three first-level indicators,12 second-level indicators,and 26 third-level indicators.The indicators determine the weights and combination weights of the indicators at all levels;the evaluation system passes the test of reliability and validity,the Cronbach coefficient α=0.624,and the structural validity test extracts 3 common factors,and the cumulative variance contribution rate is greater than 70%.The evaluation system is credible and effective;in 2018,the quality of CIIS report in Yunnan Province is higher than 2016 and 2017;in 2018,the basic information integrity rate,vaccination information integrity rate and heavy card rate report quality of CIIS report in Yunnan Province are significantly better than 2016.