Research On Evaluation Index System Of Traditional Chinese Medicine Consortium Standards Based On Modified Delphi And Precedence Chart

Objective:The published Traditional Chinese Medicine(TCM)consortium standards were searched systematically and analyzed by the method of bibliometrics.With the help of specific data,the development status of TCM consortium standards was accurately understood and the problems in the development of TCM consortium standards were analyzed.Aimed at getting over the existing problems in the development of TCM consortium standards,the evaluation index system of TCM consortium standards was explored to serve the supervision of TCM consortium standards and promote the improvement of the development quality of TCM consortium standards.Methods:Search published TCM consortium standards on the official websites of National Consortium standard Information Platform,China Association of Chinese Medicine,China Information Association of Traditional Chinese Medicine,China Association of Traditional Chinese Medicine,China Association for Acupuncture and Moxibustion,etc.Extract information such as standard number,standard name,release group,release time and so on.Based on the subject classification of TCM,the retrieved published TCM consortium standards were divided into Chinese herbal medicine consortium standards,Chinese Medicine consortium standards,acupuncture or massage consortium standards,information consortium standards and other consortium standards.Excel was used to conduct descriptive statistical analysis of the data from the perspectives of release year,release group,release number,release standard classification,standard crossover,and production and revision.The quantitative indexes analyzed included the total number of standards and the number of classification standards,the number of annual releases,standard age,clinical guidelines and expert consensus,the number of department distribution,the number of guideline standards using the names of Western and Chinese diseases,the number of consortium standard issuing institutions and the number of group standards issued.The ratio index includes standard aging rate,standard revision rate and standard crossover rate.According to the analysis results,the problems existing in the development of TCM consortium standards are summarized.Team established,based on the purpose of build consortium standard supervision of Traditional Chinese Medicine and promote the development of TCM consortium standards of quality improvement consortium standard evaluation index system of Chinese medicine,combined with the problems in the development of Chinese medicine consortium standards found in the bibliometric analysis of Chinese medicine consortium standards,and established the construction principles of the evaluation index system.The research team systematically searched relevant literatures of standard evaluation,supplemented corresponding evaluation indexes based on existing problems of TCM consortium standards,extracted evaluation indexes of TCM clinical practice guidelines with higher levels from the perspective of standard evaluation,and formed a set of standard evaluation indexes.Experts with experience in standard evaluation were selected to form a draft evaluation index system of TCM consortium standards based on index sets via expert meeting.The Modified Delphi was used to consult experts on the draft evaluation index system of TCM consortium standard in the form of semi-open questionnaire.Likert 5-level scoring method was adopted to let experts evaluate the importance,familiarity,judgment basis and influence degree of each index,and feedback relevant opinions and suggestions.Select experts who have some experience in the field of traditional Chinese medicine and standardization and are interested in research.The evaluation index system was optimized based on the statistical analysis results of questionnaires and experts’ opinions and suggestions.Statistical indicators include mean(X),maximum value(Max),minimum value(Min),quartile,standard deviation(SD),coefficient of variation(CV)and full score ratio(Ki)to reflect the concentration and consistency of experts’ opinions.Indicators meeting the three conditions of mean(X)<4 points,full score ratio(Ki)<0.8 and CV>0.25 are deleted directly.Indicators that do not meet the deletion conditions are decided according to experts’opinions and the evaluation results of the research group.For reserved indicators,the follow-up rounds of questionnaire consultation should present the expert opinions and suggestions of the previous round of expert questionnaire to the experts as well as the statistical results of the importance score of indicators in the previous round of questionnaire.After the experts’ opinions tended to be concentrated,the researchers summarized the research results and formed the final evaluation index system of TCM consortium standard.Statistical analysis of questionnaire data,using Microsoft Excel software statistical analysis of experts’ research direction and education level,professional title and working years,age distribution and other expert background information,experts’ positive degree(questionnaire recovery rate),authority degree related indicators and full score ratio(Ki);SPSSAU web edition Data Science Algorithm platform tool(address:https://spssau.com)was used for descriptive analysis of mean(X),maximum value(Max),minimum value(Min),quartile,standard deviation(SD),coefficient of variation(CV)and other indicators.Based on the expert’s importance score of the index,the index weight was calculated by using the Precedence Chart.The principle of the Precedence Chart to calculate the weight is to compare the mean value of importance score of a group of indicators in pairs.The one with the highest score is recorded as 1,the one with the lowest score is recorded as 0,and the one with the same score is recorded as 0.5,so as to form a weight calculation table.Sum the weight calculation table of each row to get the relative score(TTL value)of each indicator.To obtain the weight of each indicator,divide the TTL value of each indicator by the sum of its TTL value.Results:As of December 31,2020,a total of 1,765 TCM consortium standard have been retrieved from 29 groups.There are 913 items of Chinese medicine,633 items of Traditional Chinese medicine,97 items of acupuncture and massage,115 items of information and 7 items of other standards,The standard mean age was 4.35 years(0-14 years).The standard aging rate was 27.31%(482/1765);The standard revision rate was 5.72%(101/1765).The standard crossover rate was 3.57%.Based on "goal oriented,generality,systematic,operability,qualitative quantitative combination" of traditional Chinese medicine consortium standard evaluation index system construction principles,exploratory built to serve the consortium standard"regulation" to promote community development for the purpose of high quality standard of traditional Chinese medicine of traditional Chinese medicine consortium standard tertiary evaluation index system,The evaluation indexes include 5 first-level indexes,12 second-level indexes and 27 third-level indexes,including formulation subject,text preparation,technical content,popularization and application,and implementation benefit.The weight of the main body of the formulation is 0.08,the weight of the text compilation is 0.24,the weight of the technical content is 0.36,the weight of the promotion and application is 0.24,and the weight of the implementation benefit is 0.08.Conclusion:With the gradual attention paid to TCM consortium standard,the number of standards issued and the number of issuing institutions has gradually increased,and the scope of standards has gradually expanded.However,there are problems such as standards crossover,poor access channels,untimely revision,and uneven quality of standards.Generally speaking,the evaluation of TCM consortium standard starts from three aspects:the formulation subject,the standard itself and the feedback of application effect,and comprehensively reflects the quality level of TCM group standards through the indirect indicators in the three dimensions of formulation subject,promotion and application and implementation benefit and the direct indicators in the two dimensions of text preparation and technical content.Among the evaluation indexes of TCM consortium standard,technical content is the most important index,followed by text writing,promotion and application,and the weight of formulation subject and implementation benefit is relatively low.