Multidimensional Data-driven Item Quality Analysis And Feedback Design For Assessing Primary Students' Chinese Reading Ability

This study combines the research of S-P chart evaluation theory,the Item Response Theory and the option analysis in the analysis of the examination paper quality.It attempts to do a more in-depth study on the quality analysis of examination paper,taking quality analysis of the items in online Chinese reading assessment system as an example,to explore the more objective measurement steps and evaluation methods,and to put forward the methods to improve the quality of the items according to the parameters analysis.It is expected to provide the educators and researchers with a solid and feasible evaluation method,to further improve the quality of the proposition and teaching evaluation,and to provide a theoretical basis for the future large-scale examination and the computer self-adaptive examination.This paper takes a primary school grade four students' online Chinese reading test paper of Wuhan as an example,using the quality analysis method,the correlation analysis method and the interview method.The quality analysis of test papers is analyzed by using the S-P chart evaluation theory and the Item Response Theory,and the application of software SPAlpha,Excel 2013,BILOG-MG 3,SPSS 22 and so on,Various numerical calculations and diagrams are drawn.First,the S-P chart evaluation method is used to evaluate and analyze the test from the characteristics of the curve and the quantitative evaluation index.Secondly,the three-parameter Logistic model of the Item Response Theory is used to give examples from the measurement attributes(difficulty,distinction,guess,etc.),the characteristic curve of the item,the information function of the item,the test information function and so on.The correlation analysis of quality parameters of items and behavior parameters(number of markers,number of questions,times of modification and time of answer and answer time etc.)is used to verify the quality of the items,and provide the basis for the proposition and improvement of the quality of the test questions.Finally,provide the method to locate unreasonable options of items and partial modification through analysis the item parameters and options.Both test theories showed that the quality of the examination was good and the difficulty of test questions was easy.A few items and options have certain defects in function:one item is too difficult,the degree of distinction is negative,the correct option and the wrong option can't correctly distinguish the subjects of high,medium and low ability,beyond the cognitive range of the grade four students,not to retain;the two items'attention coefficient are too large,all are judged to be class-D items,the wrong option presents the middle group answer ratio higher than the low group.Category characteristic curve appears to be inconsistent between the answer probability and the ability trend.In general,the S-P chart analysis method is easy to operate,the image is intuitionistic and the information is large.The relative strengths of the IRT lie in test information function,latent trait assumption,and parameter invariance and test equating.