An Exploration And Realization Of CAT With Cognitive Diagnosis

Since people are paying more and more attention to "cognitive bugs behavior" in study, Diagnostic testing based-on Item Response Theory (IRT) has been springing up increasingly, which combines cognitive psychology and teaching research with psychometrics to develop to form a new science. Nowadays, in domestic or abroad, the study on cognitive diagnosis is mainly applied to Paper and Pencil testing, which is rarely applied to computerized adaptive testing (CAT) . CAT with function of cognitive diagnosis has not gone public at home up to now. As a new testing mode, which is more scientific, efficient and accurate, to develop the application technique of cognitive diagnosis corresponding to CAT is in need urgently. Hence, this paper attempts to construct an initiatory CAT system for cognitive diagnosis.Generally, the choice of strategies for item selection depends on the function requirement of CAT. It's pivotal to design a feasible strategy of item selection in CAT for cognitive diagnosis. Using the strategy, CAT can carry on successfully and perform ability estimation and cognitive diagnosis simultaneously. With the help of the methods for " Diagnosis first, Ability estimation second ", knowledge states conversion maps is used to describe all the possible knowledge states in a domain of interest and the relationships among the knowledge states at the diagnosis stage, where a new strategy of item selection based-on the algorithm of Depth First Search is proposed. At the stage of accurate ability estimation, all the items tested by each examinee not only match his/her ability estimation value, but also are limited to those items whose attributes are mastered by the examinee.And this paper has performed Monte Carlo simulations to evaluate these three different structures of cognitive attributes and the results are favorable, and the rate of cognitive diagnosis accuracy has exceeded 80%. The creative points of this paper are:CAT with function of cognitive diagnosis has not gone public at home up to now. Some studies have been performed abroad, while Rule-Space Model and other methods are used in those studies. This paper studies and discusses CAT for cognitive...