Font Size: a A A

Applying The Many-facet Rasch Model To Evaluate College Students' Performance

Posted on:2012-04-04Degree:MasterType:Thesis
Country:ChinaCandidate:X Y HuangFull Text:PDF
GTID:2217330368479557Subject:Development and educational psychology
Abstract/Summary:PDF Full Text Request
Subject Ability Assessment plays an important role in school education in both for checking the learning conditions of students in former stage and promoting the follow-up study. But the current assessment of subject ability is simple in our country. The main forms taken by some colleges are paper-pencil text and open examination. Paper-pencil examination has many drawbacks, for example, students tend to be rote and half-heartedly which makes it hard to examine the higher level abilities of students and so on. Open examination can assessment students'higher level abilities, but there have no model answer which place difficult for score. It's not fair and precise give students score by one teacher.This paper began with the improvement of the evaluation method by using PowerPoint Assessment and concept mapping method to assess students'ability which pushed the students to the dominant position, aroused the students'activeness, initiative and creativity and encourage students apply the knowledge to analyze and solve problems independently. In the first research, the PowerPoint Assessment was used in "Multivariate Statistical Analysis" course for the students of junior. We used self-assessment and peer assessment of students to evaluate in the hope of the students finding the advantages and aspects to be improved in the comparison, improving the students'criticize thinking and more convincing to the results of assessment. The second research used concept mapping method to evaluate the Master of Education in the study of "Education and Psychological Statistics" course. The concept mapping method was proved to be a good assessment method which not only can assess the knowledge which the objectives test can measure, but also can evaluate the students' understanding of the correlation between knowledge and the whole context. On the presentation of the results, the concept mapping method not merely has a quantitative form, but also can be qualitative analysis.Secondly, the research used multi-rater score in order to overcome the subjectivity of one rater and the unscientific of using the original score as an indicator of student ability. Moreover, Many-facet Rasch model can also provide detailed information about the raters, student ability, standard for evaluation, rating scale and the interaction between the rater and each facet, which provide a reference for improving the test.This study reached the following conclusions:(1) The estimate of students'ability used in Many-facet Rasch model is latent trait value rather than the original score. The latent trait value is acquired by removed various errors which can represent the level of students'ability.(2) Using Many-facet Rasch model to assess subject ability can not only to examine the differences of severe degree between the raters, but also can analyze the degree of internal consistency within raters, the consistency degree of raters across subjects and cross items (standard for evaluation) and the interaction between the raters and subjects, raters and items, which can provide information to improve the test by analyzing the specific modalities of rater bias.(3) Many-facet Rasch model can also analyze the standard for evaluation and rating scale, provide the information on the difficulty of scoring criteria and the function of the rating scale. According with such information we can find out the rationality of the standard for evaluation and rating scale settings and how to improve it.(4) PPT peer assessment is a method suitable to assess students'ability which can stimulate students'interesting of learning, increase the interactive between teachers and students and student to student, as well as assess the higher level of students'ability.(5) Multi-rater (expert) to assess the concept mapping method is also very good way to assess student subject level. The analysis of Many-facet Rasch model showed that the raters conducted their score functions well and the the standard of evaluate and rating scale are function properly too.
Keywords/Search Tags:The Many-facet Rasch Model, Performance Assessment, Concept Map
PDF Full Text Request
Related items