| Creativity refers to creation,production,edification,etc.The core of which is creative thinking.The concept of creativity widely recognized by the academic circles today includes two core characteristics: uniqueness or novelty(Originality or Novelty or Uniqueness)and practicality or applicability(appropriateness or usefulness),and creative thinking can be divided into divergence according to the direction of thinking development.Thinking(Divergent Thinking,DT)and Convergent Thinking(CT),among them,divergent thinking is the core of creative thinking.Corresponding to the two ways of thinking,researchers have developed many tasks to measure them separately.For example,for divergent thinking,the most classic is the Alternative Use Task(AUT).In addition,there are The Torrance Tests of Creative Thinking(TTCT),the University of Southern California test,the University of Chicago Creativity Test and other tasks;for aggregate thinking,the main measurement task is the most commonly used Remote Association Test(RAT).And insight problem-solving tasks,etc.Creative measurement tasks develop rapidly and gradually show the characteristics of multiple angles and diversity.After the measurement task is completed,a particularly important step is required: creativity evaluation.This evaluation process can determine which creative results are retained or discarded,promoted or eliminated,And creativity evaluation methods can be divided into subjective evaluation and objective evaluation.These two methods have their own advantages and disadvantages,but these methods all focus on the suitability of the evaluation method,and insufficient attention is paid to the accuracy and stability of the evaluation results.Therefore,this study will explore the influencing factors of creativity evaluation.The indicators to measure the results of creativity evaluation mainly include the evaluation criteria of the rater and the reliability of the rater,and these indicators have many influencing factors,mainly including the rater,the creative task,the environment,and so on.This study uses the answers to the AUT task as the evaluation material to explore the characteristics of the raters,especially the influence of knowledge,experience and the number of people on the two indicators of the creative evaluation results,and conduct a preliminary study on the stage and stability of these two indicators.Study 1 initially explores the differences in creative evaluation between psychological and non-psychological raters,and the trend of the rater’s reliability with the number of people.Each rater independently completes the unique evaluation of AUT’s answers to the four types of objects.,The score is a four-level score(1 represents completely not unique-4 represents very unique),and then analyzed the evaluation criteria and the reliability of the scorer,and found that in terms of evaluation criteria,non-psychological scorers and psychological scorers There are no significant differences,only significant differences between the types of materials are found,that is,the uniqueness score of newspaper materials is significantly lower than other materials,but in terms of rater reliability,the reliability of psychological raters is significantly higher than that of non-psychological raters To a certain extent,the scorer’s reliability and the level of knowledge and experience reflect the advantages,and if psychological scorers are used,the number of people required is less than that of non-psychological scorers.Study 2 carried out a Latin square design for the evaluation materials of study 1,strictly controlled the influence of the scoring order on the evaluation results,and deleted the studyal materials into three parts,and divided the evaluation process into three stages with the materials to explore The stability of the evaluation standard and the reliability of the scorer,the results found that there is no significant difference between the evaluation standard and the reliability of the scorer in the three stages,indicating that the evaluation standard and the reliability of the scorer are relatively stable.Study 3 further expands the number of knowledge and experience levels and the generalization of the results of study 1,introducing two types of raters,quasi-experts and experts,and mainly explores the impact of the number of raters,knowledge and experience,and the interaction of the two on creativity evaluation.The results found that in terms of evaluation criteria,quasi-experts are more relaxed than experts,and in terms of scorer reliability,the scorer reliability among quasi-experts is significantly higher than that of experts.The results of the interaction study show that if experts or quasi-experts are selected,at least two raters should be selected,and quasi-experts are good substitutes for experts.In summary,this study shows that:(1)In terms of the number of raters,if other characteristics of raters are not considered,at least 6 people are required to reach the reliability of qualified raters.As the number of people increases,raters believe The degree also gradually increases,until it finally tends to a stable value.And if you consider the level of knowledge and experience,the non-psychological graders need 7 people,the psychology professional graders need 5 people,and the quasi-experts and expert raters need only 2 people.(2)In terms of the knowledge and experience of raters,there is no significant difference in the scoring standards of non-psychological professional raters and psychology professional raters,but in terms of the scorer reliability,psychology professional raters are significantly higher than non-psychological professional raters.The comparison of professional graders,quasi-experts and experts shows that the scoring standards of quasi-experts are looser than that of experts,and the scorer reliability of quasi-experts is significantly higher than that of experts,and quasi-experts are good substitutes for experts.(3)In terms of the stage of creative evaluation results,the evaluation criteria and the scorer’s reliability are very stable indicators and will not change with the extension of the task time. |
PDF Full Text Request