| In group evaluation,due to individual differences in knowledge,experience,academic background and other aspects,as well as the complexity of the evaluation objects,there will be a large difference among different evaluation individuals,which will affect the evaluation results and lead to the problem of leverage effect.The so-called "leverage effect",that is,in the process of group evaluation,when there is a "fraud",the orientation deviation of partial evaluation units,evaluation ability is not stable,and many other factors,the possible distortion of a few individual assessment evaluation opinions "leveraging" the vast majority of normal evaluation opinions,so that the evaluation conclusion deviates from most people’s expectations and the actual situation of evaluation objects.In the existing researches,scholars mostly focus on the innovation and improvement of group evaluation methods and information integration methods,as well as the allocation and adjustment of weights,etc.,but seldom involve the problem of leverage effect in group evaluation.Therefore,this paper attempts to conduct a systematic study on the leverage effect,and forms a method system for the identification,measurement and treatment of leverage effect,to make up for the neglect of existing research on the leverage effect in group evaluation.Identification and measurement mechanism of leverage effect.Aiming at the identification problem of leverage effect in group evaluation,this paper adopts the idea of "whole first,then part" to form a complete identification and measurement mechanism of leverage effect.On the overall level,the recognition method based on individual judgment and evaluation conclusion is proposed respectively,and a leverage ratio index is constructed to directly measure the level of leverage effect.At the individual level,based on the idea of difference degree and anomaly degree,the corresponding identification and measurement methods are designed respectively from the two perspectives of the implementer and the carrier of the leverage effect.Finally,the feasibility of the above method is illustrated by an example.The mechanism of the leverage effect.In order to reduce or eliminate the negative impact of leverage effect on group evaluation,this paper proposes a processing mechanism based on data incommensurability and a processing mechanism based on individual weight allocation.Based on the data incommensurability processing mechanism,aiming at the leverage effect caused by the biased evaluation behavior and the non-biased evaluation behavior,this paper proposes the data processing method based on OWA operator and data standardization processing method respectively,to eliminate the data incommensurability problem and thus weaken the influence of leverage effect.Based on the processing mechanism of individual weight allocation,this paper firstly proposes the weight allocation method based on the stability of evaluation performance and the variable weight adjustment method based on the degree of individual difference respectively from the static perspective and according to the above two kinds of evaluation behaviors.Secondly,from a dynamic perspective,based on the improvement of multi-stage interactive feedback group evaluation method and the introduction of leverage ratio index,this paper proposes a weight allocation method based on multi-stage interactive feedback,and gradually eliminates the leverage effect in group evaluation through the adjustment of individual evaluation information.Finally,an example is given to show that the above methods can effectively control the negative effects of leverage under different conditions. |
