Research On Academic Influence Evaluation Based On Contribution Weighted Citation

Paper evaluation has always been an important research content in the field of bibliometrics.In recent years,the number of academic papers has been increasing dramatically.How to effectively evaluate academic papers has become a key problem.Academic evaluation is often of great significance in evaluating scientific research performance and allocating academic resources.Through more detailed and comprehensive evaluation indicators,it is beneficial for improving the academic capacity of scientific researchers in our country and recommending excellent talents for some maj or scientific research programs.At present,the evaluation indicators that are more concerned,such as peer review,impact factor and citation count,have many limitations,ignoring the attention to the paper itself.Citation count cannot fully and accurately describe the scientific influence of publications,and the so-called scientific influence is not just as what we see from the surface.Therefore,it is very necessary and important to study the evaluation indicator of a single academic paper.This paper aims to propose a new influence measure,Contribution-Weighted Citation(C WC)indicator,which weights each citation from the perspective of the citing articles.This weighting method is mainly based on the ranking of the citations of articles published in the same year and the same field,and modifies the value of one citation from each paper negatively or positively.In addition,the idea of iteration is introduced into the calculation process to obtain more accurate results.Secondly,on the basis of the above,a parameter is introduced to adjust the value of citation contribution,so as to measure the role of the CWC indicator in evaluating the scientific influence of one paper.In the traditional concept,one citation from any paper is regarded as having a citation value of one,and the received citation values are accumulated to reflect the scientific influence of one paper.In this method,the value of one citation from one citing item can be larger than or less than 1.At the same time,we can adjust the value of citation contribution through a correction parameter to meet different evaluation needs.Finally,this paper further explores the practical significance of the CWC indicator.Due to the mutual influence between the scientific influence of journals and of papers,journal evaluation is also an evaluation content that has attracted much attention in recent years.By replacing the citation count with the CWC indicator,the Journal Impact Factor(JIF)and H index can be recalculated,which provides a more accurate method for journal evaluation.We empirically analyzed 3847243 papers in WoS database from 1978 to 2017,including the fields of mathematics,physics and space science.The experimental results indicate that the three patterns of the new indicator proposed in this paper show different characteristics in identifying the scientific influence of one article.Our new indicator in sinusoidal mode makes the scientific influences of articles more discrete,which helps to distinguish papers with similar citation counts,while the indicator in anti-sinusoidal mode is more helpful to identify papers with high citation quality.In addition,we find that the average citation quality of low-citation papers fluctuates greatly,but in some cases the citation quality of some low-citation papers is surprisingly high;for highly cited papers,the average citation quality is stabilized in a certain range.This paper plays a positive role in identifying important publications and insufficiently cited publications.After introducing a parameter into the weighting algorithm,it is found that the control of the parameter can adjust the distance in the CWC indicator between papers.With the increase of the parameter,the gap in the CWC indicator between papers is gradually increasing.The selection of the parameter will also affect the order of ranking,and larger parameter value is very valuable for identifying undercited and over-cited papers.In terms of journal evaluation,the contribution-weighted journal indicators are more sensitive for physics and space science,and less sensitive for mathematics.The journal indicators optimized by contribution weighting are more beneficial for reflecting the real scientific influence of journals.The study discusses the feasibility of the CWC indicator from the aspects of theory and practice.At the theoretical level,it expands the relevant theoretical research domain of single-paper evaluation and journal evaluation,which provides a theoretical basis for the achievement evaluation of scientific researchers.In addition,at the practical level,based on a large number of data,the study has deeply practiced the evaluation indicators proposed in this paper,which is helpful to test the applicability and feasibility of the indicators,and then in favour of the estimate and dissemination of excellent achievements.