Evaluation Of The Academic Influence Of Highly Cited Papers Based On Citation Diversity

With the continuous deepening of scientific research,academic achievements emerge one after another.How to evaluate academic achievement,especially academic papers comprehensively and fairly is an important demand for researchers and scientific research management.For a long time,people often evaluate the academic influence of the paper simply by using the cited number of papers as the evaluation index.The cited frequency index is easy to obtain and easy to compare,but this simple and crude method neglects a lot of factors worth considering.Citation frequency treats the importance of each citation of a paper as equivalent.But in fact,when the cited frequency is the same,the citation of other properties of the literature may differ greatly in the specific circumstances.There are limitations to treating the importance of each citation as equivalent.Therefore this paper puts forward a kind of academic influence evaluation system based on the diversity of citing behavior,from five perspectives,such as the citing authors,citing academic institutions,citing countries,citing journals and citing Web of Science.The diversity,richness and evenness of the distribution of the citing behavior were analyzed.Then calculating the index of comprehensive diversity of the citing authors,the comprehensive diversity index of the citing institutions,the index of the comprehensive diversity of the nationalities,the comprehensive diversity of the citing journals index and citing comprehensive index of diversity of Web of Science categories.Finally,the principal factor analysis was used to extract the main factors,and the comprehensive citation diversity evaluation results of the highly cited papers were obtained.In this paper,100 highly cited papers in the field of space science are taken as an example,and the academic influence of authors,institutions,countries,journals and Web of Science categories are analyzed based on the citation diversity.It is found that some papers may have the same cited times,but the distribution of their citing authors,institutions,countries,journals and Web of Science categories are different,so the evaluation from all angles is meaningful and can not be replaced by each other.Therefore,we can not directly think that the papers which have the same cited times also have the same academic influence.This is also demonstrated by the consistency check of cited times-based sorting results and the citation diversity-based sorting results in the example.The empirical results show that the evaluation system based on citation diversity can well distinguish the documents with the same or similar cited times,which can be used as a good complement to the citation frequency index.