Research On The Impact Evaluation Of Papers From The Perspective Of Altmetrics

In scientific research,academic paper is the most common and practical type of academic achievements.Academic paper is not only a tool for academic communication,but also has the property of information transmission.It is an important part of measuring the influence of individual and research group's academic achievements.In the 21 st century,with the development of science and technology and the change of academic communication mode,how to conduct scientific,comprehensive and fair evaluation of academic papers has gradually become a hot issue of academic circles.In the early evaluation system of academic achievements,the citation frequency of academic papers and the impact factor of journals have become the core indexes of the traditional evaluation system of academic papers because of their accessibility and intuitiveness.With the development of the Internet,the way of academic communication and the carrier of information in the Web2.0 environment have changed.More and more users are keen to share and discuss academic achievements on the Internet,and these academic achievements have an increasing influence in the social field.At that time,scholars realized that the traditional evaluation system based on citation indicators could no longer meet the evaluation requirements of academic achievements' influence,and began to think about how to include the influence generated in the network environment into the evaluation system of academic papers.The proposal of Altmetrics provided new ideas for scholars.By reading and sorting out relevant literature,this paper discusses the feasibility of using Altmetrics to evaluate the influence of academic papers in view of the existing problems in the evaluation of the influence of academic papers.First of all,Altmetrics indexes are screened preliminarily according to index coverage,and then the indexes are classified and stratified through correlation analysis and principal component analysis.TF-IDF algorithm is adopted in weight calculation method,and finally a paper influence evaluation model based on Altmetrics is built.After the construction of the evaluation model,the paper scores in three dimensions to observe the differences in the research topic and different disciplines,and conduct empirical analysis on the relationship between the evaluation results and traditional citation indicators,and the relationship between the evaluation results and open access.According to the empirical research based on the evaluation model of Altmetrics,this paper draws the following conclusions: First,there are a large number of Altmetrics platforms and evaluation indicators,but the coverage of indicators is low.The weight of some indicators cannot be simply determined by the number of references,and more attention should be paid to the attributes and values of the indicators themselves.Second,there are differences in the research topics of high-scoring papers under the three dimensions,and different disciplines have different responses to the Altmetrics evaluation model.Therefore,evaluation indexes should be selected according to the specific characteristics of the discipline in which the paper is evaluated.Third,the evaluation results of paper influence based on Altmetrics are positively correlated with the traditional citation frequency to a certain extent.It can be considered that the evaluation system of Altmetrics is a good supplement to the traditional citation evaluation system,in which the audience utilization dimension has the highest correlation with citation frequency and AUC value.Therefore,the index under this dimension can accurately predict the probability of literatures being marked as highly cited papers.Fourthly,under the Altmetrics evaluation system,whether the open access of the paper has little influence on high-quality papers,and whether the paper can get higher scores in the Altmetrics evaluation system mainly depends on the quality of the paper itself.In the follow-up research,it is necessary to further expand the selection range of journals and conduct deeper research.