Research On The Evaluation Of Academic Papers Influence Based On Altmetrics

As the most common information communication tool in scientific research communication,academic papers are also an important standard to measure the academic influence of relevant scientific research groups or individuals.It is very important to carry out a scientific and comprehensive evaluation of them.The traditional paper evaluation criteria system is based on the citation frequency of papers or the influence factors of published journals.However,with the rapid popularization of the Internet and social network,the rise of application and open access movement,online academic communication began to develop rapidly,and more and more users began to tend to share and use academic achievements on the Internet The traditional citation index can't reflect the influence of academic papers in online scientific research communication,and can't meet the relevant impact evaluation requirements.In recent years,with the development of Altmetrics and related research applications,it provides a new way to evaluate the influence of academic papers.This paper discusses the rationality and feasibility of using Altmetrics to evaluate the influence of academic papers by combing the relevant research,obtains the relevant Altmetrics indicators according to the principle of indicator selection,and classifies them into three different angles: social media communication degree,reader utilization degree and peer recognition degree according to the nature of the indicators.Then get the index data of the paper,and test the rationality of index classification by reliability and validity analysis,and calculate the comprehensive weight of each index by AHP-EWM,and build the paper influence evaluation model based on Altmetrics.Through the evaluation model,this paper analyzes the selected thesis from the research topic and the discipline field,understands the scores of different disciplines or research topics under different indicators,and then analyzes the correlation between the evaluation results and the traditional citation indicators to understand the similarities and differences between the two in the impact evaluation.Based on the empirical study of the evaluation model above,the following conclusions can be drawn: firstly,there is a positive correlation between the evaluation results of the papers based on the Altmetrics and the results of the traditional citation evaluation.Among them,the readers' utilization score and the cited frequency are strongly correlated,indicating that there is consistency between the two results and the application of Altmetrics indicators.The evaluation of article influence can make some supplement to the traditional evaluation results;secondly,although there are a lot of Altmetrics indicators,most of them have the problems of low coverage and lack of reference value;at the same time,some of the indicators of comment and recommendation type should not only examine the quantity,but also excavate and analyze the text content;thirdly There are some differences in the impact scores of different disciplines.The average of the cited frequency of individual disciplines is low,while the impact score of Altmetrics is high.Therefore,when evaluating papers of different disciplines,appropriate indicators should be selected for impact evaluation.In the follow-up research,it is necessary to further expand the scope of relevant research and promote the development of the discipline group of metrology.