Research On Multidimensional Evaluation Indexes Of Academic Books From The Perspective Of Communication Process

Academic books are an important part of academic achievements,and their evaluation work occupies an indispensable and important position in academic evaluation.Scientifically and reasonably measuring the influence and value of academic books has both theoretical and practical significance.On the one hand,it can promote academic book evaluation and scientific measurement evaluation indicators in theory;on the other hand,in practice,it can not only provide a basis for scientific evaluation of the "representative works" of scientific researchers and their scientific research performance,but also help readers select high-quality academic books.However,compared with journal papers,academic book evaluation researches are less and scattered.The actual evaluation work is facing a severe dilemma.On the one hand,traditional measurement evaluation is poor in timeliness and the workload of peer evaluation is large;on the other hand,Altmetrics evaluation indicators are scattered,lack of systemicity,so it is necessary to integrate the existing available academic book evaluation indicators and construct a framework of multi-dimensional evaluation indicators for academic books,so as to provide theoretical support and practical reference for the smooth progress of academic book evaluation in the future.At the same time,the perspective of the communication process provides a new perspective for academic book evaluation,which is conducive to making the evaluation work run through the entire process of academic book influence and value generation,ensuring the comprehensiveness and comprehensiveness of the evaluation work,and helping to make up for academic book evaluation indicators.The deficiencies and shortcomings in research promote the research and practice of academic books.Based on the perspective of the communication process,this research selects appropriate indicators from the three dimensions of traditional measurement indicators,Altmetrics indicators and review indicators to construct a multi-dimensional evaluation indicator framework for academic books.First of all,sorting out the academic book evaluation theory,index selection principles,current available evaluation indexes and their source platforms.Secondly,based on the academic book exchange model in the traditional and network environment,the academic book exchange process is divided into four stages:pre-reading inquiry,acquisition,utilization and feedback,and an academic book exchange model is constructed.Thirdly,specific evaluation indicators are set for the four exchange stages of academic books according to the behavior characteristics of each stage.Finally,taking the four communication stages as the first-level indicators,and the main body behavior characteristics of each stage as the second-level indicators,construct a multi-dimensional evaluation index framework for academic books,and screen out the three-level indicators based on the availability of indicators to construct a multi-dimensional evaluation index framework for academic books in Chinese and foreign languages and clarify the method of assigning index weight.Due to the different sources of index data obtained at home and abroad,the empirical part selected Chinese and foreign academic books from the three disciplines of management,computer science and physics to test the applicability of the multi-dimensional evaluation index framework,and on this basis construct a multi-dimensional evaluation index system applicable to both Chinese and foreign academic books.Through empirical research,it is found that:(1)The multi-dimensional evaluation index framework for academic books under the perspective of the communication process is generally feasible and effective,and can comprehensively measure the influence and value of academic books;(2)There is a certain degree of consistency in the indicators of the four communication stages,the use of stage indicators has a greater impact on the multi-dimensional evaluation results;(3)There is a moderately weak correlation between the three-dimensional evaluation indicators,and the combination of them can reveal the influence and value of academic books more comprehensively;(4)There are obvious differences in multi-dimensional evaluation of books in different disciplines.It is confirmed that academic evaluation must follow the principle of classification evaluation,and it is necessary to assign different weights to evaluation indicators according to the discipline;(5)There are certain differences in the three-level indicators of multi-dimensional evaluation of Chinese and foreign academic books and their specific source platforms,but still under a unified evaluation framework.Chinese books lack the Altmetrics indicator integration platform,and the sources are relatively scattered.The multi-dimensional evaluation index system of academic books under the perspective of the communication process constructed in this study has the following characteristics:(1)The evaluation index setting is based on the academic book exchange process to ensure that the evaluation index can cover the entire process and all elements of the value and influence of academic books;(2)The evaluation indicators are more comprehensive and detailed,involving traditional measurement evaluation indicators,Altmetrics indicators and book review indicators,and the quantitative evaluation and qualitative evaluation(book review sentiment analysis)are combined in the evaluation process to ensure multi-dimensional and multi-level academic book evaluation indicators;(3)The indicator data source platform is diversified,including non-academic platforms,academic platforms and academic databases,and factors such as the authority of the platform,user activity,and indicator density are taken into account,has stronger scientificity and reliability;(4)The CRITIC method is used as an indicator weighting method,which avoids the influence of human factors on the evaluation results,and is easier to operate.It can also assign different weights to books in different disciplines,and conduct the evaluation of academic books in a more targeted manner;(5)Evaluation indicators distributed in different dimensions and communication stages have different value representations,and various evaluation indicators can be flexibly selected and combined according to different evaluation purposes of the evaluation activity,so as to better play the role of the "baton" of the evaluation purpose.However,due to conditions and time constraints,there are some shortcomings in the selection of foreign Altmetrics integrated tools and the mining of comment indicators,which are also the directions that can be continued in the follow-up research.