Comprehensive Comparative Study Of Academic Journal Evaluation Methods

Academic journals are tools for scientific scholars to conduct academic exchanges and are records of scientific progress.Evaluating academic journals is of great significance of promoting academic fairness.For the quantitative evaluation of academic journals,there are two main methods:the single-indicator evaluation method and the multi-index comprehensive evaluation method.The former uses the bibliometric indicators,such as Journal Impact Factor(IF),Eigenfactor Score(EF),SJR and other indicators to compare the journals.The latter uses multiple indicators to conduct comprehensive evaluation of journals.This method can avoid the one-sidedness of single-indicator evaluation methods.However,as pointed out by scholars the evaluation process is relatively complex,which applying the multi-index comprehensive evaluation methods to evaluate journals,involving the selection of bibliometric indicators,data normalization processing,and evaluation methods.In this research area,oversea and domestic researchers have made a lot of empirical research.However,faced with a variety of comprehensive evaluation results,the academic community have proposed a "combination evaluation" method to comprehensively utilize the results of different evaluation methods.This article uses the journals in the Economics and Business areas of the Essential Science Indicators(ESI)and uses the peer review journals FT 50 as the evaluation basis to evaluate various journal evaluation methods and selects the most effective evaluation methods.The article found that h-index was the most effective evaluation method and showed that the journal evaluation method was not that the more complex the evaluation methods,the more effective.This article is divided into six chapters.The research content of each chapter is as follows:The first chapter talks about the research background of this article and elaborates the purpose and significance of the research.The research content and research methods are introduced,and the innovative points of the research are clearly explained.The second chapter introduces the theoretical foundation of journal evaluation and the related literature review.Quantitative evaluation of journals is closely related to the selection of literature databases,specific subject areas,and the evaluation methods.In addition,this chapter introduces two types of methods for evaluating journals in detail:qualitative evaluation and quantitative evaluation.The third chapter discusses the single-indicator evaluation.Eight bibliometric indicators from different databases were used to evaluate the journals,and the advantages and disadvantages of the indicators were briefly reviewed.Then the peer review journals FT 50 were used as the evaluation basis to find out the most effective single-indicator evaluation.The fourth chapter elaborates the multi-index comprehensive evaluation of the journal,such as,the methods of entropy-weighted Method,grey correlation method,factor analysis.Then the peer review journals FT 50 were used as the evaluation basis to find out the most effective multi-index evaluation method.The fifth chapter aims at the combination evaluation method.In order to comprehensively utilize the results of different comprehensive evaluation methods,the combined evaluation method was used to apply different combination evaluation methods.Then the FT 50 publication was used as the evaluation basis,and the most effective evaluation method of journals was selected.The sixth chapter makes a summary of this article.The main research work and innovation points of this paper are summarized.In addition,based on the analysis of the deficiencies in this paper,the future research directions of the journal evaluation are pointed out.The innovations in this paper are:(1)Using peer reviewed journals list FT 50 publications as evaluation criteria,evaluating various journal evaluation methods to find out the most effective journal evaluation methods.The research shows that the H index is more effective against the field of Economics and Business areas;(2)This paper used the journal classification method of the Essential Science Indicators(ESI)and does not adopting the Web of Science or Scopus subject classification.The main reason is that the journal in the latter's journal classification could belong to multiple disciplines;(3)The journals were evaluated with combining the evaluation results of multiple comprehensive evaluation methods.