| ObjectiveTo assess the evaluation system for the projects supported by the National Natural Science Foundation of China ( NSFC) , we adopted projects on gastric cancer as examples. According to bibliometric method, proportion of published articles of each project to those in related research was calculated. The number, quality and implication of the articles were compared and analyzed before and after the projects were supported. The effect of peer review of the NSFC was eval-uated. We provided bases and references for the evaluation system of NSFC to improve.MethodsThe procedures of our research were as follows: First, selecting subjects. From projects on life science supporeted by NSFC from 1990 to 2001, we selected 52 items (including 51 general items and 1 major item) in which titles " gastric cancer" were contained. Second, collecting data. We retrived articles on stomach neoplasms published by Chinese organizations, papers of the projects and their related articles in CBM, MEDLINE and SCI from 1985 to 2003. The citations of the projects articles were searched in SCI and CSCD. The admission by MEDLINE, SCI, CSCD, CSTPC of the projects papers were investigated. Third, analyzing data statistically. We analyzed the proportion of signature frequencies of the projects authors to those of all authors in CBM. The proportions of papers signatrued organizations that the projects came from to the total number of papers were calculated. The proportions of projects articles to related articles were calculated. The numbers of project articles published before and after thesupportion were counted. In terms of publication for each project's articles, a score was yielded (integrated score of publication, citation and registration) in an " Evalution System for Scientific Research Achivement" that was created by Xiaoning Wang. The difference between the publication scores for total projects before and after the obtaining of supportion (1-3 years ,4-6 years, 7 years or more after supportion) was analyzed and tested statistically.ResultsThe projects' members accouted for 78.61% of all the authors of high frequency. The total frequency of projects'members was up to 18.79% of all the authors in CBM. The projects' organizations accouted for 70.58% of the top organizations ranked by the number of articles published. The top seven organizations were all among the projects' organizations. The proportion of the papers of the projects' organizations to that of the total organizations was 20. 99%. The numbers of articles published by the projects' members increased with time. For each project, its articles displayed various proportion to their related articles, and the average proportion was 25. 65 %. The numbers of papers published by the projects' members for 1-3 years, 4-6 years after obtaining supportion were more than those before supportion. The publication scores for all the years, 1 -6 years ,1-3 years ,4-6 years after obtaining supportion were all higher than those before supportion, i. e. , the publication and implication of articles after supportion raised distinctly.ConclusionsThrough the bibliometric reseach, we found that the proportion of the frequency of projects' members and papers of projects' organization to all in China was high. The publication and implication of articles after supportion were better than before. The supportion of NSFC strongly facilitated the increase of quantity and quality of the achievements for the projects supported. NSFC's peer - review evaluating system produced good performance. The innovation of our studies liesin: We take the lead in evaluation the performance of peer review system of NS-FC, assessing the bibliometric indexes of research projects according to the periods of executing years, using article - publication score based on journal impact factor in evaluating NSFC projects, and time - scale of the example projects which ensured the adequacy and reliability of the study results.
|
PDF Full Text Request