Research And Implementation Of Test Case Prioritization Based Testing Evaluation System

To improve the efficiency and accuracy of software testing, many test case prioritization techniques have been proposed. All these techniques have the same goal: to improve the defect detecting ability. There are two categories of such techniques: The first one is based on the static/dynamic analysis of the program. It aims at improving the code coverage. The second one takes the source of the software defects in the regression-code modification into consideration and proposes a code comparation based test case prioritization method. Both of these two kinds of techniques assume that the software defects are evenly distributed in the software and have no difference, which results that the test case prioritization can not reflect the relationship between test cases and the software defects while wasting much time comparing different versions of software code. This is conflict to the initive of test case prioritization. In a word, both these two kinds of techniques are code-oriented without considering the individuality of test cases.Another problem with current mainstream test case prioritization techniques is that there is no quantitative evaluation method, which can evaluate the testing effect of these techniques. This has been a big obstacle when testers are trying comparing different test case prioritization techniques. Also it makes the effort to finding a best test case prioritization impossible. The main contribution of this paper is as follows:First, it changes the traditional code-oriented research direction. We proposed test case oriented method, which widens the research view.Second, it proposed a test case prioritization integration method, providing a way to integrate different weak test case prioritizations into a stronger one. This method makes the prioritization approach the optimal one possible. At the same time, it can also make the integration of the software developer's opinions of test case prioritization possible.Third, the evaluation method presented and implemented in this paper can quantitatively evaluate the test case prioritization based on the test case priority and the test resource assigned to each test case.The method and system presented in this paper is used in the actual industrial software development project. The result shows that the method described in the paper achieves a higher efficiency and accuracy.