The Evaluation Methodology Of Program Analysis Tool Based On Benchmark Suite

With the rising demand for software quality, as an important complement to the dynamic detection techniques, static analysis techniques have become a research hotspot in recent years. And as a result many static analysis tools come out. However, there is lack of a widely accepted method to evaluate these tools. So this paper proposed an method to for static analysis tools evaluation Based on Benchmark Suite. Main tasks are as follows:1 Summarize the static analysis techniques and tools present.2 Summarize the research of Benchmark for static analysis tools and discuss the trend of it.3 Propose principles for selection of Benchmark database for static analysis tool and constructed the initial Benchmark database containing more than 1,000 tiny cases and 51 large cases according to the principles.4 Propose some evaluation metrics for static analysis tools.5 Design the process for evaluation of static analysis tools. Design and implement Benchmark Suite components for evaluation of static analysis tools, making the evaluation of static analysis tools become highly automated, and has good graphical interface.6 Evaluate four static analysis tools with test cases of six types of bugs. Give an assessment about the functionality, time and space cost of the four tools.