The Design And Implementation Of Coverage Analysis Module Based On TCT Test Suite

With the software testing became more important in software development process, more manpower and material resources need to put into the development of test suite. So people pay more attention on the coverage analysis which could judge and verify the quality of a test suite. A good automation coverage analysis could save a lot of resources for QA department. Test development engineer could verify the test cases and make progress based on the coverage analysis results.Tizen is an open-source operating system which developed by Samsung and INTEL, it could run on mobile phone and multiple devices. TCT (Tizen Compliance Tests) is a test suite for Tizen compliance verification, it contains large amount of test cases. Test developers always write test cases by reading the specification, but these test cases may have duplicated or missed test points, the developers need a module to help them to verify the test cases. To solve this problem, coverage analysis module named Spec Coverage is developed with Python, PhantomJS and XML technologies. This module could analyze the test suite automatically and locally, and supply precise and visual results for developers.This thesis’s main work includes:1) Tizen Compliance Tests test program is introduced and Testharness test framework, PhantomJS and related technologies is analyzed.2) Requirements of Spec Coverage module is analyzed based on the architecture, context and execution process of Tizen Compliance Tests test suite, then the preliminary design and detailed design of this module is worked out.3) Spec Coverage coverage analysis module which included XML-Cov sub-module, Visual-Cov sub-module, process control sub-module and config file reader sub-module is implemented. Multiple error return mechanism is used by Spec Coverage module to avoid the problems of the test framework. And also Spec Coverage module is verified based on the TCT test suite.