Design And Implementation Of Aultomated Reliability Testing Tool For Server Modules

As the world’s largest Chinese search engine, Baidu provides a wealth of Web search services which also includes image search service. Millions of people use Baidu to search images every day. If the image search server is out of running a large number of people will be affected and will cause the reduction in advertising revenue. Two out of six image search server modules will be updated per week on average. Rapid updating increases the risk of image search service. Before updating, it is necessary to monitor the error probability and the performance deterioration trend of software at certain pressure condition. Therefore, the development of module-level reliability automated testing tool is very important on reducing the product’s risk and improving the efficiency of testing.The paper presents the design and implementation of reliability automated testing tool for server modules. The automated tool can provide a strong support for the module-level reliability testing. Requirements are extracted from the known process of reliability testing, relative meetings and users’ needs. The tool includes four functional modules which are data preparation module, stress testing module, diff rate statistics module and test cases. In addition to the stress testing, fuzz test and diff rate statistics are added to the module-level reliability automated testing tool as a supplement. In the design and implementation of the system, the work finished by the author independently as follows:(1) Data preparation module includes data recording tool and data fuzz tool. Data recording tool can record data on the communication between the server modules. Data fuzz tool has functions like fuzz data in a structured way, fuzz data based on the range and fuzz data according to customized way.(2) Stress testing module includes module automatic update tool, module pressing tool and system environment simulation tool. This module achieved the goal that update the tested module automatically and perform reliability testing at the specified pressure. Add system environment simulation into the test to assess the reliability of the module under different environmental.(3) Diff rate statistics module implements functions that record the returned data of the same request in the single-threaded and multi-threaded scene; find and analyze the diff among the returned data. Test engineers could find and fix bugs with the help of detailed information provided by diff rate statistics tool. The detailed information includes the request which make the diff happened, the frequency of the same diff and the name of the diff section(4) Design the automated test cases of module-level automated reliability testing. Test cases will execute automatically when the test begins which will simulate various scenarios that may occur in the actual operation to monitor the performance in these scenarios.Currently, the automated reliability testing tool for server modules has been used in the testing process of product updates. Test engineers found and fixed some problems existing in the system with the help of the tool. Sub-tools that have different functions are also used to assist in the completion of other testing.