Design And Implementation Of Distributed Database Test Load Generator

As the amount of data that enterprises need to store continues to grow,and in order to meet different needs,various new types of databases have emerged: such as Not Only SQL(No SQL)with flexible data structures.This requires the testing tool to be able to test the performance of a variety of databases.In the database performance test tool,whether the load generator module is implemented well or not determines whether the test tool can generate the load specified by the user.However,the existing load generator implementations still cannot fully meet the actual needs: for example,the design of the partial load generator is only for a certain type of database.Therefore,it is of great significance to design a load generator that supports multi-node deployment and is aimed at a variety of distributed database management systems.By analyzing the existing load generators,a load generator design for the test of a homogeneous database management system is given.The load generator is divided into two parts: scheduling node and execution node.The scheduling node simulates the pressure characteristics of the real database by controlling load parameters,random number distribution,load mode,etc.;supports controlling the scale of the test end and deploying the test end node to generate large Scale load;collect transaction execution results,calculate throughput and other performance test outputs,and evaluate the performance of the tested database.The execution node is controlled by the scheduling node to generate a load that meets certain characteristics,and communicates with different database management systems under test through the database driver and different database interfaces,sends the load and executes the performance test.In order to obtain the operating information of the load generator,the scheduling node supports the monitoring of the load generator,including the status monitoring of each node,log records,and load monitoring of each execution node.Experimental verification of the realized load generator.On the one hand,the load generator is used to perform TPC-C performance testing;on the other hand,the load generator is used to interface with existing performance testing tools to perform performance comparison tests on My SQL and Mongo DB database clusters.Experiments in these two aspects show that the load generator can be applied to a variety of distributed isomorphic database management systems,and supports the prediction,deployment,feedback and dynamic expansion of the number of test nodes.