Design And Implementation Of Full Link Stress Testing System Based On Spark And B/S Architecture

With the rapid development of the Internet and the improvement of service quality requirements,stress testing has become an indispensable key step for large-scale events such as the “Double Eleven”.The traditional stress testing framework has been greatly challenged by the growing demand for stress testing of Internet services.At present,the industry has proposed a widely applicable pressure test concept,namely full-link stress testing.Full-link stress testing is a process that simulates the stress testing of the entire service chain by a large number of users in response to actual business requirements and scenarios.In order to carry out the full link stress test conveniently and quickly,the thesis designs and implements a full-link stress measurement system based on Spark and B/S architecture.A full investigation of the research and development of the full-link stress testing is introduced firstly,and then the needs of the user roles and basic functions of the system are analyzed.The system is divided into three modules: management console,stress testing engine and stress testing service plug-in.The management console provides the ability to manage the stress testing link and view the pressure report online.The stress measurement engine is a stress measurement calculation framework based on Spark Streaming real-time flow design,which is used to manage stress measurement task scheduling,stress control and stress measurement result calculation.The stress measurement service plug-in,which is connected to the pressure measurement engine,is used to manage a variety of stress measurement service methods,and the stress measurement service plug-in.The full-link stress measurement system initiates the stress testing engine to stress test the pressure measurement service through a management console,and visualizes the stress measurement results in the management console.At the same time,the new stress measurement service plug-in can be quickly added to the stress measurement system through the plug-in method of the stress measurement service,aiming to supporting more stress test service types.The management console system is based on B/S mode,using SpringBoot and Vue framework to realize micro-service and front-end separation to reduce system coupling and achieve good performance and scalability.The stress measurement engine and stress measurement service plug-in of the system are implemented based on the Spark framework,supporting real-time pressure measurement data calculation and storage,and plug-in management pressure measurement service.The full-link stress measurement system has been officially launched in the private cloud basic service of cloud platform in iQIYI.It is responsible for the daily measurement of several businesses and has achieved good reputation and user feedback.