Design And Implementation Of A Multi-stage Tuning Middleware System Management And Allocation Algorithms

Optimization technology of system performance is applied to various fields of the science research and national economy.Actually,the optimization of software performance lags behind greatly the hardware technology development.System optimization and resource allocation algorithm are being increasingly attached importance to by computer scientists. With the promotion of commercial propelling force,the modern service develops rapidly.The success of lnternet-based applications depends in part on the ability of network servers to respond in a timely and reliable manner to simultaneous service requests.New challenge has been brought to the Web service developer in the aspect of performance.To consider the optimization problem in the design stage of the system, the development cycle and cost will be reduced greatly.A performance optimization framework is presented for the service developer and the burden of the developer is alleviated.The system is constructed entirely in pure Java .A new model for handling the massive concurrency requests has been described in detail.The application is divided into several stages in the framework.The whole system performance bottleneck is analyzed by fixing out which stage load is too heavy to work well.Then, the optimal thread pool size is determined analytically and the event queue is adjusted with algorithm of resource allocation. Several control-based mechanisms for automatic tuning and load conditioning of busy Internet services in the system design are introduced, including thread pool sizing, event batching, and queue-based admission control for overload management.By dividing the application into several stage , it is easy to find performance bottleneck;By performing admission control on each event queue and thread pool, the service can be well-conditioned to load, preventing resources from being overcommitted when demand exceeds service capacity;By employing dynamic control to tune runtime parameters automatically, workload can be managed well;By advanced efficient feedback mechanisms, the state of system can be shown in real-time.In order to mask the difference in the underlying operating system,a module named LMSF is elaborated ,which refers to the design concept of ESB.Finally, an Internet services platform,called CSOpti Web server based on the architecture was developmented.The performance of CSOpti is evaluated through several test suite. The CSOpti server shortens the Response time and improves the concurrency capacity of system. It proves that the framework yields high performance and robust behavior under heavy load.Separating the business logic of the application from the resource control is the main characteristic of the platform.The robustness and compatibility of the re-development for complex services is improved with an effective design approach.It has very good scientific research value and bright application prospect.During the development of the project, The author participated in the system architecture design in the first several months and then implemented the system management module with pure java.The design of resource allocation algorithm presents good performance.The system test work was done by the whole team members.