Design And Implementation Of A Data Analysis System

With the rapid development of the Internet industry and iteration, different systems will accumulate a large number of user behavior data, the consequent problem is, common storage system can not effectively analyze the processing of complex data, provides services for the upper layer. Now need to run a large number of data processing, the system in different departments and different kinds of data into the same system based on the same and has the same data structure with end user logic data, which will be useful for the information value of precipitation data, provides data analysis services for the upper decision and the management of Internet Co, after a time in this process, as the company level tasks, therefore, the problems related to data analysis, derived from many related projects.For all sorts of problems in the process of data analysis, improve the system’s usability, efficiency and maintainability, in the daily production environment, developers often will continue to improve the function and requirement of data analysis system, there are many problems can not be avoided in the process of system analysis. Such as the analysis tool or platform and scattered, difficult to manage data visualization is insufficient, lack of aid, lack of appropriate data analysis model and has high development cost.This paper presents a easily provide users with data integration and aggregation computation, data visualization and analysis, data monitoring, data output service data analysis platform. The task scheduling system based on distributed process communication, through the heartbeat mechanism to maintain the main tasks and sub tasks, ensure the large amount of parallel computing tasks, using object oriented method, the interface of the module, greatly reduce the coupling of the system, and improve the stability of the system. This paper gives a detailed analysis of the system’s functional requirements and non functional requirements, the overall system architecture, function, database, security, and other aspects of the interface and the interface design for the specific business platform system, the detailed design and Realization of sub module, for each module of the system was tested, and the display areas in need of improvement suggestions on the function, for potential problems are summarized and the prospect analysis system.At present, the system has become the most widely used in the data analysis platform, service in various product lines, play the role of the value of the data.