Design And Implementation Of Management System Of Big Data Platform For Banking Applications

In recent years,with more and more attention paid to the value of data,data has gradually become one of the core assets of banks.Therefore,the big data platform for big data storage and analysis has become one of the most important IT infrastructures of banks.The management systems of big data platforms provide the administrators of the platforms with the functions of system management,infrastructure management,log management,user management and so on.The management system plays an important role in giving full play to the application performance of the big data platform.However,with the deepening of big data applictions,it becomes difficult to meet the needs of big data applications of a specific industry by using the management system designed for the universal purposes,due to the proprietary requirements of the industry.In the banking scenario,banks have to pay more attention to the innovation of big data application under the pressure of the increasingly fierce competition.At the same time,as the big data platform becomes more and more complex,higher requirements on the lower complexity and higher convenience are put forward for the management of system.In this thesis,the management system of big data platform for banking applications is designed and implemented.This system introduces a method of collaboration between the big data system for production and the virtualization system for experiments.On the premise of not affecting the performance,stability and security of big data system for production,the requirements for constructing and managing the experimental environment of big data more conveniently are satisfied,as well as to support the demands of the innovation of banking big data applications.This system adopts the big data technologies to collect,aggregate,store and analyze the running data and the configuration information of big data platform's infrastructure and services,and then it assesses the running state of the platform and reports the exception to the administrators,which meets the requirement of the lightweight management of the big data platform.This thesis firstly introduces the research background of the subject.Then the requirements of the big data platform management system for the banking applications are analyzed by investigating the management system of big data platform in the industry and the application scenarios of the banking big data platform.Based on the requirement analysis,the architecture design of the management system and the design of each subsystem are proposed.Then the management system of big data platform is implemented and tested.The tests verified the effectiveness of the system.