Design And Implementation Of Monitor And Management System For The Massive Data Analysis Platform

With the development of computer technology,computing power has become indispensable to our life.Faced with increasing of demand in computing resource,traditional mainframes or supercomputers has been unable to meet the needs of modern industry.So it is necessary to make a study of computational resource management and allocation way,with which the cloud computing came into being.Based on the distributed system,cloud computing centralize computing resources,while providing massive computing power and large data storage capacity.Cloud computing can also provide a flexible resource management and allocation.According to the needs of business,make dynamic adjustment of computing power,which squeezing machine resources.Due to the characteristics of distributed and centralized management of cloud computing platform,it is an important issue to monitor and control the cloud computing platform.In particular,PaaS platform not only provides the underlying computing resources,but also has a complex application executive ability,which needs higher standard for the monitoring and management of platform.This page is mainly based on project named "the massive data analysis platform based on cloud computing".The goal is to provide effective operation and maintenance management tools for the platform.The main work involved in this paper is:1)According to the characteristics of the mass data analysis platform based on cloud computing,make design and implementation of monitoring and management functions.And collect the information of data processing applications running on platform.2)Based on the monitoring function of the cluster node and using the existing data analysis algorithm of the platform,achieve the analysis of the performance of the distributed cluster.3)Research and analyse a variety of log management method,to get a log management method suit large amount of data analysis platform.4)Design and implementation of the cluster task management tool for platform operation and maintenance.