Research And Implementation Of HBase Monitoring System

With the arrival of big data age,the rapid growth of data volume and the diversification of data have brought new challenges to data storage.Because of its high performance and high reliability,distributed database HBase becomes an important tool for storing data in massive data age.The normal operation of HBase database is an important guarantee to ensure the security of data storage.So designing a reasonable HBase monitoring system has an important practical significance.Basic performance monitoring enables managers to clearly observe the operation,operational trends,and performance bottlenecks of nodes across the cluster.Abnormal alarm can promptly remind managers to solve the problem,to minimize the loss,and for the rational use of the database to provide a reference.Aiming at actual production projects demand of a certain operators actual for HBase monitoring database,this paper introduces the solution that contains the performance monitoring and fault alarm function module.In this paper,a flexible and extensible monitoring agent is designed to collect HBase database performance information,server hardware information and network connectivity information.SSM architecture is used to design and monitor the server to perform data storage,abnormal alarm,statistical analysis and so on.The flexible database table is designed to store data,as well as the simple and clear monitoring display layer to show the latest operation of the database cluster and historical data.And according to the problems presented in the actual operation,the optimization program containing reduce SQL query,log optimization and retention of two-day historical data is proposed.In addition,based on the system operation,the paper studies the fault early-warning of the monitoring system based on the decision tree,puts forward the idea of using the decision tree in the business application of the fault warning and proposes an improved decision tree algorithm.Practice shows that the system can effectively monitor the status of HBase database,flexibly extend the monitoring index,issue the problem alarm in time,improve the working efficiency of the administrator,and ensure the smooth operation of the project.In addition,the fault warning based on decision tree is better than the manually set alarm conditions,and the improved decision tree can further improve the decision accuracy.