The Design And Implementation Of Monitoring And Alarm System Based On Log Processing

With the rapid development of Internet,the business system is becoming more and more complex,and its availability also becomes more and more important.If the system failure is not timely detected and repaired,a big economic loss could happen.Now,many companies pay more attention to the monitoring of the core business system,to find the problems in the system operation and to timely make a rapid response.Especially,in the field of Internet Finance where business system is involved with fund settlement,availability and the details of settlement are very important.Once the system has problems,the situation is likely to be fatal.The process of system operation needs having a detailed logging,collection,processing and storage.If a problem of a module appears,we need timely to notify the operations engineer.In the actual environment,the engineers also want to know the development of business system and the situation of financial transactions every day,in order to guide the development of business.All the above requirements need a complete set of powerful monitoring and alarm system to support.At present,there are some monitoring and alarm systems which are open source,such as Ganglia and Nagios.However,they are the monitoring system of basic system level,which are rarely involved in the monitoring related to business.For specific business logic and field,they do not provide the comprehensive and friendly monitoring.If these systems are to be reused,they will have high complexity,poor scalability and availability.According to the area of Internet Financial,we design a set of monitoring and alarm system.The whole system is divided into two parts,which are monitoring and alarm.In the monitoring subsystem,the main method adopted is to collect log data of modules in the running process of the system,and then store data to MySQL.We use the statistical log data to demonstrate the development of business and monitor online program operation.At the same time,for web,mobile phone and other different clients,we provide a unified search service using REST API of Spring MVC.By analyzing log data stored in MySQL uninterruptedly using multi thread,when the monitoring and alarm system finds that the online system meets the alarm conditions of operator configuration,it will alarm the operators,and guides the operators to deal with online problems and thus guarantee the stable operation of the system.