Design And Implementation Of Security-based Web Log Analysis System

With the rapid development of Internet Technology, we have entered the era of big data, various data showed a geometric growth. Web as the world's largest information system, the number of Web log is in rapid growth. As a record of the process of Web application tool, how to analyze the meaningful information from the Web log data, has become the concerns of academic, business and industry safety professions.At present, domestic and international research work of Web log analysis can be divided into three categories. The first category is mainly used for performance analysis of the Website, get the model of user's access. The second category is mainly used for analyzing and predicting the user's intention,analyzing the user's behavior according to data mining algorithm. So it can understand the consumer's preferences and habits in order to enhance and improve the Website service. So far this kind of analysis work has a good prospects in business, it become the focus of the most Web log analysis. The third category is a analysis based on security.The analysis will show the intrusion from the Web log and find out the source of the attack.This article belongs to the third category, by designing a security Web log analysis system, the administrator can not only discover intrusion behavior but also find the server's vulnerabilities, so that the administrator can take measure to prevent the servers. The key technology to realize this system is how to manage and process the different format Web log data,and how to make full and reliable description of aggressive behavior, and how to match method quickly and detect attacks accurately.Aiming at the demand of Website security,especially for the attack to government units, this paper design a security-based Web log analysis system.The system will put different format of the log data into the format database. It also can find out the behavior of attacking. The system can also help the administrator know more about their website so that they can take further protection measure.According to the characteristics of scale and heterogeneous format,this paper firstly put the different format log files into a same format database,make a full use of the logs data by design the log management module.Design and implementation log analysis module and feature library so that the system can find out the aggressive behavior through matching algorithm.Design user interface(UI),support the user to view and manage the system.