The Design And Realization Of Log Analysis System Based On Data Mining Algorithms

With the rapid development of data collection and storage technology recently,lots of application fields accumulated large amount of data. Data mining technology,combining with database,statistics and machine learning methods,is utilized to find the valuable knowledge and rules from these data.Clustering analysis technology is the classical part in data mining and is an important tool in many research areas.This dissertation systematically, deeply, roundly and detailedly studies and analyses the data mining technique, especially clustering analysis.The main contents are listed as follows:(1)Description in brief of the data mining technique.This paper introduces the basic concept,classes, main functions,key technique and typical applications.(2)Description in brief of clustering analysis.The paper analyses the clustering methods and the representative clustering algorithms,puts forward the typical requests of clustering and compares the common clustering algorithm,so that people can easily find a clustering method that suits a special problem.(3) Appliance of clustering analysis technique. According to problems encountered in practical development, I designed some logs analysis systems. This dissertation makes detailed analyses and discussions on structures, function designing, module dividing and realization of this system, and sets forth some functions which were already realized. Through analyzing the logs of applications by the use of this system, developers can quickly discern the exception, improve the maintenance efficiency and reduce the cost, as well as discern the module which characterized with frequent exception, and modify logic process in program by utilizing logs analysis system.