Research And Implementation Of Log Analysis System For University Website

Under the background of "Internet + education",colleges and universities have accumulated a lot of data in the process of campus informatization construction.Doing a good work of data governance and service to optimize the information service environment is a new topic facing the information construction of colleges and universities in the new era.At the same time,as an important part of the information service environment,the functions of university websites are increasingly diversified.Its role is not only to carry out information dissemination,but also an important and effective way to carry out communication and provide services.Therefore,it is of great significance for website builders and administrators to understand users' visiting situation by analyzing the website logs of colleges and universities and obtaining the interviewed information of websites.However,there are few colleges and universities through the analysis of website log data to obtain the website construction situation.Some colleges and universities use the traditional method of collecting information through web pages,but this method has low efficiency,less information and poor real-time performance.Using big data related technology to research and develop the website log analysis system for colleges and universities,which can directly,accurately and comprehensively reflect the website interview situation,and is of great significance for improving the intelligence degree of college informatization.This paper takes the research and implementation of college website log analysis system as the research content,on the basis of the existing Spark function research,combined with a variety of distributed technologies,puts forward a streaming batch method for dynamic parallel analysis of website log data.Then,the paper discusses the key technologies used in the process of web log analysis,and analyzes the functional requirements of the web log analysis system of colleges and universities.On this basis,combing the design process of the website log analysis system.The system is designed from the aspects of log collection,log cache,log analysis,analysis result storage and dynamic visualization.Finally developed a website log analysis system.It includes real-time dynamic analysis of website traffic,visitor area,popular sites and visitor terminal information.The analysis results are presented in the form of situational awareness map,which can be directly applied to the information department of colleges and universities,providing a basis for website managers to deeply understand the interview situation of websites,and laying a foundation for further analysis based on website data.