The Design And Implementation Of Server Log Collection System For NetEase Game Studio Server Cluster

At present,the number of servers providing online service for Netease game studio is expanding rapidly,and the existing server log collection tool has been difficult to meet the daily operation and maintenance needs.It is urgent to establish a better server log collection tool to collect server log data,so as to provide a log data bases for further monitoring system operation status and rapid detection of system failure.This thesis describes the background of the project,explains the important role of the tool in business operation,and summarizes the application of log collection system in domestic and foreign enterprises.This thesis describes the related technologies such as Django,Kafka,MongoDB,Bootstrap and Echarts.This thesis describes the system boundary,analyses the functional and performance requirements in detail,extracts five functions of log collection,data preprocessing,query analysis,template management and user information service.This thesis describes the overall structure of the tool through working principle,architecture design,function composition design and system deployment design,and explains the database design.Through class diagram,sequence diagram and other methods,this thesis designs five modules in detail,such as log collection,data preprocessing,explains implementation details and carrys on system test.The tool has been put into use in the server cluster of project group,and the effect is good.It is planned to be extended to the whole company.