The Design And Implementation Of Origin Store Log System’s Log Management Subsystem

Electronic Arts Inc. uses Origin store to sell games online. By associating logs of different sources from Origin and visualizing them, developers can manage system resources better and locate the source of the problem more efficiently. However, visualizing logs in big data environment is a huge challenge because of the heterogeneity and instantaneity of log files.To solve these problems, the paper designed and implemented LogSas system for Origin online store to search, analyze and monitor logs. Logs were collected, purified and stored in centralized server cluster.This paper summarizes the mainstream real-time log searching and analysis system and presents a new solution based on Logstash, Redis and Elasticsearch. This paper describes the analysis and design of LogSas system in detail. On this basis, this paper focuses on the implementation of log management subsystem. LogSas uses a distributed architecture and adopts the hierarchical design. Log transmission module, log cache module, log store and search module, and log management module are divided into different layers. This loosely coupled architecture reduces system complexity and the dependence between modules. Log management subsystem use B/S architecture and MVC development method. It provides user interface and features for searching and analyzing, job scheduling, report exporting, user management and query management.