Design And Implementation Of Industry Logging System Based On HBase

For a long time the industry logging system as the most important data source which monitors the industrial production process, but as the evolution of next generation industrialization 4.0, it shows performance bottleneck. The purpose of this paper is to solve the performance issues of the traditional industry logging system model using distributed database, distributed file system, asynchronous network I/O, load balancing, JVM and open source framework technologies, introduce these advanced technologies and open source technologies into the design of industry logging system to improve the throughput, reliability and safety of the industry logging system.This paper adopted the top-down design approach, at the very beginning we discussed the main related technologies and then we discuss the details of front end, server side, HBase database and system test design and implementation.During the design and implementation of front end and server side this paper introduced open source frameworks and also we added specific design for the logging system, so we can guarantee the performance and also we can take advantage the high performance and stability of open source framework. During the design and implementation of distributed HBase database and Hadoop distributed file system, we take full advantage of the cache of HBase and Hadoop improved the performance of the whole logging system a lot. The unit test cases design and implementation guaranteed each modules can complete its functionality and the whole system can leverage the continuous integration framework, performance test cases guaranteed the whole system can work correctly at certain level of pressure.