Design And Implementation Of Telecom Alarm StorageBased On HBase

In recent years, with the construction of 4G networks the Network Fault Management System of Shandong Mobile Company need to processes more and more alarm data. Every day, millions of alarm data is written to the alarm database, the data stored in the database alert increasingly large. While the alarm TABLE become larger and larger, the traditional way to store and access the alarm is difficult to provide a good performance, this serious impact on the user experience. Especially, the big data analysis is more and more important now. How to use the existing alarm data with data from other formats in order to better protect the network? The user become focus on this point now. The current mode cannot meet the new needs.As a NOSQL database, HBase can support big data access, millisecond-level query, give a way to store alarm data. By analyzing the characteristics of HBase and the network alarm data, the paper analyzes the feasibility of using HBase store alarm data. Then, designs HBase to store alarm data, and proposes a solution for the hotspotting problem and the condition combination query problem.For the hotspotting problem, the paper uses hash and presplit to ensure the alarm in a relatively uniform distribution, try to avoid the hotspotting. For HBase cannot directly support multi-condition combination query problem, the paper uses a secondary index table to store the index data, so that the query can be first through the index table to obtain the index data which meet the conditions, and then quickly extract data from the data table. Moreover, designs the alarm serial number to be generated by the alarm time, so that the serial number can contain time information, and then uses the hash value and the serial number to generate the RowKey.The analysis shows that the use HBase to store alarm data can meet the growing amount of alarm data in fault management system and data analysis. This paper gives a reference solution for the resolution of the hotspotting and multi-condition combination query problem while using HBase to store alarm data.