Design And Implementation Of HINOC Network Real-time Data Acquisition And Analysis System

HINOC is a new type of broadband access technology used to connect fiber optic networks and home networks.On the basis of FTTB,HINOC provides high-speed network services for many families by utilizing the coaxial cables that have been laid in the corridors and indoor areas of the community.At present,the mature HINOC 2.0 access technology can support single channel 1 Gbps two-way communication,the average delay is less than 2.5 ms,and various performance indicators far exceed similar EOC technology.At the same time,the industrialization of HINOC technology are also progressing simultaneously.In 2017,the HINOC test network was deployed in Changshu and Suqian,Jiangsu,and a one-year actual operation test was conducted.After the rigorous testing of HINOC technology by authoritative institutions,it is confirmed that all the indicators of HINOC technology can be comparable with optical fiber technology.With the gradual commercialization of HINOC 2.0 technology,HINOC's network scale and number of users have continued to grow.It is becoming more and more difficult to monitor and manage a large number of HINOC equipment.Building an automated and intelligent real-time data acquisition and analysis system is of great significance to the quality management of HINOC networks.In recent years,technologies such as big data and cloud computing have developed rapidly and are widely used in various industries.Data acquisition and analysis of communication networks is one of the application scenarios that can give full play to the advantages of big data technology.Using big data technology to build an automatic and intelligent HINOC network real-time data acquisition and analysis system,which can efficiently collect,store and analyze the network status information and equipment statistics information,so as to mine valuable information for network management or assist in problem decision-making.The focus of this paper is the design and implementation of HINOC network real-time data acquisition and analysis system.First of all,the requirement analysis of this system is carried out,and then the overall architecture of the system is given.The system is divided into four modules: data acquisition module,data storage module,data processing module and data visualization module.The data acquisition module collects the network parameters of each HINOC network,providing a high-quality data source for the system.The data storage module is responsible for storing and accessing various types of data in the system.In order to solve the problem of slow retrieval of massive data in database,the speed of retrieval can be improved to the level of milliseconds by establishing a combined index.The data processing module provides low latency and high throughput data processing services.The data visualization module is responsible for visualizing the real-time running status and statistical analysis results of the HINOC network.In view of the problem that the data of real-time monitoring page is not updated in time,this paper proposes a solution to maintain the monitoring data in memory and push it to the front-end page actively through the server,which greatly improves the response speed of real-time monitoring data.Finally,the function and performance of each part of the system are tested,and the results are analyzed.The test results show that the system's real-time monitoring,statistical analysis,and historical data query functions are all realized.The system has excellent performance in data access,data distribution,and data processing,and meets design requirements.