The Design And Implementation Of Data Acquisition And Storage System Of IP Network Traffic

With the great development of Internet , the IP network technology ,as a carrier of business and communication, having got rapid growth in recent years. The business based on IP technology also make good time ,which make the network become more and more enormous, and increase the inconsistency between availability and size of the network. The quality of the network management can directly affect the network's transport, the construction is as important as management to network..Network management software manage the network resource,performance,fault by analyzing the network data, how to get network data is the most important part during the course of developing the network management software, This article will elaborate on the design and implement method of data acquisition and storage system.This paper first introduces some base theory of network management technology, including base conception, main functions and framework of network management.Secondly, this paper analyzes some protocols used by data acquisition, including SNMP, NetFlow and RMON.After that this paper gives a brief introduction about how to storing big data of IP network, at the same time, To show differences we compare many kinds of storing means.Finally , the design and implementation of the data acquisition and storage system allied project practice is discussed in detail at chapter 5. Taking different protocols collecting different network data in data acquisition layer for network cell and management class difference, In upper level, data acquisition is divided into active acquisition and passive acquisition.NetFlow,SNMP TRAP belong to passive acquisition, and in the flowd module acquisitive the data , save the data and transfer the data to alarm module. However, SNMP and CLI, belonging to active acquisition , must be polled regularly by polling server. In order to avoiding frequently operate about I/O, using embedded database store collected data, for origin data and business data disposed store in difference databases. In order to improve the whole efficiency of the whole system, divide the whole system into three layers , each layer corresponding with a process. Data collect layer is flowd and arpd process, business dispose layer is flow-mining, then for the front disposal we take J2EE technology.In order to promote the efficiency of receiving and disposing, we program with the C language for data collecting layer and business disposing layer . for front disposal layer we program with the JAVA language for it working different platform.