Research And Design Of High-speed Ip Network Traffic Measurement System

The research and implement of network traffic measurement system is regarded as a base and an important approach of" network management. Analysis and modeling should be done on the base of traffic measurement, while network resource needs a rational distribution and optimization. With the rapid progress of technology for high-speed network, technology of network traffic measurement is confronted with new requirements which mean high-speed and high efficiency.In this paper, firstly, we studied theories of network traffic measurement including basic principle, conception, classes and standards. Some current and popular technologies of network traffic measurement were compared and analyzed. We introduced the architecture of the network traffic measurement, respectively four parts of the architecture which were data collection, data management, data analysis and data representation from the point of view of data engineering, among which data collection was particularly discussed on the base of investigation of primary problems in traffic measurement of high-speed network. We also adopted and applied the flow-mergence method into measurement system, which is based on flow-compression technique, similar to Cisco NetFlow.Secondly, we analyzed the principium and implementation of Netfilter framework and loadable kernel modules technique in Linux system.In the last of this paper, we explained the design and implement of high-speed network traffic measurement system on Linux, including the framework, functional modules, core algorithm and some details.There are two innovations in the paper. One is the integration of Netfilter framework and loadable kernel modules technique to increase the ability of data collection, while the other is the adoption of the flow-mergence method to decrease the quantity of data analysis. The system can take a high performance measurement and provides detailed measured data and APIs for the upper applications such as IDS or firewall.Researches on traffic measurement of high-speed IP network are ever progressing while many research efforts are still in discussion either increasing ability of data collection or decreasing system performance...