Design And Implementation Of General Purpose Data Collection System Based On IP Network

Network traffic monitoring has become an important field of Internet technology. The purpose of network traffic monitoring is to obtain traffic data which is extremely significant for the planning, management, maintenance and billing of network. The traffic data is also an important indicator to measure the value of network applications and can be used to analyze user-behavior. Generally we use software to collect packets from network adapter of host and extract information from the packets. Traditional packet capture and analyzing software has many disadvantages, such as the code is scattered and it requires a lot of work to adapt the code to specific network protocol environment. In this case, we propose a general-purpose software framework for traffic data collection which can be deployed quickly and flexible.Firstly, the basic knowledge and technology which is related to the software system is introduced briefly. Then we introduce the design of the data collection system in detail including the features of the framework and the detail design of the sub-modules. By analyzing the performance characteristics of this framework and comparing the existing technical solutions, we achieve software performance optimization from the following two aspects, high-performance packet capture methods and taking full advantage of multi-core CPU. Through the above research and experimentation, we complete and improve a flexible, general-purpose and high-performance packet data collection system.