The Design And Implementation Of The Processing System For 10gbps Network Data Flow

In more than forty years that computer network has flourished,the technology in network hardware has made very great progress.Especially in the last ten years,the development of Internet technology presents explosive growth,the performance of network switches and other network hardwares has also been greatly improved.And for the performance that a network hardware can achieve when it is working properly,we have to use a professional network testing device to measure.The processing system for 10 Gbps network data flow is a device that used for testing a 10 Gbps network switch.It can catch all the packets that getting through a network switch at a very high speed,and can also store the network packets at the same high speed,which can provide accurate and complete data record for the analysis on the working state and performance of the network switche.In the design of the system,the most important challenge is the design and implementation of the high-speed network packet capture module and high-speed mass data flow storage module.In the design of high-speed network packet capture module,the traditional structure "10Gbps NIC + general processor" can not meet the 10 Gbps performance requirements when the packet size is 64 B,and this paper proposes the design that using network flow engine(NFE).This design makes all the processing operations of network packets occur within the NFE,so that can reduce the frequent communication between NIC and CPU,which can greatly improve the capability of network packet capture and processing,and makes the system can meet the 10 Gbps performance requirements when the packet size is 64 B.This paper proposes three designs for the implementation of high-speed mass data flow storage module,they are RAID software simulation,RAID with a RAID card,and a SSD cache + RAID.During the implementation process of the system,we made practical storage performance testings for the three designs respectively.And by analyzing and comparison of the experimental data,we choose the second design as the system storage implementation.In the actual work environment test after that,we made tests on actual performance and stability of the system.And through the optimization and adjustment of parameters,we continuously improved the overall performance of the system,and ultimately made the system performance achieve the standard of design requirements.In addition,we also repeated the test many times to validate the system's working stability in the long-term continuous working environment.This paper proposes a workable structure design and implementation for the 10 Gbps network data flow processing system by system requirement analysis,system design,system implementation,the actual tests,and many other aspects of works.This implementation can not only capture all the network data packets getting through a network switch in a high speed of 10 Gbps,display the working status information of the network switch in real time,and also realize the fuction of high-speed mass network data flow storage,which can provide accurate and complete data records for the analysis of the network switch's working state and performance.As for the domestic switch detects field,it can also solve the problem that domestic users have to afford a very expensive price when buying foreign products.Besides,the processing system for 10 Gbps network data flow can also be used in more Internet-related fields,such as network security,network devices testing,network monitoring and so on.If the system can be used in these actual working scenarios,it will have a very important and positive impact on the development of these areas.