Research And Implementation Of User-mode Network Protocol Stack Optimization Technology For Data Center

With the continuous development of cloud computing,Internet of Things,artificial intelligence,big data and other technologies,data centers now have to process massive amounts of data every day,which requires extremely high network throughput performance and puts forward higher requirements on network technology.However,with the gradual deployment of high-performance network cards such as 40 Gbps and 100 Gbps,the bottleneck of the traditional core network protocol stack has gradually emerged.Because the data message transmission needs to cross the kernel space and the user space,The network transmission causes the interruption of the kernel,which leads to the context switch overhead.And the increase in the cost of data replication have a great impact on the processing of data messages.The traditional kernel network protocol stack can no longer meet the requirements of ultra-high-speed networks for data forwarding and processing.As a result,a series of network technologies that bypass the kernel protocol stack have emerged.How to use these similar technologies to formulate rules for kernel bypass transmission is a direction of current high-performance network research;on top of this,high-performance user-mode protocols Research on the stack has also received more and more attention.In order to deal with the inefficiency of the core protocol stack's network processing capabilities,this paper studies and analyzes the high-performance network I/O framework and the user-mode protocol stack developed based on the high-performance network I/O framework;on this basis,the author carried out user-mode protocol stack compatibility and performance optimization work.The main work of this paper is as follows:First of all,in view of the low compatibility of user-mode protocol stacks and the difficulty of porting traditional network applications,a design scheme of a compatible framework for user-mode protocol stacks based on shared memory is proposed.This method realizes that by using the LD?PRELOAD environment variable to change the loading sequence of the dynamic link library,the network application calls the POSIX API to intercept,and the corresponding flag bit and related information are passed to the data sharing module,and the user mode protocol stack process is based on the data sharing module related information Match the specific calling function for redirection,so as to achieve the goal of accessing the user mode protocol stack for use without modifying any source code of the network application.Secondly,with the diversification of user-mode protocol stacks and the innovation of packet processing functions,vector packet processing has been vigorously developed,providing new solutions for further improving performance,including DPDK receiving packet preprocessing strategies,RSS parallel processing,and vector Packet processing proposes a user-mode protocol stack performance optimization scheme based on vector packet processing.This method realizes the use of receiver expansion technology and active caching technology to achieve data preprocessing.And comprehensively consider the resource consumption caused by the process function in the data message processing,and use the vector grouping method for message processing to further improve the message processing performance.