Building High-performance Networking System For Public Cloud

In recent years,cloud computing has rapidly developed as a new technology.Cloud computing has revolutionized an unprecedented way of working and has transformed traditional software engineering companies.At the same time,along with the deploy-ment of large-scale distributed services such as big data,artificial intelligence,and the Internet of Things in cloud data centers,the pressure on network systems is increas-ing.Therefore,improving the performance of network systems has become an urgent problem in cloud computing.This thesis aims at the urgent need of high-performance network platform for pub?lic cloud.We have studied three aspects:optimizing the virtualized backend of existing network platforms,designing and implementing RDMA-based high-performance pub-lic cloud network platforms,and providing high-performance network protocol stacks.The main work and innovations of the thesis are as follows:1.Zero-copy virtual package I/O system:For the overhead introduced by virtualiza?tion,which leads to an increase in CPU consumption at the back end,we propose a zero-copy virtual package I/O system.For the first time,the scheme uses page remapping in paravirtualized network I/O to eliminate data copying,and uses a series of optimization techniques to reduce the overhead introduced by page remapping.The single-core I/O speed has been improved by 2-4 times,saving CPU resources and further saving costs for the cloud service providers.2.A reliable network transmission platform in the public cloud:In response to the increasing network demand in the public cloud,we built a high-performance net-work platform for virtual machines based on RDMA.We proposed an RDMA paravirtualization solution based on connection virtualization,which solved the difficulties of RDMA hardware virtualization solutions that are difficult to meet the public cloud requirements such as network isolation and performance iso-lation,and eliminated the maintenance need for RDMA paravirtualhzation solu-tions.Compared to traditional transport platforms,the platform has lower latency and higher throughput,and provides reliable transport services for the upper lay-ers.3.Lightweight protocol stack:Traditional protocol stack processing in cloud com-puting is too complicated and takes up a lot of CPU cycles.Software-based so-lutions are difficult to eliminate complicated TCP processing.And The high-performance user-mode protocol stack also faces difficulties in providing native BSD Socket interfaces.We built the lightweight protocol stack-vSocket on the RDMA-based network back-end transmission platform.The design idea of reusing the kernel protocol stack control plane and accelerating only the data plane was proposed.It not only eliminates the huge overhead on the data path,but also maintains the functionality of the kernel protocol stack.Moreover it is compatible with the native BSD Socket interface.This thesis proposes several solutions for network performance problems in cloud computing,improves the performance of the network in the current cloud environment,and builds a reliable network transmission platform for virtual machines.We hope that these solutions can provide new ideas and possibilities for the study of network problems in cloud computing.