Design And Implementation Of High-Performance Paxos On RDMA

Distributed systems are more and more widely used in large websites.Multi-copy state machine is a common solution to disaster recovery and load balancing in distributed systems.It guarantees the consistency of data storage among multiple copies through distributed consistent protocol,so as to improve system availability.However,the complexity of distributed consensus protocol and the overhead of network communication between nodes,incur prohibitive performance overhead on system programs.Therefore,this paper designs and implements a high-performance Paxos algorithm based on Remote Direct Memory Access(RDMA)technology,which can effectively improve the performance of the algorithm while providing strong data consistency and high availability guarantee.The main contributions and contributions of this paper are as follows:First of all,this paper tests and evaluates the performance of RDMA communication primitives and provides the basis for implementing Paxos algorithm based on RDMA.This article selects RDMA WRITE operation primitives over unreliable connection transmission to achieve communication between backup nodes.Secondly,this paper designs and implements a high performance Paxos algorithm based on RDMA.The node communication,consensus log structure and consensus flow in Paxos algorithm are redesigned and implemented in detail,and the performance of the algorithm is optimized by Batch and Pipeline,multithreading and asynchronous resolution,atomic operation synchronization mechanism.Finally,this paper tests the high performance Paxos based on RDMA.The results show that the proposed algorithm meets the basic requirements of correctness,fault tolerance and low latency of distributed consensus protocol.Compared with APUS,throughput of the proposed algorithm can be doubled in low concurrency scenarios.As concurrent requests increased,the throughput of this algorithm is more obvious,up to 1 order of magnitude or more.