Research And Design Of High Performance And High Availability Distributed Key Value System

In the past low speed network and disk storage system,because the processing speed of disk I/O and network performance is far lower than that of CPU and the performance of memory,affect the performance of storage system design rarely consider scheduling and memory copy factors such as architecture,computer operating system brings to the storage system,but now with the rapid development of new technology in high speed network and new storage media and other hardware,storage system software to the performance of the storage system is becoming more and more.Therefore,it is very important to study the storage system software technology that can make full use of the latest computer hardware technology to improve the performance of computer storage system.This thesis makes a thorough research on the distributed consensus algorithm and high performance server program design method of distributed key value storage system,existing,and on the basis of the design and implementation of a high performance and high availability of distributed key value storage system.The main research work of this thesis is reflected in the following aspects:1?This thesis makes a deep analysis and Research on the theory of distributed storage system,the distributed data consistency algorithm,the distributed storage model and the implementation technology of high performance server program.2?This thesis presents a design scheme of high performance and high availability distributed key value storage system based on Seastar framework.Based on the Seastar framework used in the user mode DPDK protocol stack,shared-nothing thread model design and zero copy technology storage API,LSM tree storage model and RAFT consistency algorithm based on many new technology,so in this thesis,the performance and availability of high performance and high availability of distributed storage system has high value.3?We design and implement a high performance and high availability distributed key value system prototype.Experimental results show that the system has higher performance and higher data availability than the same distributed key memory system in the same test environment.The research content of this thesis will have a good reference value for the further research of distributed key memory system and the research of large data storage system in the future.