Research And Implementation Of A Scale-out Cloud Storage Based On Distributed File System GlusterFS

With the rapid development of big data, cloud computing and internet of thing, more and more data needs to be stored and analyzed. Traditional storage server was unable to meet the data storage needs now and in the future in performance and scalability. As the main direction of the future development of storage, researchment on cloud storage is urgent and important. Due to the outstanding advantages in scalability, stability, security and other aspects, Scale-out storage is more suitable than Scale-up storage as the underlying architecture of cloud storage, increasing academic and the importance of the industrial sector.Although the scale-out storage has obvious advantages, but the high-powercost of storage server is a major constraint of expansion of the storage node. The deficiency of GlusterFS in security has hindered its further development. In this paper, a new scale-out cloud storage solution is proposed based on an in-depth analysis of the shortcomings of traditional storage architectures and scale storage bottlenecks.In hardware, this paper analyzes the relationship between CPU performance and power consumption. Design a CPU chip dedicated for cloud storage node conceptually, for the data types and characteristics of cloud storage. And also design a micro cloud storage server by reducing unnecessary peripheral chips. A low-power and high-density micro cloud storage server would be designed to improve I/O performance & bandwidth through the study of solid state disk optimization techniques.In System software, make a deep research of optimization strategies of GlusterFS in Prefetch data, cache, with small sequential I/O, striping, etc. In terms of security mechanisms, GlusterFS has not provided any authentication mechanism and access control mechanisms. This paper study and improve the GlusterFS file system from the encryption and authentication aspects.Based on the above research on cloud storage servers and GlusterFS file system, This paper deploye the scale-out cloud storage system. Design a Web management platform in order to monitor and manage the entire clusters. Finally, this system is tested to verify the feasibility and performance advantages of the proposed cloud storage solutions.