Research And Design Of Cloud Storage System Based On Openstack

Facing massive data storage requirements, conventional storage system hassignificant deficiencies in performance, storage capacity, reliability and storage costetc. To solve problems in storage petabytes of unstructured data faced by businessesand individuals, a solution of cloud storage system is proposed based on OpenStackwhich is an open source cloud computing platform.Firstly, the commercial cloud storage system and open source cloud storageproject are studied, and the architecture and working principle of cloud storagesystem are analyzed. Then basic function and service relation model of OpenStack aswell as the key concept and working principle of Keystone are studied. Dataorganization structure and overall architecture of Swift are intensively studied, andthe data consistency model, data mapping algorithm, core data structure as well asworkflow of data upload and download are analyzed in detail.On this basis, the overall design scheme of the cloud storage system is proposed.This design contains a three-tier resource management mode involving container,directory and object according with user habits. It also contains a hierarchicalarchitecture of the client and the server. A design scheme of virtual directory isadopted referencing to the principle of the folder in google drive. To protect the datasecurity of enterprise users and individual users, an access control mechanism isproposed based on Keystone. To solve deficiency in storage gigabyte large file toSwift, a storage solution of gigabyte large file is designed based on file segmentation,segments merging and concurrent processing.Finally the client of cloud storage system is implemented with Javamulti-threading, and cloud storage experiment environment is established withlimited cheap hardware devices. The feasibility of this system is proved through theexperiment. The experimental results show that cloud storage system has realized thecontainer, directory, object management function and has provided a security accesscontrol mechanism. This solution can also break through the Swift restrictions on filesize, and improve the speed of file upload and download.