Design And Implementation Of Storage Subsystem In Private Cloud

As the development and popularization of the information technology, data amount increases sharply and data interaction becomes more closely, making people more concentrate on data storage and computing.Nowadays, cloud storage technology becomes the preferred solution for enterprises due to its high efficiency managing manner, high reliability and safety. The difficulty and emphasis lie in the efficiency, extendibility and safety in the designing of cloud storage system.The design and realization of metadata managing unit and data storing unit have always been difficult problems in the field of cloud storage system. This thesis mainly focuses on the design and realization of data storing unit due to limitation of research time and the length of thesis. Taking practical demand of enterprise into consideration, a cloud storage system C-Store with high extendibility and availability is proposed and realized on the basis of the characteristics and applications of current storage system and distributed file system in this thesis.In this thesis, several current distributed storage systems and theoretical principle related to cloud storage technology are introduced firstly, followed by the design thinking and method of this cloud storage system C-Store. The emphasis lies in the design and realization of data storage system and finally, system testing is carried out to verify the former design thinking.Distributed framework is adopted in cloud storage system C-Store, in which data from metadata part and data part are stored respectively and in different, individual resource managing unit(bucket). Thus metadata and data can be managed and optimized independently, avoiding the risk brought from the invalidation of a single node. Meanwhile, load balancing technology is employed to balance the load among nodes. Data recovery strategy is used to improve the reliability and extendibility of the system.Design thinking and essentials in data storage unit are realized in this thesis. The private cloud system developed with C++ under Linux OS; Users can upload, download and delete data via user service port. Data storage in key-value pair storage manner is realized. Multiple different data storage units can be located according to rule-based resource locating mechanism(multilevel mapping). Load balancing mechanism of the system is realized through bucket extension and migration. Data recovery and reestablishing is realized via multi copy mechanism. A cloud storage system with high performance, high availability and high reliability is realized.