Research And Implementation Of Cloud Storage System Based On MooseFS

With the development of information technology and the era of big data, traditional datastorage methods can not meet the needs of modern data storage. And cloud storage and massdata storage are considered as good next-generation data storage solutions. The so-calledCloud Storage actually is a system which combind a variety of network storage devicestogether by software systems to work together, and provide common external data storage andbusiness access service, through application of a variety of clustering technology, grid anddistributed file system technology and other systems. The study in this paper actually is aMass Data Storage system based on the distributed systems MooseFS. But the implementationof the system used the Cloud Storage system architecture, so it is also a Cloud Storage system.MooseFS is an open source distributed network file system. And it is a C languageimplementation of the Google File System. The system has a high-availability systemarchitecture, convenient application programming interface, as well as a very high-scalability(support online extensions) and data read and write performance. Besides the installation anddeployment of MooseFS is very simple, and easy to use. This paper will briefly introduce thetheory and technology of Cloud Storage at first, and analyse its system architecture and designthe overall framework of the system based on this. Then use the Struts2framework to designand implement a Web application as a client. Design and implement an API by Java languagefor file storage. And then use of Libevent Event Library to design and implement ahigh-performance data storage server. And after that, use the distributed system MooseFS asthe underlying basic storage system. Eventually implement a simple Cloud Storage systemwhich similar to the network disk, thus to verify the availability of MooseFS in Cloud Storageor Mass Data Storage systems. In addition, the Research and Implementation of CloudStorage system security policy will be done in this paper, including virtualization storagetechnology and data encryption technology. And at the end, some functionality andperformance tests will be done to verify the feasibility of the system design and solutions.The study made in this article is mainly a prospective validation of the application ofdistributed filse systems MooseFS in Mass Data Storage system in many corporations. It has acertain reference value and practical significance. But, as a safe, reliable and efficient Cloud Storage System, the research this paper made is never enough. The data monitoring andmanagement of Cloud Storage system, data compression, data deduplication, networkbandwidth limitations, will be problems to be solved in follow-up study.