The Desigh And Implementation Of Cloud Storage System Based On Amazon S3 Interface

With the development of information technology,more and more enterprise data and user data need to meet massive users' access at any time and at any place.In order to cope with the increasingly severe challenges,the storage system is also constantly developing and improving.From the early single node storage,to the current network storage and distributed storage,and the most widely used cloud storage,we can see the development of storage system and information which is closely related and promoted by each other.BOSS(Blue Ocean Storage System)which is independently researched and developed by our lab is a distributed file system.We also have absorbed the advantages of the previous technology and design ideas.BOSS has many advantages such as high concurrency,linear expansion,high reliability,strong consistency and other outstanding features and technical advantages.With the difference of traditional system which metadata is managed centrally,it eliminates the bottleneck of the system performance caused by the metadata node.As a result of it,BOSS has a very high storage capacity and high expansion ability.In this paper,I have studied the key technologies of distributed storage in detail.By the research of high concurrency model and data consistency,many innovative design ideas are proposed for BOSS.At the same time,I design and implement the AmazonS3 interface for BOSS,so BOSS can serve as the existing cloud services back-end cloud storage devices,which can provide 24 hours of uninterrupted high efficient cloud storage service for users.The work of this paper is as follows:First of all,I design and implement a high concurrency model to meet market needs,so that BOSS can cope with the massive user requests at the same time in current Internet environment.Secondly,in order to simplify the configuration management of BOSS distributed file system,the monitor management cluster is introduced.We also propose the consistency algorithm of BOSS monitor cluster by the research of the existing consistency algorithm.Thirdly,implement the AmazonS3 interface analyzes module for BOSS,so that BOSS can serve as a cloud storage system based on AmazonS3 interface.Finally,through the detailed comparison of the other systems,it is proved that the BOSS is competitive in the storage capacity.According to this,the paper puts forward the optimization and improvement measures in the future development of BOSS.