Design And Implementation Of Module Storage And Access In Private Cloud Storage System

With the combination of Internet transmission and mobile communication,the amount of information transmission in the network is drifting growth,whether it is business or individual,has become more and more accustomed to relying on these intelligent electronic devices to manage their own information,data.Massive data management,relying solely on the individual structure of the storage system to complete,become more and more unrealistic.With the cloud storage technology to achieve massive data management and storage has become the inevitable trend of the development of Internet information.As of the end of 2015,mainland China cloud storage business,the number of individual users reached 420 million.In the foreign cloud storage market,Amazon's S3,Google's GSD,Microsoft's WinLive SkyDrive and other products are also a short period of time to occupy a huge market share.To cloud storage technology as the core to build the data storage platform,can provide all kinds of users with convenient,fast,reliable data management service,do not require users to consider and solve such problems as the underlying architecture of the whole system,overhead costs.It saves users the time and cost of data management.The cloud storage system provides a unified network interface that enables users to access data on the Internet at any time without being subjected to time,location,or terminal device types.In this paper in view of the existing in the development of this unit in the main business mass storage,transmission speed,data backup and disaster recover system requirements,based on the Hadoop platform design implements a good scalability and reliability of private cloud storage system.The main tasks of this paper are as follows:(1)The deployment management of the underlying data storage device adopts HDFS distributed file management technology of the most popular Hadoop platform,which guarantees the high reliability and stability of the system.(2)The front-end user access module combines the WEB mode with the SDK mode,and the user interface based on the mobile end is also designed in the WEB mode.(3)Aiming at the characteristics of this unit,the optimization scheme is proposed for the storage of large number of small files,and the simulation verification is carried out.(4)For the two main modes of the system,the complete test cases are designed to test and compare their performance.The private cloud storage system designed in this paper can provide large capacity file storage space in the at the same time,also guarantee the transmission speed under multiple simultaneous connections,in dealing with this unit of data storage needs of the business at the same time,also for the cloud storage technology in other areas of similar applications to provide certain reference and the research train of thought.