Design And Implementation Of Cloud Storage System Based On HDFS And Encryption Retrieval

In order to make hardware and software and other computer resources can also be like water and electricity,only need to pay a little "money" can be used continuously,cloud computing appearance at right moment.Cloud computing has changed the traditional model of use of hardware and software,to avoid the cumbersome process of application installation and maintenance of hardware facilities,so that the real meaning of the direct use of computer resources services.It meets the requirements of data computing and storage in the era of big data.Cloud storage comes from the development of cloud computing,the core point is the storage of data.Compared to traditional storage,cloud storage has a very good fault tolerance and scalability,can solve the massive data storage,as long as there is a network,users can access the data in the cloud regardless of time and place.However,due to cloud storage in the distribution of different geographical location of the cloud server has a distributed characteristics,resulting in data storage location uncertainty,will give users cloud data security storage risks.In addition,HDFS is generated due to big data storage,the storage of a large number of small files will inevitably cause a waste of space.In view of the above problems,this paper has done the following work:(1)In this paper,an encryption retrieval method is proposed,which encrypts and stores the user sensitive data,an information digest generated using the MD5 encrypted file name forms an index,and provides the information digest to retrieve the ciphertext file.The plain text data is localized and decrypted by Improved DES algorithm.To solve the user sensitive data security storage worries,ciphertext file retrieval and other issues.(2)In this paper,HDFS as a data storage side,to the browser / server model to achieve cloud storage system.The system provides a series of functions such as user registration,account management,space and file management,file upload and download,file search,data backup and so on.Cloud storage users themselves need to store many small files,in order not to affect the user's experience,but also to minimize the waste of storage space,increase the small file merge upload mode,in a small file issue to do a compromise,the user can select Add some small files that are not commonly used.This paper designs and implements a cloud storage system based on HDFS and encryption retrieval.It can effectively meet the basic needs of users of data storage,combined with encrypted retrieval methods to achieve the user sensitive data secure storage and effective retrieval.And users can selectively merge small files and upload,improve storage space utilization.