A Study On Secure Cloud Storage Model Based On HDFS

Due to the development of Internet technology and cloud services, the number of Internet users is growing, making all kinds of information also showed explosive growth.In this trend, traditional storage services have failed to meet the current needs of the user. Whether business or personal needs a new storage service.Cloud storage is developed from the concept of cloud computing. It is using the Internet, distributed file system technology to connect physical storage together in the network by a combination of hardware and software and to provide users with a standard,user-friendly storage interface.The development of cloud storage, prompting more and more users to migrate users’data to the cloud storage,while the cloud storage security has become an essential focus.When our data migration to the cloud, cloud storage provider will have absolute control over our data, and we have lost absolute control of the data.As the underlying Hadoop Distributed File System, HDFS is one of the mainstream to build cloud storage. Due to the use of HDFS deployment of cloud storage platform data have absolute control problem, the research of this paper is the self-controlled secure cloud storage model ASOM (All Self-Organization Model) and the internal implementation of HDFS.For the realization of HDFS,the main the analysis of the approach of managing metadata for NameNode and management of the entire cluster to the realization of HDFS.By analyzing the related data-blocks interaction betweent DataNode and NameNode, and the metadata organizational processes in NameNode,we design and implement a metadata subservices and device management server for ASOM.After a successful extraction and separation of metadata, the device management server is responsible for managing the entire cluster normal operation, the metadata server is responsible for the namespace and file positioning. When reporting data from the data server to the device management server,the device management server will forward the necessary information to the metadata sub-server to complete metadata organization. In the whole process of running a cluster,the metadata sub-server and device management server constantly exchange information.In order to prevent possible leakage of sensitive data in the interactive process, in the realization we introduce a random table mechanism. In this interactive process, this paper also implements Co-work algorithm to ensure consistency in both server data interaction.Co-Work algorithm is based on the lock through the analysis of the actual scene process to make two servers ensure data consistency.While for ASOM security issues that small file corresponds to a data block content make research and resolve. By encrypting section fine-grained data for the small data file contents, not only to ensure the security of data, but also can improve efficient of encrypting all the data.At the end of this paper, through the model experiment of security and comparative analysis on the performance and memory usage, we not only prove that user can make effective control and manage for metadata,but also prove the platform administrator of cloud service provider is difficult of possible to malicious operation for metadata,and bring safety hazards.