System Performance And Security Of Cloud Storage System Re- Search Based On HDFS

Compared to the traditional computer cluster computing, Hadoop cluster is easier to maintain and extend, and the Hadoop cluster is achieved based on a large number of cheap machines when implementing large scale operations. OpenStack is an open source infrastructure cloud services, there is no need for administrator to manually maintain and the cost of load balancing and elastic operation such will be lower with the use of virtual machine to schedule computer cluster. In this paper, it has made a brief introduction to cloud computing platform, and attempt to built the hadoop distributed file storage system based on this.With the fast expansion of network information throughput, in many cases, HDF-S was used as a cloud storage systems dealing with massive amounts of data. This scheme ensures the storage efficiency, meanwhile, there is also a high demand for the reliability of data. Current HDFS system achieve high fault tolerance in the process of storage through the data redundancy. This method is simple and easy to implement, but the efficiency is low, and difficult to guarantee the security of the file, because the contents of each copy is the same with original data.In this paper, we propose a new architecture, combined with random linear network coding and multi-node reading, to improve the security and storage efficiency of the distributed system on the basis of HDFS. Even if the whole copies was intercepted by a third party, the third party cannot get a single complete encoded data, it is impossible for him to restore the original data by decoding, therefore, it is almost put an end to the possibility of data leakage.Traditional media storage devices cannot meet people’s demand for large amoun-t of data storage already, the development of the cloud storage service will alleviate this phenomenon that all kinds of cloud storage system was developed in recent years. However, applications based on HDFS are rare. In this paper, we developed VISG cloud synchronization software based on HDFS, which can synchronize local docu-ments and files in HDFS system in the same time, the operation is simple and the system is easy to use. We will introduce the development and writing process of this software from the system structure, operation process, algorithm analysis and the usage instructions.