Research Of Cloud Storage Service System Based On HDFS

With the rapid development of Internet technology, data volume shows the tendency of explosive growth. The enterprises face many problems like difficulty of managing massive data, high cost of data storage and low liability. More and more enterprises begin to manage data storage separately. They turn to professional service providers of cloud storage for help in order to conduct data distributed management. Cloud storage service has the characteristics of high liability, high versatility, high scalability and massive storage. Therefore, the research on the system of cloud storage service can not only follow the new trend of IT technology, but also is meaningful and full of application value.The thesis studies cloud storage service system based on HDFS. It aims to solve enterprises'problem of massive data storage and reduce cost of applying distributed file system and promote the Hadoop technology by conducting a cloud storage service system based on HDFS. Cloud storage derives from the extensively discussed concept of cloud computing. It can synthesize a large number of storage equipments in different sizes, and therefore has the function of providing data storage and business access outside. HDFS is the basic part of Hadoop framework which is an open source software platform of cloud computing. It has the characteristics of high transmission rate and high fault-tolerance. It can visit the data in the file system in the form of data flow. In this way it solves the speed and security problems and achieves storage management of massive data.Firstly, the thesis expounds the theory of cloud storage including the definition of cloud storage, structure and application of cloud storage system. Secondly, the thesis analyzes HDFS data management mechanism and its implementation techniques in detail to provide technical support for the following researches. Finally, combining with the actual need and making business analysis of the cloud storage service system, the thesis has designed the system architecture, the functional structure, database and operating environment of the cloud storage service system. After that, the system is made into reality. Thus, an effective solution is provided to enterprises to solve massive data storage problem. The main purpose of the thesis is to achieve a cloud storage service system facing enterprises application to solve problems like unstructured data online storage, query and backup. Some progress has been made on research of cloud storage service system, however, how to protect security and privacy of data in the cloud is still a key point and an urgent problem of future research.