Design And Implementation Of Data Management System Based On Public Cloud

With the continuous development of Internet, the network data grows exponentially. The data storage scale have expanded rapidly and data storage technology faces enormous challenges. Cloud computing technology has brought a new technological revolution to the IT industry and its appearance has brought new ideas to us to solve the storage problem.Using cloud computing technology to store corporate data, the most common solution is "public cloud".And because the "public cloud" is highly scalable, automated fault tolerance, ease of management as well as the advantage of cheapness, disaster recovery can be a good supplement to bring additional expenditure. But the current use of public cloud there are two main problems:First, the transfer speed is slow, that corporate data can not be backed up to the "public cloud"; Second, data security is not guaranteed, private enterprise core data in the "public cloud" unprotected. Aiming at the deficiencies of "public cloud" in the enterprise data storage, we design and realize a middleware between the interior enterprise application and public cloud storage platform closer to the client we called----Cloudkey, which is designed responsible for enterprise data backup and management business. The main content and achievement’s of this paper are as follows:(1) This paper reviewed the domestic cloud computing and cloud storage technology research in related fields, according to the status of data storage, design and implement a public cloud-based data backup and management system.(2) We made a detailed study and analysis of the key technologies of storage system, including deduplication and encryption technologies. Through experiments, we evaluated the CloudKey system duplicate removal rate and encryption performance, and verify the efficiency of the system backup and data management.(3) In this paper, we design a middleware solution, split the local working set and cloud backup storage, data storage can. be divided into: data preprocessing, resource management and scheduling, data storage, data encryption and backup. Data storage using metadata and data content separation mechanism, realize the metadatacentralized management and distributed storage of data. Use of public cloud storage platform backup of local data, ensure the availability of data. Before data backup, we encrypt data to ensure data privacy, and the data security issues will be resolved. By working set cache data locally, we backup data to public cloud when it is idle, solve the problems of slowness directly connected to public cloud.