Font Size: a A A

The Study On The Key Technology Of Distributed Data Storage

Posted on:2017-03-10Degree:MasterType:Thesis
Country:ChinaCandidate:Y F ZhangFull Text:PDF
GTID:2308330491950315Subject:Electronic and communication engineering
Abstract/Summary:PDF Full Text Request
In recent years, with the high-speed development of Internet, the data generated by Internet grows exponentially, so enormous data puts forward rigorous demands for storage system. For example, the growth of the data storage capacity is far behind the growth of the data, and the performance of storage devices are often inversely proportional to the size of its storage capacity. There are some disadvantages and shortcomings in existing distributed storage systems so that they can not satisfy the storage needs of the massive data. Some of them own good performance, but it cost a lot and can not be applicated in large-scale so far(such as storage area network SAN), some of them cost little and also own good performance, but they are only suitable in the local area network(such as cluster file system), some of them can be built in the wide area network, but they did not seriously consider the system data storage location, number of copies, resource search algorithm etc, resulting in bad system performance(such as Coda distributed file system).At present, along with the new technology’s applications such as social networking and sensors, various types of data increase rapidly. How to store these data, how to locate the data resources fast, how to analysis the data and extract the value inside within an acceptable time. So designing a reasonable distributed storage system to solve challenges which the massive data brings to become the key to the storage system at the age of big data.The main work of this paper includes following aspects: 1, we consult the relevant information about the current data storage mode and grasp their shortcomings. 2, for the shortage of the current storage mode, we use P2 P technology as storage structure system and explore the technology about data storage and data redundancy and query in distributed storage system. 3, we designed a small-scale distributed storage system by some related technologies to point out the advantages and disadvantages of the related technology mechanism.The main contribution of this paper is that we explored the key technologies of distributed storage and designed a small- scale distributed storage system by the support of the key technologies, we also verified the correctness of the related technologies and the feasibility of dealing with the challenges brought by massive data.
Keywords/Search Tags:big data, P2P, distributed storage, data redundancy, replica management, algorithm of resource search
PDF Full Text Request
Related items