Font Size: a A A

The Research On Large-Scale Distributed Storage Technology

Posted on:2005-12-22Degree:DoctorType:Dissertation
Country:ChinaCandidate:Q S WeiFull Text:PDF
GTID:1118360125463951Subject:Computer application technology
Abstract/Summary:PDF Full Text Request
Along with the rapid development of Internet and network application, the distributed storage technology has made great progress. However, it is confronted with great challenges such as the incremental number of user, the broader areas of data distribution, the sharp increase in the amount of data storage, the more critical requirement of availability, and the rapid expansion in the types of the equipments, and so on. How to construct a distributed storage system with large-scale, efficiency, extensibility, and reliability is a subject that needs to be resolved urgently.This dissertation explores the technology of distributed data storage to provide high-availability and high-performance distributed storage service. Based on the systematic summarization of the relevant work on distributed data storage, this dissertation, not only carry a research on the distributed cooperative storage and the Internet oriented large-scale distributed storage, but also makes several innovations and achievements, which will be illustrated in detail as follows.The breakthrough of this dissertation could be embodied in the following several respects:1,This dissertation presents a distributed cooperative storage mechanism: Co-Store. Co-Store consolidates disk space of individual node into a single storage spool and implements file-sharing and fault-tolerance through the cooperation of the nodes, in which a node provides as well as shares service. Co-Store provides users with high-powered, reliable storage service by name space of multiple directory-tree, and mechanism of redundant fragment and parallel file transfer.2,This dissertation presents a P2P based massive storage mechanism: GStore.GStore consolidates large numbers of nodes distributed on the Internet into a single logic network and constructs an Internet oriented distributed massive storage system using highly scalable P2P architecture. GStore provides users with efficient, dependable storage service through dynamic route mechanism, optimal data distribution policy, adaptive replica management, and parallel file transfer mechanism.3,This dissertation presents a P2P dynamic route mechanism: DynRoute.Dynamic IP address causes problem for the Tapestry overlay network, which relies on static IP address. Aiming at this issue, DynRoute decouples the global unique identifier of a node with its IP address, and introduces distributed address mapping service to implement correct route in dynamic address environment, so that peer's address change can be detected in time and the node ID can be mapped into its current IP address. DynRoute also utilizes a security authentication mechanism to prevent the address mapping from IP spoofing.4,This dissertation presents a distributed data storage model. The model defines several performance parameters to describe data distribution policy according to the basic requirement of distributed storage, and establishes an estimation and decision mechanism by analyzing the performance of various data distribution policies. In this model, the data distribution policy is described in a polyhedron view. The model can suggest an optimal data distribution policy to acquire satisfactory storage service at the less costs.5,This dissertation presents an adaptive replica management mechanism: AdpReplica.AdpReplica constructs an adaptive restriction mechanism regarding availability and consistency maintenance overload as functions of a file's replica number. AdpReplica dynamically manages replica and maintains a rational number of replica, which not only satisfies file availability, improves access efficiency and balances overload, but also reduces bandwidth requirement, keeps the system stable and provides satisfactory storage service.
Keywords/Search Tags:distributed storage, P2P, dynamic route, data storage model, adaptive replica management
PDF Full Text Request
Related items