Research On Cluster Object Storage System And Overlay Network Protocol Simulation

With the prevalence of internet, more and more services are deployed on internet, and the demand for appropriate storage system is now even more urgent. In this paper, we carefully analyzed the properties of internet applications, and explained the requirement on storage in three different layers. TODS is a distributed object storage system built on cluster layer. Several key features were designed and implemented in this system, such as object storage management and optimization, distributed transaction processing, transparent object persistency. We think it is a novel storage solution for internet application with great scalability, high performance and high usability, and because it directly stores and processes structured or semi-structured data, application logic can be expressed smoothly.In the WAN level, we give no direct solution of storage; instead, we pay our attention on research of overlay network protocols which is the base of WAN storage system. First, we represent in this paper an improved version of Pastry protocol. It greatly decreases the maintaining cost of Pastry protocol while preserving the protocol performance. On the simulation of this improved protocol, we advance the application architecture of "Separate Protocol State-machine with the Driver", and with this architecture we can remove most of the repeating work on simulation application implementation. This accelerates the implementation and verification of Overlay Network protocols. At last we introduce ONSP, a large scale overlay network simulation platform based on parallel event simulation. With the carefully designed parallel protocol and synchronization strategy, we can simulate different scale overlay network in high performance. We also carefully analyze the impact of overlay network properties on simulation, such as "locality property".