The Research And Implement Of Data Access Subsystem In The Distributed Storage System

As the development of computers and the Internet, the information on Internet is showing a explosive growth. How to solve the storage and use of information is a very challenging problem.The distributed storage system appears, and it's the hot-spot issues in academic. So the study of the distributed storage system is a very important issue.There are two styles of the distributed storage system.One is based on the P2P, while another is not. The distributed storage system in this paper is based on P2P. It contains a large number of P2P storage nodes .Those P2P storage nodes determine the performance of the overall system.How to improve the performance of these nodes is an important issue. Therefore, this paper focuses on the network performance of the istributed storage system. It includes the throughput and CPU utilization.This paper mainly includes the following two parts:Firstly, we propose a method called ONPK, which can not only improve the throughput but also reduce the CPU utilization.How to improve the throughput, while reduce the CPU utilization is a very difficult problem .In this paper, we propose the following solution, called ONPK (The Optimizing of the Network Performance based on the Linux Kernel).the method can solve the problem through the following three measures:1. To reduce the times of replication when sending data;2. To reduce the number of system calls and context switches;3. Pre-constructed header, to reduce the processing overhead of the protocol stack.The experiments show that the mothed can improve the Gigabit Ethernet performance significantly.For instance, it can maintain a speed of 740Mbps while reduce CPU utilization by 11% on average.Secondly, research and implement of Data Access Subsystem.Based on the ONPK, we research and implement a data access subsystem. It is based on the P2P technology and support for continuous download and downloads from many nodes.In this paper, the study was a part of project: The distributed production of broadband services in the development of collaborative environment.