The Research Of High Performance Network Storage Technology

Along with the rapid development of Internet and broad bandwidth application, the data amount in network has increased with volatile speed. How to save these continually expanding data is a new challenge for network storage technology. In addition,improving the performance of the storage system is the critical means to improve the performance of network service in many network application environment. Thus, the study of high performance storage technology not only can provide the effective method to save data, but also is the foundation of the high performance network service.The primary fields in study of network storage are centralized in: storage of wide area network, cluster file system, novel high performance disk file system. This dissertation explores the technology of network storage based on the issue how to provide high available and high performance network storage service. On the basis of systematic summarization of previous work on network storage, this dissertation deeply researches in the forementioned three primary fields. The author's novel viewpoints and breakthroughs are presented in this dissertation. The innovations of this dissertation are as follows:(1) The research on storage of wide area networkThis dissertation presents a mobile agent based file system: MADFS. MADFS uses hierarchical architecture, which makes it have good flexibility and expansibility; and uses mobile agent to improve the performance of communication in wide area network, which can reduce the load of server.The dissertation presents a novel hierarchy and convergence cache mechanism: HCCM. HCCM adequately utilizes the idea of hierarchy and convergence, which can effectively reduce the overhead of cache management and communication in distributed file system. This feature makes HCCM suit to work in WAN. This dissertation sets up an analysis mode of HCCM and does the performance comparison experiment. The experiment result shows that HCCM has the shorter response time and lower server load.(2) The research on cooperative write and cluster file systemThis dissertation presents a novel cooperative write mechanism: CWM. CWMcan eliminate the synchronous write operation in storage system and also insure the security of data. This dissertation presents the working principle and running mechanism, and analyse the data security and operational efficiency of CWM. The experiments in this dessertation show that CWM can effectively improve the performance of system. This dissertation presents a cooperative write cluster NFS server: CWCNFS CWCNFS not only has the availability of NFS, but also has the high performance of cluster file system. CWCNFS also introduces the CWM into the cluster file system, which greatly improve the performance of synchronous write operation in CWCNFS. The experiments in this dissertation show that CWCNFS can effectively improve the file access speed and system throughput.(3) The research on novel high performance disk files systemThis dissertation presents a novel high performance disk layout mechanism: ABL. ABL can record the access frequency of every file in file system and actively optimize the block layout of these hot files by block duplicating. The duplicated blocks can be placed in the special zone of track, which called "Cooling Zone". This duplication can make the files which are frequencely accessed appropriately distributed in the file system, and then can improve the access performance. The experiment in this dissertation shows that ABL can effectively degrade the latency of file access and greatly improve the performance of file system.This dissertation presents a novel high performance file system for efficient small wirte: STFS. STFS can utilize the non-liner seek character of modern disk driver, and put meta-data and the file data into the same track in order to minimize the latency of track seek. This disk layout of STFS can effectively reduce the disk seek latency of synchronous write. The experiment of this paper shows that STFS can effictiely improve t...