The Design And Implementation Of A Distributed File System In Grid

Nowadays, grid technology would no longer limit itself in the field of high performancecomputing, instead it is moving along to the web service technology and has been construct-ing an SOA grid architecture. Accordingly, the data module of grid will become an individualautonomic distributed file system instead of just a support module.This thesis aims to construct a distributed file system in grid for China Grid SupportPlatform and provides other submodule in CGSP with permanent data access and stableefficient data transfer service. In the other side, this system can be run independently and letendpoint grid users create their own data space via the network.Traditional distributed file systems are tight-coupled and have outstanding performance.However, they are always designed for a specific system and lost the generality. Whilethe performance of some web-based distributed file systems are at poor performance. Tomeet the requirement of large distributed data-intensive applications, we designed and im-plemented a slice-based, loose-coupled distributed file system, which includes data storageresources, data storage management module, meta data management module, data transfermanagement module, replica management module, information monitoring module, strategyanalysis module and all kinds of portals.Comparing with other distributed file system, our works have the following features andimprovements:Stability: Replica management module will adjust the redundancy degree of file slicein the system and thus avoids"zero replica crisis". Besides strategy analysis modulewill choose the most robust data node to store data;Efficiency: The system use GridFTP stripped parallelled transfer to increase the usageof the bandwidth both on client and on server. Besides strategy analysis module willchoose a best data node to start a transfer;Generality: In this system, we use web service resource framework to implement re-mote call. Thus the only thing storage resource must do to enter into resource set is toreport its state to management module. Besides, users can log in their own space viaany terminal;...