Design And Implementation Of A Cmopatible Network And Local Distributed File System Client

From the emerging internet industry to the traditional aerospace industry,distributed storage technologies with high scalability and high reliability is gradually replacing the traditional centralized storage technology.However,limited by the client network bandwidth,distributed file system download throughputs are generally low,which limits the scope of applications of distributed storage technologies.This limitation worsens the situation when the download time window for applications is narrow.To download large amounts of data in a minor window from small-scale distributed storage systems,an offline data download method is proposed.The core ideas are: I)the data storage devices in the distributed storage system are directly disassembled and are connected to an offline node deploying a customized client.The client with customized functions directly downloads data from these mount devices to local data storage devices II)Empty storage devices are mounted to the distributed storage system to ensure that the distributed storage system functions normally.Thus,the data download function of the near zero time window is realized.According to the above idea,a distributed file system client is designed to be compatible with both network and local mode.It has two different working modes.One is for the FC-based distributed file system.In this mode,clients can store files over the network as the data storage nodes in the distributed storage system.The other one works as an USB-based local file management.In this mode,the client directly manages files in the mounted data storage devices from the distributed storage system.A prototype system is developed according to the design content.The experimental results show that it effectively achieves the design goal in the local mode.Configuring with a processor Intel i7-3930 K and 16 GB DRAM,reading and assembling file metadata for one hundred thousand files from 4 physical storage devices takes 210 ms,and the peak throughput of downloading a 4GB files is 193.93MB/S.