Multi-client File Management System Based On GlusterFS In Cloud Platform

With the rapid advancement of cloud computing technology and the increasingly widespread use of cloud platforms,the data and files generated also used by users in the production environment are increasing exponentially.In response to the problem of massive data management under the cloud platform,the researchers put forward the concept of cloud storage.Its meaning is to combine the concept of cloud,store users' massive files in a large-scale distributed file system,and combine server cluster technology to provide users with access interfaces,users do not need to pay attention to the physical location and organization of file storage,the only thing that users need to do is use the cloud storage services to access files.Cloud storage has the characteristics of convenient expansion,redundant backup,and low unit storage capacity by using the distributed file system,which is suitable for enterprise applications in the production environment.The excellent features of cloud storage need not only the support of the underlying distributed file system,but also the ease of use and power of the upper-level functional services.After studying several mainstream distributed file systems,this thesis chooses the Gluster FS file system,which has the characteristics of no metadata service,powerful expansion performance,support for data redundancy backup,damaged data self-repair and other excellent features,which is very suitable for application in In the cloud storage environment.For the upper-level services,this article takes into account the needs of users to access the file system in different environments and devices,and chooses to use Electron technology for the development of multi-platform clients,so that users can access the file system using devices of various platforms.It solves the disadvantages of traditional cloud storage that the system is difficult to expand,cannot provide file management services in multiple environments,and cannot meet the needs of collaborative office.It also solves the shortcomings of traditional cloud storage in laboratories that there are too many components and difficult security maintenance..This thesis firstly studied the Gluster FS system architecture,server-side client access mechanism,data distribution and self-repair mechanism,analyzed the specific needs of users for the file management system under the cloud platform,and designed a multiclient file based on Gluster FS.Manage the performance requirements and functional requirements of the system,and carry out detailed design and implementation of each subsystem,including basic function modules,performance optimization modules,and file modules.The performance optimization module proposes to add a metadata cache layer to the Gluster file server to improve the corresponding performance of the server and reduce resource overhead.The file module realizes the function of uploading and downloading large files in fragments,the design realizes the aggregation and storage of small files,improves the performance of small files,and combines with Electron technology to realize the online browsing of files,which facilitates user office operations and improves users' Use experience.Finally,the functional test and performance test of the system show that the multi-client file management system based on Gluster FS under the cloud platform can meet the needs of users and achieve the planned goals.