Research And Implementation Of File Management System Based On FastDFS In Cloud Platform

In the era of cloud computing,there has been an explosive growth of user data and files,and cloud storage is playing an increasingly important role.Cloud storage is a solution for the storage of massive data in the concept of cloud.The core idea is to manage the distributed storage resources in the cloud based on distributed file system and cluster technology to meet the data storage requirement.Cloud storage has the characteristics of elastic expansion,data backup,data management and low cost,and is widely used in production environments.These features of cloud storage are inseparable from the support of distributed file systems.The file management system in the cloud platform is designed to provide users with efficient and reliable file storage and management services.This thesis researches the design principles of several types of distributed file systems,and finally selects lightweight distributed file system FastDFS which has a good performance on redundant backup,load banlance and online capacity expansion.The design of FastDFS follows the principle of simple and efficient,and uses clustering mechanism and peer-to-peer structure to expand the cluster.The sophisticated file name design makes it suitable for storing small and medium files.This thesis will build a file management system based on FastDFS combined with distributed storage technology.This thesis firstly studies the system framework,file upload mechanism,file download mechanism,file name mechanism and file synchronization mechanism of FastDFS.Next this thesis analyzes and determines the requirements of function and performance for the file management system based on FastDFS.The functional requirements are based on file and directory functions,and performance requirements are based on system reliability and concurrent access.Then this thesis proposes the system framework of the file management system,and the detailed design and implementation of each module of the system,including basic functional module,directory module and file module.The directory module transforms the directory operation into a read or write operation on the directory file by designing a directory file,and implements the directory index function in the storage system,which is convenient for organizing and managing user files.The file module is the core module of the whole system,and it is also the key of the design and implementation of this thesis.The filemodule implements the deduplication function before file uploading,the caching function of file downloading,and the large file storage function,and improves and optimizes the file synchronization mechanism of FastDFS to further improve the reliability of the system.At the same time,the function of the FastDFS client connection pool is expanded to improve the system operation efficiency.Finally,the whole file management system is tested.The test results show that the file management system based on FastDFS under the cloud platform meets the expected design goals.