The Design And Implementation Of Distributed File Manage System Based On SeaweedFS

Since the 21st century,the internet has grown rapidly,accompanied by the explosion of information.These data for businesses have a great value.Therefore,how to store and manage data privately has become an essential task.Although the current cloud computing technology is quite mature,such as Ali Cloud OSS cloud storage technology.Storing some important and private files in the cloud is easy but inappropriate.With the exponential growth of data,simply by increasing the number of hard drives with OS cannot meet the requirement of data storage and management.Therefore,this thesis introduces the design and implementation of self-built distributed file system to provide a compromise solution to the problems of private data storage,data backup and so on.The system is based on the open source SeaweedFS file system which provides basic distributed storage and backup capabilities.The proxy module is directly builded with Spring Boot.MySQL is used as database and Druid as connection pool.Optional red is cache is used to speed up the data access and reduce DB load.The file management module uses MVC pattern and its front-end is based on Thymeleaf,combined with Bootstrap,jQuery and AJAX to display and update data in near real time.Firstly,this thesis describes the key technologies involved in the system,including SeaweedFS file system,Spring Boot,Druid connection pool,Redis cache,Thymeleaf,Bootstrap,etc.Secondly,it describes requirements analysis and design including the overall structure of the system,deployment architecture and database tables.It also explains the design details of each module in the system including file upload/download,file management,system management and file process modules.Lastly,it explains the realization of the functional modules,the SeaweedFS access module,the display effect of the system,and the application of the core technology.The system is currently in the trial phase.Applications are gradually migrating from the Alibaba Cloud OSS storage system to the distributed file management system.