The Design Of LeeFS Distributed File System

With the development of Internet services and the growth of Internet data in recent years, large storage area is undergoing a significant change. For Internet companies, the explosive growth of massive amounts of data is impacting their storage systems. Meanwhile, corporate requirements for data security are increasing. Facing the growing data, traditional architecture is powerless in expansion. When the user demand for more capacity and performance, only we can do is add or replace the advanced storage devices. Over time, the environment of storage will become difficult to manage. And managing and operating costs will rise sharply. At the same time, overly complex storage architecture can hardly satisfy the customers’requirements on data management and disaster recovery.LeeFS distributed file system is a custom system for Internet companies’ large-scale data storage, high concurrent data access requirements. And LeeFS is designed to provide a high availability, high security, easy to expand large-scale distributed storage services for Internet users and enterprise applications.LeeFS distributed file system consists of FUSE (Filesystem in Userspace) Client, master servers, data servers, monitor and deployment platform, and other system-level modules. It provides users a high-performance, extensible, easy to maintain storage platforms. With the user mode file system interface, the LeeFS distributed file system architecture transparent to the user, which greatly reduces the system access costs. Meanwhile, using SSH2 based secure transmission pipeline, the system provides security data transmission protect. This paper analyzes the LeeFS distributed file system requirements, design and deployment, discusses the design, implementation strategies on part of the core modules. The primary content of the paper is about:1. The LeeFS distributed storage system requirement analysis. With the nowadays distributed storage system design concept and the specific needs of specific business, designed the LeeFS distributed file system architecture.2. Introduced the development status of the current distributed file system, involving related technologies and design concepts.3. Discussed the architecture of the LeeFS distributed file system. Broke down the system’s core module and designed each specific sub-module, such as the master server, data server, etc.4. Combined with the development of Internet applications, looking for the future of the distributed file system.