Internet Oriented Fusion Distributed File System

With the development of Internet technology and the emerging of innovative applications, the tremendous growth of different information made new demands to data storage.The traditional file system is unable to support the file data generated by the current rich web applications.In response to the growing storage needs proposed by the applications on the website, storage system for the Internet needs to have the following characteristics:First, it should be able to handle a large number of files; Second, it should be able to store multiple types of file, from text files of a few KB to larget video files of several GB; Last, it should have a high performance.In this paper, we will introduce a new distributed file system named FDFS(Fusion Distributed File System), which can handle the storage of a large number of various types of files. It draws on the experience in the design of existing distributed file system. It can store a huge number of files with different sizes and different types in the same system. With this, FDFS can greatly improve the utilization of physical space, reduce the complexity of system management.We will also propose the architecture of FDFS and some implementation strategies. This system uses a Master/Slave architecture model. There exist two center nodes, NameServer and MetaServer, whose responsibilities are managing the storage space and directory space of the system. The data file from customers is located on many DataServers, and customers can access their file using the API provied by the FDFS Client Library. "Block" is used as the unit to manage the physical space in FDFS. The system can merge multiple small files into a Block and split a large file to serverl Blocks automatically. In addition, FDFS offers a directory space to support the management of large files.