Design And Implementation Of Metadata Storage Unit

With the information data rapid growth, the distributed file system of data storage came into being. Currently popular distributed file system uses a metadata and data separation management mechanism, which saves the file metadata and namespace in the metadata node, and saves the file data in the data node. All above in order to achieve efficient, scalable, secure and fast access. Therefore, storage of metadata in distributed storage system occupies a pivotal role in the entire distributed file system.This thesis mainly studies the distributed file system metadata storage unit, after understanding the high availability technology of metadata and in-depth research, based on predecessors’research design and research, the Cstore distributed file system metadata storage units were achieved, and completed part of the performance test.The main work of this thesis is as follows:1. Studied the current mainstream file systems and their design concepts and principles, focusing on the metadata management approaches. At the same time, metadata duties and metadata management approaches are elaborated.2. Studied the organization model commonly used in distributed file system, and introduced two categories of design patterns thoroughly:active/active mode and active/standby mode. At the same time, analyzed the advantages and disadvantages of these two models.3. Introduced the Cstore file system and the key involved technologies, and then proposed solutions to the problems uncounted the metadata storage unit service, including Master-slave Mechanism for data security and stability of services; Rules of the Hash Mapping for quickly locating of metadata to the metadata server and files to the data server.4. The above metadata storage unit, first has carried on the detailed design of the overall introduction, and then each module detailed design is given in the design of involved in the class diagram and data flow diagram, and the class of figure involved in the role of a detailed description and introduction.5. Tested the metadata storage unit cluster’s performance. Results showed that the metadata storage unit cluster can provide efficient and stable external metadata access and the performance reached the design requirements.