Design And Implementation Of The MLFS Hierarchical Storage Management System

With the rapid development of the Internet and mobile communications technology,people are getting larger capacity and higher performance requirements of storagesystem capacity, especially as the development of cloud computing, large-capacity,high-performance storage management system will become an key component of thecloud computing platform. With the gradual popularization of cloud storage technology,the increasingly prominent contradiction between the high cost of high-performancestorage devices and mass data storage capacity is becoming more and more acute.Theincreasing complex of storage and maintenance, as well as the further increasedcapacity of storage system increase in the cost of storage systems management.Hierarchical storage management has always been a storage management focus, whichcan effectively solve the contradiction between high performance and large capacity.Based on the hierarchical storage management system, this article implement s theMLFS Hierarchical Storage Management System prototype, which achieves the goals ofrational allocation of system resources and improvement of system performance.First, this thesis propose a hierarchical storage management model, which not onlydivides the storage device into a high-performance level and mass storage level, andagainst the difference of distributed file system features, the model uses the Lustre,GlustreFS file system to manage the the storage system performance and mass storageresources. Based on the above-mentioned distributed file systems, archive thedevelopment of a virtual file system with unified storage resource view MLFS, andhierarchical management.Second, this thesis analyses the existing data migration algorithm, deep researcheson FV algorithm, which is well done in comprehensiveness of the data elementsconsidered and determine the accuracy of the data value, and implements the algorithmin MLFS.Third, this thesis uses Disksim simulator to compare FV with other algorithms, andtests the performance of MLFS on conditions of single-threaded and multi-threaded I/Oand verifies the effectiveness of the hierarchical management through building a readenvironment.