The Design And Implementation Of Tiered Storage With Object-based PNFS

Driven by the economic prosperity, traditional high performance storage systemssuch as SAN or NAS can’t meet the fast-growing requirements of massive dataprocessing in performance or scalability. The OSD-based pNFS effectively compensatesNFS in performance and scalability with separated data and metadata storage paths.On one hand, the users began to consider not only the performance but also thecost-performance ratio of storage, along with the growing needs of storage scalabilityand reliability. On the other hand, storage devices of different performance level tend toexist simultaneously within the users’ storage system, and higher-speed storage shouldbe used to improve the performance of entire system. Tiered storage technology is theeffective solution of those problems.Aimed at current situation，with deeply analyzing several mainstream networkstorage technologies, this paper advances a pNFS based distributed file system model,t-pNFS, integrating the tiered storage technology and object-based storage technology.This model can fully utilizing the flexibility of object storage devices, and featuringhigh-performance, high-reliability and scale-out scalability, and is suitable for high readperformance and throughput requirement. This model increases the performance byseveral measures, such as optimized hot data hot-data identification and cachingmechanism, and cache reclaiming policy.Finally, this paper tests the implementation, proving the correctness of the t-pNFSmodel and the availability of those technologies.