Font Size: a A A

The Design And Realization Of Storage Performance Acceleration Method Based On Cluster File System

Posted on:2018-08-31Degree:MasterType:Thesis
Country:ChinaCandidate:S X DengFull Text:PDF
GTID:2348330521951169Subject:Engineering
Abstract/Summary:PDF Full Text Request
In recent years,with the rapid development of cloud computing industry,cloud platform products have become an important factor in the production of enterprises and institutions,and bear many kinds of business.Storage system is an important part of cloud platform products,shouldering the storage and management of enterprise data.With the widespread use of virtual machines,they are getting more and getting bigger as the business grows.The performance of the storage system will directly affect the development of business.Therefore,improving the performance of the storage system will greatly improve the productivity of the enterprise.Based on the technical characteristics and current situation of the storage system of CAS cloud management platform of Hangzhou H3C Technologies Co.,Ltd.,this paper analyzes the business process and the storage performance of the storage system of the company's cloud platform,the method of using VAAI interface to speed up storage performance are studied.Then the principle of VAAI about accelerating on hardware,OCFS2 cluster file system and the technology of sg tool set are elaborated and analyzed.The VAAI interface is a set of application programming interfaces that can simplify the communication between storage hardware and hypervisor management.The principle analysis shows that through the VAAI API,storage array vendors'storage hardwares and applications can directly be integrated with virtual machines.Through VAAI,some work involving storage can be done off-line on storage array,which can improve storage performance from the hardware level as compared to be completed at the host end.The analysis of the OCFS2 cluster file system and the sg toolset technology shows that it is technically feasible to implement the functions defined by the VAAI interface in conjunction with the data distribution characteristics of the OCFS2 cluster file system on disk and using the sg tool set.Then,requirement analysis has been done and the storage performance acceleration subsystem is divided into three sub-modules:interface between front and back,accessing the deployment information of OCFS2 file system on the disk and full copy module.Then,according to the characteristics of business technology,each sub-module' function is designed.According to the needs of business,XML technology is used to develop the interface between the storage system and the front end,and VAAI XCOPY technology and the data distribution characteristics of OCFS2 file system on disks are used to implement storage system performance acceleration.Then,the performance acceleration module is designed in detail,and the overall function module diagram of the module is designed.Then,the concrete implementation of each sub-function module is encoded with Python programming language.Finally,the test of the storage system performance acceleration module is carried out,and the results of the test are analyzed.The test results show that,the storage performance of the system is obviously improved using VAAI XCOPY,and the host processor and memory resources and storage network bandwidth are reduced,which means that the expected target is achieved.In the simulated production environment,the storage system performance acceleration module is successfully integrated into the CAS III Enterprise Edition E0218 version and above.Post-use analysis showed that the speed of copying and migrating large volume files was significantly improved after enabling the acceleration module.Especially when the business system pressure is relatively large,the server host-side resources and storage network bandwidth are saved,which ensures the business be proceeded smoothly.
Keywords/Search Tags:Storage Performance, Cluster File System, VAAI, XCOPY
PDF Full Text Request
Related items