Research On Data Migration Technology Of Hybrid Cloud Storage

With the advent of big data wave coming,hybrid cloud storage as a new data storage mode has gradually been accepted and used by various industries.People is optimstic to the mode of hybrid cloud storage which it will become very potential. However,in fact user found some short comings in the design and implementation in existing hybrid cloud storage migration.It result in make not full use of private cloud and so on.For problems faced by in existing hybrid cloud storage about data migration,this paper proposed a new data migration technology which combine the hybrid cloud storage specific usage scenarios.The data migration technology more fast and more efficient to distinguish between hot and cold data of private clouds by combination NRU and LFU algorithm,taking into account the performance gap between write into and write out for private clouds, the characteristics of data migration between public and private clouds,this set three thresholds:data migration threshold,threshold of distinguish cold and hot data and the lower threshold of data migration to make a quantification operation for the time of data migration, the time of distinguish cold and hot data and the size of data migration. Meanwhile,using a local hot and cold data selection algorithm to choose the set of cold data migrated which ensure the size of data migration which migrate as much as possible cold date from private clouds to public clouds to reduce the number of migration operations,then will improve the efficiency of data migration.Choose better performance public clouds for hybrid cloud storage data migration by the use of multi-threading and upload or download some small files to real-time dynamic monitoring the performance of public clouds.We find the technology of data migration of the paper proposed compare with some of the existing hybrid cloud storage through simulated the test methods of file system to test the system performance.it can improve 10%-20% performance of hybrid cloud system and reduced about 20% of the cost of storage under ensure the hybrid cloud storage users to store Demand.