Research And Implementation Of A Load Balancing Method For Cloud Storage System Of CSCloud

Load balancing was one of the hot issues in cloud storage research.At present,the load balancing technologies use in cloud storage system were mostly for the public cloud environment,and most of them are base on a static method which is designed in accordance with prior experience to achieve load balancing.However,it is difficult to meet the need of fast,scalability,resource utilization,deployment diversity and so on.In this paper,based on the analysis of existing load balancing technology and the CSCloud cloud storage system architecture for private cloud environment,a dynamic feedback load balancing method based on the real-time monitoring system was proposed,in which,the load information of each storage node was collected by control nodes in real time,based on the comprehensive evaluation of factors such as load state,node heterogeneity,number of users on node and system concurrency,the migration algorithm was trigged and then the rebalancing of load between nodes was completed according to the load migration strategy.When the unbalanced load of the nodes was perceived by the control nodes automatically,it could achieve the transformation of load with the fastest speed,the minimum number of times of migration and the maximum resource utilization rate,and the whole process was transparent to users.In addition to the research on the load balance between nodes,the data distribution on the storage nodes was also studied in this paper,and a data distribution method based on the segmentation of object ID was proposed.which could dynamically adjust the data distribution parameters,control the directory level and capacity,and improve the system's responsiveness to user demand in combination with the directory distribution collected by the monitoring system.The load balancing method proposed in this paper was implemented and applied in CSCloud system.By simulating various situations of load imbalance,such as heavy load of a single node,dynamic expansion of the system,node deletion and so on,the function and performance test for the unbalanced load were carried out.The results showed that the method could effectively realize the balanced distribution of load between nodes and even data distribution on nodes in real time.The method could not only apply to CSCloud system,but also provide a new idea and method for realizing load balancing in other cloud storage environment.