Research On Load Balancing Technology Of InfiniBand Network

High Performance Compute(HPC)has developed rapidly with the increasing computing power of the CPU.On the one hand,Infini Band interconnection architecture has become the mainstream common architecture in HPC network interconnection architecture due to its ultra-high bandwidth and ultra-low latency characteristics.On the other hand,the performance of high-performance computing networks is closely related to the topology structure,and the Dragonfly+ topology has been favored by many researchers due to its ultra-high scalability and low cost.However,with the increasing number of switches and links in HPC network,the applications of HPC are becoming more and more complex,some links in the HPC network become the bottleneck link,leading to the decline of overall network throughput and the increase of transmission delay.In order to balance the traffic on the bottleneck link and allocate the network bandwidth,the static load balancing algorithm and the dynamic load balancing algorithm based on Infini Band network for the Dragonfly+ topology are proposed respectively in this thesis.Aiming at the existing static load balancing algorithm based on Infini Band network,which has the problems of low link utilization and easy deadlock when it is applied to Dragonfly+ topology network.This thesis proposes a static load balancing algorithm based on a new deadlock-free strategy.By allocating a certain proportion of the traffic concentrated on the bottleneck link to the idle non-shortest path,the algorithm not only avoids the out-of-order data,but also improves the utilization rate of the network link.For the use of the non-shortest path deadlock problem,the thesis combined with static load balancing algorithm and the characteristics of Dragonfly+ topology,and design a deadlock-free mechanism,through specific LID(Local Identification)allocation and switches connected way to limit the use of certain direction path.Without the use of virtual channel to prevent the generation of the deadlock,this deadlock-free mechanism can be simply deployed.The network simulation results show that compared with the existing MLID scheme,MINHOP scheme and VAL scheme,and the throughput of the proposed scheme is improved by 61%,63% and 11% respectively in the near neighbor traffic mode.In view of the existing dynamic load balancing algorithm is applied to the Infini Band network,the existing configuration overhead is high,the deadlock prevention strategy depends on the switching virtual channel problems such as difficult to actual deployment,this thesis proposes a dynamic load balancing scheme,measuring the current congestion situation by the number of credit through integrated port,path length and the unfinished forwarding data length,and dynamic scheduling traffic in the network.In this scheme,packets with different SL(Service Level)are dynamically separated and forwarded to different paths when the middle group is turned,and the data competing for the same port resource is staggered on different virtual channels without switching the virtual channel,thus avoiding the generation of deadlock.This scheme has few changes to the existing Infini Band protocol specification,low cost and good load balancing performance.The network simulation results show that compared with the existing UGAL and PARX schemes,the proposed scheme achieves an average throughput increase of 26% and 14%respectively in the near-neighbor traffic mode.