The Design And Implementation Of Application-driven Flow Scheduling Simulation Framework For Data Center

Network traffic scheduling has been a concern in the data center network study.Currently,big data applications bring higher requirements for transmission delay and network traffic control,which need further optimized network flow scheduling algorithm.At the same time,the existing network flow scheduling algorithms have no consideration for the execution logic of application.In addition,we need simulation tools to verify and analyze the design of network scheduling in the network study.However,the existing data center network simulation tools hava shortcomings in terms of network topology,distributed applications and many other emulation support,which can not meet the needs of new scheduling algorithm simulation.Therefore,we start to study application-driven network flow simulation platform and application-driven network flow scheduling algorithm.Specifically,the main work and contributions are as follows:Existing network simulation tools cannot support the simulation of execution logic on distributed application.With the consideration of this shortcoming,this paper presents a design and implementation of application-driven network flow simulation platform.In this platform,we add extra modules to support the simulation for distributed computing applications on the basis of network simulator ns-3.We use discrete event simulation strategy and an events insertion algorithm based on timeline to support the simulation of distributed computing execution logic.In addition,the Application module and Network module in this platform achieve co-simulation,which supports further network analyses.Compared with testbed experiment,the relative error of the simulation is less than 5%,which means this platform can support the simulation of task-aware network flow scheduling.Existing network flow scheduling has no consideration for the execution logic of application.With the consideration this shortcomings,we put forward an applicationdriven network flow scheduling algorithm.We propose Seflow abstraction,which includes both network flows and the dependency between network flows.This new network flow scheduling algorithm take into account both the network status and the semantic information of application.By analyzing the execution logic of application,the algorithm determines the priority of network flow based on dependencies between the different stages.Experimental results show that,network scheduling based on execution logic of application can enhance the network transmission performance in application level.