The Design And Implementation Of The Symphony System Resource Scheduling Based On Proportional Share Rule

As the amount of information appears the trend of growing exponentially in theinformation age, to extract the useful information in a large amount of data will bemore and more difficult for us in the future.The distributed computing framework’scomputing ability is good or not,its one of the main factor is that it is efficientscheduling strategy and design.In order to make the Symphony distributedcomputing software when parallel processing the multijob has more efficientcomputing ability, so we are going to design a new resource scheduling strategy forprocessing the multijob to make the cluster can get more reasonable allocation andeffective use.We will be design a kind of resource scheduling strategy based on proportionalshare criterion in this paper,this resource scheduling strategy when processing themultijob can be divide the resources of the cluster into different proportions foreach job,and this value is setted by the user according to each job priority,And thescheduling policy has been optimized and improved on the reasonable allocation ofresources and efficient use of resources.The goal of resource scheduling strategy isdesigned to make multijob when parallel computing can let each job according tothe priority of different to allocate the size of the cluster resources and then tocalculate,at the same time, make the limited cluster can get more reasonableutilization of resources to improve the ability of cluster computing.This paper mainly divided into cluster resource allocation module,the clusterresource scheduling module and the cluster resource use module,and the analysis indetail and implementation for each module.The cluster resource allocation modulewill first divide the original resource pool into the two different types of resourcepool and calculate how much slots should be allocated according to the algorithmicrule in each type pool.Cluster resource scheduling module is mainly depending onthe priority value of each job to decide each job should occupy how much shares indifferent type’s resource pool, and to actual schedule for each job tasks.Clusterresource use module is adopted bidirectional use technology to use the idle slots indifferent types’ resource pool to make one type task can borrow another type idleslot,so that more rational use the resources in the cluster. Finally, after reasonable design test cases to test the every module’s mainfunctions of the resource scheduling strategy, and the test results achieved the desiredeffect,it makes the cluster resources obtained an appropriate utilization and improvedthe computing performance of the cluster framework.