Font Size: a A A

Research On Optimal Scheduling Of Jobs Approach In Cloud

Posted on:2012-01-30Degree:MasterType:Thesis
Country:ChinaCandidate:X H HuiFull Text:PDF
GTID:2218330338453812Subject:Computer software and theory
Abstract/Summary:PDF Full Text Request
Cloud computing is a new business computing model, so far, Google, Yahoo, Microsoft, IBM, Amazon and some other famous cooperation has proposed their cloud computing application, and take development of cloud computing as the one of the most important strategies in the future. Cloud computing is the development of parallel computing, grid computing, distributed computing and which provide for the needs of users data resources and computing services on the Internet. The influence of customer requirements and resource distribution for the job scheduling is very large in cloud environment. Quality of Service for users is paid more attention in commerciality of cloud computing。In this paper, customer requirements were classified through customer's preferences. The basic classifications of job include several aspects, such as completion time of operation, bandwidth, cost, stability of demand and other aspects. Meanwhile, monitor the nodes in the cloud environment, inspection node resource properties, such as distance from the node to the data resources required, CPU, memory, cost, bandwidth, failure rate, etc. Classification of jobs by users and resources for evaluating the results of the node are mapping. According to the results of mapping the node select the appropriate implementation of operations as Manager.In some cloud environments, such as hadoop, take use of MapReduce mode scheduling, often using the Master/Worker level management model. Master node handled so much the relatively heavy work that the number of jobs requst was very limited。In the paper, we add Manager node into the system that we implement the Master/Manager/Worker three level management model for improving system throughput and improving the efficiency of the cloud environment management model .we proposed method of MultiLe(multi-management scheduling optimization)and support MultiLe's architecture.There are three roles in the MapReduce framework, such as user, Master, Worker and so on, and we add another roles Manager.Users submit jobs to the Master node.Through the needs of user for jobs and the information of node resource, Master node map both of them to access to the node Manager dynamically. Master node assigned the job to the Manager node.Manager splits the job into map and reduce tasks, assigned the tasks to the Worker to perform . Then split into Map Manager and Reduce Operating tasks. Although the system complexity increases by setting Manager, which can better meet the needs of business and the load of Master node was reduced effectively.Cloud computing system so as to enhance the throughput and improve the efficiency of the cloud environment.
Keywords/Search Tags:Cloud Computing, job scheduling, hadoop, MapReduce Multi-layer management
PDF Full Text Request
Related items