Research Of Virtual Job Management Environment Based On Jobflow

The massive parallel applications become more complex, along with the highperformance computing gains ground. More and more parallel jobs need to cooperate witheach other to complete the final task. The traditional job management systems focus on thesingle job, so they don't support the depending relationship very well and can't satisfy thenew requirement. On the other hand, the job management system should be more scalable inorder to adapt to the massive cluster and the multi-cluster system. To face the two challenges,we present the virtual job management environment based on jobflow.The virtual job management environment based on jobflow focuses on the jobflow,provides the integrated user environment and adapts to the existing job management systems.We define the jobflow as the job sequence which has the depending relationship. Thedepending relationship includes timing depending, data depending and so on. This papermainly discusses the jobflow modeling. Based on the Petri net theory, through a series ofdefinition and proof about jobflow net and soundness, we solve the two core problems ofjobflow modeling: effective process modeling and soundness verification. On this basis, wedesign and implement the jobflow engine based on event model and the user environmentbased on MVC pattern. The design not only solves the problem of jobflow modeling, but alsostrengthens the scalability of the jobflow system through the virtual job managementenvironment.First, the paper introduces the cluster and the job management system and then from thejobflow view, the typical job management systems are compared and analyzed with thesummary of their good and weak points. After that, the paper describes the features, theproblems to be solved and the system architecture of the virtual job management environmentbased on jobflow. Then the jobflow modeling based on the Petri net is researched and finally,the paper introduces the design and implementation of the jobflow engine based on eventmodel and the user environment based on MVC pattern.