Virtual Cluster Design And Implementation Based On Cloud Platform

Computational platform is a cloud-based integration of resources, the core virtualization technology, computing resource management programs through a series of cloud to provide users with various needs of the service platform. Type cloud computing platform has wide coverage and high efficiency in the use and allocation of resources based on user needs, etc., which offers more possibilities for the establishment of efficient large data processing scenarios.Due to the rapid development of modern information technology, built on a large physical server data processing environment, has been unable to meet the expanding scale and high-performance computing applications increase in complexity. The virtual cluster technology is an important tool for solving such problems, it has been widely applied to a variety of parallel computing environment, many large data problem has been a good deal in a virtual cluster environment. Therefore, in order to solve the many limitations of the traditional large data processing environment, create a virtual cluster environment on the cloud computing platform model has very important significance.This paper focuses on the design of a Openstack cloud platform Hadoop cluster environment. First introduced the Open Stack cloud platform and Hadoop cluster system, and then studied using the method based on Open Stack API interface to accomplish good communication between the virtual cluster environment and cluster management system; then designed a web-based application cluster environment management system; Finally, based on the above research environment to achieve a virtual cluster based cloud computing platform.(1) Cloud platform and implementation Hadoop cluster environment. Firstly Openstack open source project to build a cloud computing platform, the architecture and deployment platform for a detailed study. Then Hadoop cluster system for a simple introduction, also studied framework Hadoop cluster system and deployment scenarios, and lay a good foundation for creating a virtual cluster system.(2) Open Stack API usage. It explains the four ways Open Stack API request, studied the Open Stack API application development design ideas and how to use API interface for external users on multiple cloud platforms to access and change data. Open Stack API interfaces to provide complete data communication between a virtual cluster system and cluster management system. While parsing the specific use Open Stack API request four ways. They are the key to the interaction between the management system and the cloud platform.(3) Design and implementation of a virtual cluster management system. As a virtual cluster management system, which is an important way for users on the cloud platform virtual cluster resource use and demand settings. Here in the form of Web applications shows the basic design ideas virtual cluster management system, and the overall framework of the virtual cluster management system makes a further description. Use of existing basic design concept and overall framework, while the use of computer programming tools, completed the design and implementation process of the management system.(4) Cloud-based platform for virtual cluster implementation. On the basis of these three parts of the smooth realization of the above, through the relationship between them, link them up one by one, to achieve a virtual cluster system based on open source Open Stack cloud computing platform. At the same time, cloud-based platform for virtual cluster features were tested, proved good usability of the virtual cluster.