Research And Implementation Of Automatic Resource Allocation System For Nosql Cluster Based On Cloud Computing

With the development of new technologies, such as the Internet and cloud computing, it puts forward higher requirements for large data storage and management. At the same time, the new applications in cloud computing environment also put forward new requirements for cloud storage systems, such as large capacity, high concurrency, scalability etc.. At present, there have been nosql database systems which support dynamic increase or decrease in virtual nodes based on cloud computing, so as to meet the demand of large data scalability. It also ensures the system’s fault tolerance by replication strategy and effectively realizes the automatic management o f nosql database system based on the monitoring message coordination mechanism. This flexibility based on cloud computing conforms to the dynamic lease mode of pay-as-you- go, and improves the the utilization of system resources as well as services efficiency.Aiming at that large data management and storage systems in cloud computing need to manually extend or release resources, high efficiency and low cost, this paper puts forward an automatic management scheme of nosql cluster based on cloud computing. It designed and implemented an automatical configuration framework of nosql cluster with good scalability, adaptability and extensibility, which is named NACFrame. This framework supports dynamic variation of the workload. Finally on the basis of NACFrame, it realized an automatic configuration prototype system of nosql cluster.The research work of this paper mainly focuses on the following aspects,(1) This paper presents an automatic configuration technology of nosql cluster in cloud computing, which can automatically configure cluster resources according to system operation condition and dynamic load change.(2) This paper designed and implemented an automatic configuration framework of nosql cluster based on cloud platform, which is named NACFrame and provides an unified interface, supports all nosql database system and can widely be integrated with third-party cloud platforms, such as amazon EC2, openstack, eucalyptus etc..(3) On the basis of N ACFrame, this paper designed and implemented an automatic configuration system of nosql cluster based on cloud computing, which is named Nosman. It further validates the validity and applicability of NACFrame.(4) By function and performance test for Nosman, it can provide normal large data storage and management. In the case of users’ SLA, This system can automatically allocate nosql cluster resources along with the dynamic change of workload.