Research And Application Of Cloud Data Management Technology Based On MongoDB

With the rapid development of Internet web2.0technologies and the growth of the amount of data, how to efficiently store, process and extract large amounts of data becomes an urgent problem, cloud computing emerged in this context. The continuous development and evolution of the application areas promote the changes in data storage and management, and appear lots of new data management technology. With the rise of cloud computing, and traditional relational databases face a variety of pressures and challenges, such as mass data storage and management, high availability and high scalability, the cloud data management becomes a very popular field of study. Considering the characteristics and needs of cloud computing, and learning from the experience of the existing data management techniques, research and develop data management systems for cloud computing have become an important research topic, which has great theoretical and practical significance.As an effective solution for cloud data management, NoSQL systems regard the high availability, high scalability and support huge amounts of data as the goal, and widely used in cloud computing. In this paper, research and application are based on MongoDB database which is a typical representative of the NoSQL system. The main research contents are as follows:This paper starts with the concept and characteristics of cloud computing, and analysis the challenges of cloud data management. The paper introduce the concept, characteristics and theoretical basis of the NoSQL systems,.analysis the design principles and features of the mainstream NoSQL systems, and compare the NoSQL systems with the traditional relational database in the data model, system architecture, scalability and other aspects. Conclude by analyzing and comparing:under cloud computing environment, NoSQL system is superior to the traditional relational database.Then, this paper analyzes framework and principles of highly scalable cluster in MongoDB database. We study the balancing algorithm in Auto-Sharding cluster, and in order to solve the problem of uneven distribution of data, an improved algorithm which based on the frequency of data operation is proposed. Finally, we implement and test the improved algorithm which can improve the cluster’s concurrent read and write performance. Finally, for the problems of existing Digital Resource Management System, analysis the feasibility of MongoDB modeling, design and implement a highly scalable, highly reliable Digital Resource Management System based on MongoDB.