The Design And Implementation Of MiniQQ Project Data Storage Module

Today, the application of Internetwork has a feature of highly frequent massdata storage, random access and database query but quite low of data updating.Besides, people have proposed higher requirements on the concurrency of theInternet-based application. Faced with these challenges, the tradition database serverdoes not satisfy the current Internet needs at all. Hence, people begin to considerwhat kind of technologies and frameworks we should use to solve these problems,which brings about a series of new technologies, such as mass data storage, loadbalance, data replication, read/write splitting and transparent access. As a greatInternet-based application company, in order to provide the experience with betterquality for users, we must solve these problems during the daily development andconduct the long-term optimization. For this reason, the company comes up withsuch a mini program to study, laying a foundation for the future work and furtherresearch.This paper firstly makes a systematic analysis on the general requirements ofthe whole program and defines that this topic ought to solve the core problem basedon the realization of basic functions, such as mass data storage, high concurrentaccess, data coherence and disaster recovery. Next, in this essay, after it studies thesituation both at home and abroad, it combines the forming technology in thestorage module design of MiniQQ project to plan a set of solution and put it intopractice, meeting the basic function needs of the whole system, achieving thesupports of the mass data storage. Additionally, it is also able to support a certainquantity of high concurrent access and ensure the consistency and redundancy ofuser data. Finally, through the function and performance tests, it proves thefeasibility and validity of this solution.This paper mainly focuses on the description and analysis of the design&realization of this solution, including the design of the whole framework, theintroduction of relevant technologies, the application of data partition technologyand the utilization of replication technology, load balance and read/write splitting inthe high concurrent access and data coherence as well as the in-memory databaseuse in the data storage module.