Research And Implementation Of High-performance Storage Systems NOSQL

As the web2.0rise and the rapid development of social networking sites, how to quicklyquery and processing huge amounts of data has become the focus of attention of majorcompanies. The efficiency of data processing can improve the user experience, and can savemanpower and material resources. Stable operation, high fault tolerance, fast data storage andprocessing scalability, easy to use, has become a typical feature of modern database systems.NOSQL databases are those non-relational databases, the definition is not very clear datastorage warehouse. It no longer uses the concept of the relational model, SQL databaseoperation statement gave up. NOSQL databases overcome the shortcomings of the RDBMSthat can be deployed on inexpensive hardware, support distributed, to transparent extensionnode. NOSQL databases typically store data in the form of Key-Value, with a characteristicpattern of freedom. Key-Value refers to a key name corresponds to a value that can beaccessed value by key, type any value, does not require pre-defined. Mode of liberty means nopre-defined database before using the data model. In a traditional RDBMS, if stored in anemployee’s information, you must first define an employee table and the fields, if you want toincrease employee information, you must modify the previous data model, and modeldatabases do not need freedom.This system is NOSQL the concept of a fast data storage systems to provide data to thebasic add, delete, change, check the function of automatically by the system to optimize thedata storage structure, improve system performance, the purpose is to efficient storage andquery data in response to today’s massive data processing and mass user requests, in addition,the system fault tolerance in the system, data backup, data disaster recovery have done someresearch to improve the system stability and the ability to adapt to the harsh environment [7].The system uses a Linux-based platform developed as the main language, C language, toensure portability and flexibility. Linux operating system on the server is far more than othersystems, to ensure the system can be used by different users. Through this system, the userthrough a simple operation can be efficient data management system can provide users withstable service. The subject of this study is how fast storage and query data. Including research on thedata storage structure: The main study is a data structure which can ensure that the data isstored and can provide a simple and efficient storage efficiency, while the location of the datastored on the study, namely the existence of a local hard disk or a memory; right Researchdata query structure: the main query data in what way, can provide a relatively short timedelay, especially when coping with large data; research on memory management: When allthe data stored in memory is that for on explicit memory management is particularlyimportant, a good memory management, data storage can lead to higher efficiency, highersystem stability and usability; deal with large amounts of data research requests: practicalapplication, the requested data is generally is quite large, single requests to improve dataprocessing speed is very important, even the best storage system can not handle data requestsquickly, then the overall storage performance is relatively low; on the c/s structure designstudy: design c/s, and can to some extent, to reduce the data processing sever-side pressure,preferably sever-side and client protocols, communication methods, the requested data canbe improved to a great extent, and the efficiency of success rate.The beginning of this paper describes a high-performance NOSQL background, purposeand significance, and the system feasibility and system requirements analysis, in a subsequentchapter introduces a modular division of the system and module design method and relatedalgorithm. Finally, the various modules of the system to make appropriate tests.