SQL Management System Based On Key-value Storage

RDBMS have been successfully deployed in traditional application during the past several decades,while No SQL databases are emerging due to the rapid progress of mobile internet.However,as the continuous penetration of big data applications recently,RDBMS and No SQL systems are hard to address such new challenges like scalability,flexibility,high-performance and availability.Therefore,New SQL,combining the benefits of both,is proposed to meet these requirements.In RDBMS,it is mandatory to define the schemas in advance,and then it will be very efficient and simple to manipulate the structured data with SQL with the unacceptable price in case of schema modification.In contrast,No SQL systems are flexible to accept any data,thus good at scalability and performance,while its API is usually too simple to deal with complicated scenarios.As the cornerstone of No SQL systems,KV storage engine has been widely adopted.It is of great importance to add SQL support for KV engine.This thesis provides a complete solution based on existing frameworks and systems with the following major contribution:1.Design an architecture to support SQL for KV storage engine.The system consists of two parts basically: the user(upper)level parses the SQL syntax,while the stor-age(lower)level defines a consistent set of APIs for KV engine to hide the details of the storage systems.2.Improve the mapping method from schema to KV model.Based on the mapping solution of current databases,this thesis devises a new mapping method to support automatic loading and storing of meta information.The proposed method is more efficient than the existing solutions.3.Propose a new index design to support uniq columns and non-uniq columns to speed up the query operations.The prototype of the design is developed based on Calcite and Rocks DB.Common DDL,DML and DQL statements are supported,and My SQL compatible driver is used for the sake of many applications.The prototype is evaluated with jmeter with synthesized test cases.The results indicated that the design is valid and meet the goals.