The Multidimensional NoSQL Web Framework Design And Application Based On Data Warehouse

With the development of network technology and information technology, enterprises are facing increasingly fierce market competition, the customer demand is more and more personalized, quick response to the market change has become the key for enterprises to win the competition. Emerge as the times require, the data warehouse is to satisfy and support the enterprise management decision, along with the popularization of Internet and Web technology and appearing of the concept of cloud computing, begin of using a large amount of data warehouses base on B/S application architecture. Then, with the development of Web2.0, demands of the database have been changed, The increasingly high demands of high concurrent read and write of data, massive data storage and access effectively, database high scalability and availability, but the consistency, realism, reading and writing of database transaction and the complexity of SQL query is not much demanded, so it is born out of a new type database which can adapt these demands above, is Non-relational database, which is NoSQL.The relational database is still the main media data storage, so in the construction of data warehouse mainly depend on relational database, but the query statement is far more than the modify and delete statement in the data warehouse, so the application of relational database is very few, this is a very suitable for NoSQL applications. The research object of this paper is based on non-relational database (NoSQL) Web data warehouse; the target is to complete a design of lightweight, efficient Web data warehouse model using non loose relationship data types, the main work of this paper are as follows.(1) First of all, to inducing and arrangement of the classic and latest research, making a brief overview of the concept and technology of data warehouse and non-relational data warehouse used in the paper, and analysis of the current research situation and application at home and abroad.(2) The thorough research of the structure and the constructing method of data warehouse system based on Web system. Web data, which is common in enterprise server and the HTML file of web site, consists of text, picture, sound, image content, etc. There is no strict definition and rigid structure of Web date which belongs to semi-structured and unstructured date. Due to the vast differences between Web date and conventional structured data, it is difficult to apply traditional data integration technologies to the building process of Web data warehouse. Three-Tier Data integration framework, which is composed of data layer, middleware layer and data warehouse layer, is needed to be designed based on the characteristics of web date. And the system structure of Web data warehouse, which is composed of presentation layer, application layer and data layer, is required.(3) Based on the construction process of MySQL data warehouse. Many Web2.0sites are developed based on open source software; the mainstream development framework of open source software is composed of the Linux operating system, Apache or Nginx server software and MySQL database. Because of universal application of MySQL as a database management system in Web2.0website, therefore, it is reduced installation, maintenance and learning cost solutions for Web2.0website based on MySQL data warehouse. This paper puts forward a solution which combined with Web data integration technology and Web architecture of a data warehouse based on MySQL data warehouse.(4) Design of NoSQL data warehouse multidimensional model and framework. Because of MySQL is a lightly and open source relational database management system, there are many defects and limitations in function and performance, simple to use MySQL to build the data warehouse has many problems, such as large amounts of data storage and query, high-speed read and write, distributed aspect. But NoSQL can solve these problems. Therefore the use of open source NoSQL Web to construct data warehouse with MySQL, especially multidimensional Web data warehouse can further improve the data warehouse statistics and analysis ability without a lot of investment.Through the several aspects of the study, this paper puts forward a solution which using open source software (NoSQL and MySQL) to build a data warehouse to help small and medium international enterprises to complete the data warehouse construction and provides the data support for the decision of enterprises, without more costs increased.