Researches And Applications Of Real-Time Data Warehouse Technology Based On Oracle

With the continuous development of information technology and emerging of mass data, the companies urgently need efficient, accurate and scientific analysis of data. The traditional data warehouse is usually updated in daily, weekly or monthly, that is to say, the data is not the latest. However, some information about electronic commerce, stock, online communication and etc. should be timely delivered to the workers and policy makers who will use this latest information to make policies or decisions as to dominate the market. In this way, the concept of real-time data warehouse was put forward.Currently, in the building process of real-time data warehouse, the biggest challenge is data extraction, transformation, cleansing and the work of lading real-time data into warehouse, that is, ETL process. In this article, it presents a real-time data warehouse loading method which can copy the table structure as well as set up query limits and other conditions to achieve the sustainable and efficient date loading, and also explains how to use real-time data warehouse architecture and the client terminal OLPT queries to make real-time data integration.For the realization of the real-time data warehouse technology, the relevant analyses are as follows:Firstly,the technology of real-time data warehouse is essential after analyzing the situation and application of real-time data warehouse.Secondly, a real-time data warehouse architecture which includes fact monitoring module, data conversion module, data storage module and real-time analysis module is proposed to overcome the shortcomings that the traditional data warehouse architecture can not meet the needs of real-time analysis.Thirdly, an immediate type of acquisition data method is applied to overcome the difficulties in extracting, transforming and loading data from the real-time data warehouse. Professional tools and internal development process are used to realize data conversion. The loading process is divided into three steps, namely, initial reproduction, periodically incremental loading and real-time updating.Finally, the structure of real-time data warehouse and OLAP query are adjusted, those technologies of coping the table structure, setting up query limits and etc. are adopted to accomplish the sustainable and efficient date loading, and the real-time data warehouse is packed and re-optimized in order to better apply the technology of real-time warehouse into the Golf comprehensive query and decision support systems.