Research On Real-time Data Warehouse Access Strategy

With the rapid development of information technology,the data generated by Business Intelligence system(BI)is increasingly important in daily operations of enterprises.Traditional data warehouse load cycle data is fixed and longer,often not timely response business-related information(such as government policy changes on the industry,changes in market demand for commodities)are rapidly changing,can only provide the existing historical data query and analysis capabilities,and therefore an urgent need for real-time enterprises,efficient data processing tools to capture,analyze real-time data to help businesses to determine the first time to make decisions.Real-time data warehouse technology,traditional data warehouse technology as an extension to the rapid change data capture,and complete and efficient real-time analysis capabilities to meet the needs of enterprises.Data access without delay of processing is one of the key technologies on real-time data warehousing.To the real-time data warehouse systems,real-time data efficiently,without delay access to treatment is a challenging task.Therefore,it is very important to study the real-time data access strategy in real-time data warehouse for the development of real-time data warehouse.In this thesis,we carry out a serious and comprehensive analysis of the research status on real-time data warehouse processing technology,traditional data warehouse,OLAP technology.We also design the architecture of an improved real-time data warehouse and real-time data discussed in this thesis warehouse access processing technology application scenarios.And technology for real-time data access new features focuses on the difficulties of achieving real-time data access technology: When the data query and update operations are performed simultaneously,will lead to a certain point in the fact table for some records in the query and update performance bottlenecks(ie,query conflicts);at the time when the ETL load data to the data warehouse,users may frequently executed queries,then this article should consider if they would want the new incoming data into results(ie,query accuracy problems).For these problems,a dynamic image based data access technology is proposed.By independent of the data warehouse to create dynamic memory storage area,the changed data in real-time data warehouse import homologous to the list of ways temporarily stored in dynamic storage area.Then,the real-time data warehouse is loaded after carrying out the operations of OLAP.It effectively guarantees the accuracy of the results of the query and avoids the query competition which greatly improves the query efficiency.