Design And Implementation Of Data Warehouse Scheduling Subsystem In Traffic Management System

In the increasingly fierce competition in the current era of the Internet,the timely access to data to become the key to success of enterprise.Business intelligence consider getting information from the data as the purpose and data collection,management and analysis as means,and make user get better insight and decision-making power of the business market from the data.Data warehouse as a strategic set of all types of data,which support the decision-making process of all levels of enterprises,become the core of BI data modeling.The data warehouse of this subject includes three parts,which are the ETL process of the scattered data and the integrated data in the warehouse and the decision support to the upper layer application.The scheduling system plays an important role as the core control tool of the data warehouse.The research direction of this project is to design and implement a complete data warehouse scheduling system to process the data warehouse,to achieve a stable,efficient and fast processing data,and give a set of design principles of the data warehouse scheduling system for processing the data warehouse,and give the application of the design scheme based on the traffic management project.The data warehouse scheduling system is used as the data processing core in the traffic management project,which is responsible for the data collection,processing and storage of data collection,processing and storage.The data warehouse scheduling system of this subject should have the ability of three levels.1)Capacity of scheduling ETL workflow for processing of data from outside and inside of warehouse.2)Multi ETL capability,the different sources of the dispersion of data through different means,relying on the scheduling tool,after the acquisition,processing and persistence,for the upper application.3)Ability to visualize configuration and display for ease of use of the system.This paper proves the feasibility and practical value of the scheduling system and the design scheme of visual configuration interface based on the actual application data and application effect.