Building The ETL Tool Of Data Warehouse Based On Workflow Engine And Driven By Metadata

With the development of the technology of Internet, database and Data Warehouse, the severe competition between enterprises resulting from economic globalization, more and more enterprises want to build their own Data Warehouse System which integrate a great deal of enterprise data which is dispersive and has different format, and want to get more useful information from it to advance their competitive ability. But implementing the ETL by hand prolong the period of building Data Warehouse System and result in the quality of data in Data Warehouse is bad. To solve the problem above, the text put forward the solution building the ETL Tool of Data Warehouse based on Workflow Engine and driven by Metadata. The solution shorten the period of building Data Warehouse System a lot, insure the quality of data in Data Warehouse and load new Business Data into Data Warehouse automatically and continuously. In the ETL Tool of Data Warehouse based on Workflow Engine and driven by Metadata, the Workflow Engine is responsible for managing the ETL Tasks, assigning the ETL Tasks and checking the restriction among the ETL Tasks, which solve complex scheduling among the ETL Tasks. Moreover, the ETL Tool saves all data about ETL into Metadata database as Metadata and drives data ETL by Metadata, which separate the ETL program code from concrete Business Logic, let the ETL program adapt the changes of the concrete Business Logic, and need not change the ETL program code when the concrete Business Logic changes.The text point out building the ETL Tool of Data Warehouse is essential after analyzing the concept, characteristic and architecture of Data Warehouse. Then, the text introduce and analyze the Workflow and Metadata technology, and put forward the solution building the ETL Tool of Data Warehouse based on Workflow Engine and driven by Metadata after analyzing the ETL Tool of Data Warehouse. And then, the text designs the architecture of the ETL Tool, implements the ETL Tool by Java under the architecture, tests the ETL Tool. At last, the text summarizes the ETL Tool, explains and expects the next work about building the ETL Tool of Data Warehouse.