Design And Implementation Of Heterogeneous Data Source Integration And Transformation System Based On ETL

With the development of computer network technology, the management of manipulationand information is gradually depended on computer in many departments.Enterprises start to develop many application systems based on various software and hardwareplatform; consequently many abundant data sources are accumulated. These data sources arevaluable to the enterprise; they are eager to integrate these heterogeneous data sources, whichare separated in locations and self-government in management and heterogeneous in datamodule.This paper analyzed the domestic and foreign data integration research situation.According to the research, we propose and realize a framework of heterogeneous data sourceintegration and transformation system based on extraction, transformation and loading. Thesolutions of the system cater to a broad scope of data integration needs which collect datafrom the multiple heterogeneous source systems, cleanse this data, consolidate it, applytransformations, and load it in the data warehouse, data marts, OLAP (On-Line AnalyticalProcessing) structures, and analytical applications. With its graphical developmentenvironment user can design data integration job easily .The innovation of this paper is tobring up a model of heterogeneous data source integration and transformation system andbring up a method of ETL execution base on the component.