| This paper researches and designs the heterogeneous data integration and transformation system based on component technology. The data of the heterogeneous data sources are summarized, extracted, transformed and loaded to target database. So user can timely visit all sort of required data to enforce management and do correct decision.This paper firstly introduces the background knowledge, application present status of data integration and transformation system and current popular ETL tools, and defines the design goal and function request of the heterogeneous data integration and transformation system.Next this paper brings forward the framework of the heterogeneous data integration and transformation system based on Java and component technology. This paper discusses the design and implementation of the system, and explains the design of system's main modules in detail.Then this paper introduces the design and implementation of the transform function based on component technology. It expounds the design idea and implementation step of component model in detail. This paper also researches the definition and organization of component models, as well as the method of atomic component's making and the compound transform function's constructing by atomic components. Implementing transform function by component technology can greatly raise the system's expansibility, generality and flexibility.In the critical techniques of implementing system, storing the type mapping relationship with data type map makes transforming data type active. The expressions of mapping relation are analyzed to generate transformation rules. In order to manage, query and use components conveniently, using XML to manage their information is necessary. The multithread technology probabilizes extracting and transforming extensive data simultaneously. The using dynamic SQL technology implements more active transform functions.Finally, the paper makes summary of the work on the design and implementation of the heterogeneous data integration and transformation system, and discusses how to improve the system in the future. |
