Research And Implementation Of ETL Metadata Management System Based On CWM

With the popularization of information and the rapid development of database technology, enterprises are facing the demand of integrating data of different sources, providing decision support for enterprises and enhancing their competitiveness. Metadata is an important component of data warehouse, effectively implementation of metadata management is the key to the data warehouse project.As the ETL tools are too expensive,and manual coding has greater flexibility and strong adaptability,most of the Data Warehouse developers chose manual coding.But the most important issue of manual coding is it's chaotic management on metadata. To solve the above issue, this paper proposes the thought of developing ETL metadata management system based on CWM.The main characteristic of this paper is that,it concernes about the ETL data flow, not the control flow,it clearly tells the user what are the source datas, how to transform,and what kinds of data set is obtained.In this paper,firstly introduced the basic concept and functional structure of ETL, and the concept, classification, management model and effects of metadata. Then researched the theories , design principles, framework, relational package and the relationship between packages of CWM.Next, designed the function module ,metamodel and physical model for the manual ETL metadata management system. Finally, researched, designed and implemented of the ETL metadata management system based on CWM,and introduced the web framework of the whole system, the overall scheme and the key technologies used in the implementation.This paper focuses on the design and research the model of ETL metadata management,and has done some exploration to principles, and the technologies of model design and implementation, has certain practical value.