The Reaserch And Implementation Of Data Quality Control Model Of Data Warehouse System In Tele-Communication Industry Based On ETL Tool

With the rapid computer technology development recently years, Data warehousing has been one of the core technologies to support enterprise business decision analysis and implement Customer Relationship Management. Data warehouse system has been implemented in many industries successfully such as Production, Retail, Finance service, Tele-communication and so on. But the problem is that during the implementation of one Data warehouse system we pay less attention on the control of data quality in the system. Actually today Data warehouse quality assurance is the footstone to instruct enterprises in maintaining and developing critical customers and business decisions. High efficiency and effective business decision mostly relies on the high quality data. However, current related theories need standardization and successful practice case. So how to eliminate the data errors to ensure high data quality in the data warehouse system is the core parts we discussed in this paper.In this paper the writer instructs one ETL model based on the universal workflow to achieve the data control. Base on this ETL model every workflow for filling the target table is classified into 3 standard steps which are Extract/Convert, Transform and Load-ing. In every step we should keep the complete records processing status logs for further reference. The detail data control methods during the ETL procedure are instructed. Also the architecture design and implementation in project are demonstrated clearly.With the extension using of the ETL model a module in the data warehouse system is designed for data examine and audit for further data quality assurance. By this module the data errors are classified into different types according to the business checking rules. The rules for verify the data quality and the check points are set up in the module. The checking rules according to the business rules can be enhanced timely and flexibly. With the help of this module the data quality control level has been improved dramatically.