The Design And Optimization Of ETL In The First Tier Management And Analysis System Of China Mobile

ABSTRACT:ETL decimates the data from the OLTP system, integrates the data with different data source, comes to a corresponding data and then stored them into the Data warehouse. ETL is the basic building block to form and carry out the Date warehouse, which is an important component element of BI. It provides the Data warehouse with the corresponding connector and data for analysising and applying in the practice as well. And it also shields the complexed logical operations, which makes the Data warehouse process the data automatically. The Data warehouse can be used to collect, store and analysis the data so that it can have a better understanding of the status of the operation. It can also supply with the decision support, which is generally called OLAP system.This paper introduces the Data warehouse, ETL and its relevant theory, Teradata warehouse and the operating and analysising mechanism of ETL in the system. Based on those introductions, it further illustrates the core of ETL automatic conducting process in the first tier system. Then comes the conclusion of the faultiness in the data-operating process of the present ETL system; proposal of optimization actions for the ETL system; and the process of achieving those proposals. In the end, it introduces the development of the statement and its achievements in the ETL process, which includes obtaining the requirements of the statement, sorting out the statistical caliber, the developing of script, data checking and inspecting, checking the statistical caliber, the online allocation of the operations and so on.The first tier operating and analysising mechanism of China Mobile is a very successful case in this area. The ETL is an advanced technology in the world, and the processing speed of ETL determines the speed of the whole system in a very large extent. Therefore the research of maintenance and optimization of ETL has great significance and effect on first tier operating and analysising mechanism of China Mobile.