Study Of ETL Technology Implementation In Data Center Of CRM System In Futures

In recent years, with the continuous development of the futures industry, thefutures industry has become increasingly dependent on IT technology. Some systems,such as counter trading systems, clearing systems, asset management systems, officeautomation systems and financial systems have been built, but the application focuseson operations lacking of effective means of sharing information between varioussystems, which cause the formation of a large number of "islands of information" andthe lack of a strong business support, management control, business analysis anddecision support capabilities. In order to seek greater development, Futures companiesare in the positive change, shifting from the external expansion to the internalmanagement, from business-oriented to customer-centered and from commissionprice to service competition. In order to stand out in the fierce market competition,Futures companies must attach importance to the company’s core values.For futurescompanies, the customer is the real value, and customer relationship management(CRM), as the effective application of enhancing customer satisfaction, increasingcustomer loyalty and developing customer value is paid more and more attention toby domestic futures companies. Therefore, Building a data center-based CRM systemis a top priority.For the CRM system, building a comprehensive wealth of accurate customer datais the most important thing. In order to meet a variety of CRM applications, it isessential to establish a unified customer view and construct an enterprise-class datacenter. So ETL (Extract, Transform and Load) technology and database technology are the two most critical aspects in the construction process of the data center. The useof ETL applying the business data from the heterogeneous data by extracting,cleaning, transformation, and loading into the data ceter, provides high quality datafor the application of CRM.This thesis, based on CRM futures project I participated, elaborates Futures CRMdata center construction and planning, ORACLE RAC database system planning, ETLplanning and design. The ETL design and implementation of the system are the focusof this paper. There are some results are listed as follows:1) The research on ETL theory, including data warehouse technology, ODS, ETLtechnology and so on.It researches on the construction of data center of the data warehouse, ODS andETL technology, mainly including the system structure of data warehouse, ODSarchitecture, ETL data extraction, transformation, loading, metadata management,data quality assurance and real-time ETL related technologies.2) The planning and design of CRM system.According to the requirements of the CRM system, it focuses on planning anddesign of the data center, the ETL collection process, data extraction, data cleaningand conversion mode, and concurrent processing mode. Meanwhile, it also fucusesont the planning and design of the ORACLE RAC database system, storage system.3) The implementation of ETL in futures data center.According to the needs and characteristics of futures data center and the ETLtechnology, ETL process is designed in this paper, featuring the concurrent anddistributed processing ability, the support of a variety of data sources and the supportof a variety of data extraction and conversion. The ETL process is applied to the CRMdata center. The ETL has good scalability and certain innovation with the support of avariety of heterogeneous data source, parallel and load balancing, handling ability,quality assurance and so on.