For Equipment Design And Realization Of The Etl Tools In The Data

In many military departments, for the reason of different information systems developed in different stage, furthermore, due to the special nature of the military, for security and confidentiality considerations, foreign manufacturers ETL tools cannot be directly used in the army, in addition to commitment to products, technologies and services prohibitively expensive cost, the information security will be threatened, some of the core data and information are likely to have been stolen, the country’s information security cannot be fully guaranteed. And now the operating system (NeoKylin), database (Kingbase, Dameng), and even computers are on the way of localization. So these military departments are eager to have their own research and development ETL tool which can meet their own needs and help them integrate these separate applications and databases in order to share information.In the research of the Equipment projects, according to the military want to support both online and offline data conversion needs, the paper designs a data transformation tool. In order to accomplish the tool, this paper studies the mapping technique between the relational model and XML model and gives the design and presentation of structure of XML data file and XML structure file, and proposes a method about how to describe the table structure, data types, integrity constraints and other information of relational model. In addition, the paper implements data extraction modules, the user can select the existing extraction rules or custom extraction rules, then according to the extraction rules to extract the required data from the source database, and the ability to automatically match the same structure database table reduces the workload of the user. Another characteristic of this paper is the application of Human Intelligence in the data cleaning process. The paper has revised the decision tree arithmetic to improve its automatism. It achieves to transform data in two-way that the transfer way and the merger way, and it gives settlement to conflicts in naming, data type and so on.This paper also describes the detail design and analysis on all parts of the data transformation tool and accomplishes it, the paper chooses DELPHI IDE. It implements classes of database operation based on ADO technology and designs human user interface. This paper implements the function of the data transformation tool and puts it into effect in data exchange system of Equipment project, and the data transformation tool completes the actual data test and achieves good results.