Design And Implement Of Heterogeneous Data Integration System Based On Service Data Object

System integration plays a key role in the development of social informatization, and how to integrate heterogeneous data is an important part of system integration. The structures of data or the types of database(s) in each application may be different because of the lack of unified planning and management, the using of different storage technologies, etc. All of these make it difficult to achieve data integration.After several decades of development, there are a number of mature products and theories in the field of heterogeneous data integration, such as the federal database, data warehouse, data integration based on XML (extensible Markup Language) ,theories and technologies related to SOA (Service-Oriented Architecture) , etc. SOA has been developing rapidly in recent years and gained broad attention in the realm of heterogeneous data integration. SDO (Service Data Object) is one of the important components of SOA, which focuses on the field of heterogeneous data integration. As the whitepaper and APIs to implement SOA, SDO shields the technical details of the data sources for accessing, and provides robust support for public unified interfaces, views which enable applications, tools, and frameworks to more easily query, view, bind, update, and introspect data.This paper compares and analyzes the characteristics of various products and theories in the realm of data integration. SDO related theories and techniques are introduced in detail. Besides, this paper also extends the functions of SDO by implementing the data collection and integration from the semi-structured web data sources, and applies it in real systems. This paper further extends "Telephone Charge Collect System", by proposing a charging model which is applicable in many fields such as telephone fee and utility fee. At the same time, a new hierarchical system for web applications, "Mercantile Toll Collect System", is designed by combining the characteristics of SDO and the pattern of MVC. This new system is able to handle the heterogeneous data from different source/service providers, of which the key is to deal with the integration of heterogeneous data. By adopting the related SDO techniques and transforming the heterogeneous data to SDO DataGraph, the technical details of the heterogeneous data at the bottom level are well hidden from the users, which further help the implementation of the core functions in "Mercantile Toll Collect System". This system can query balance, achieve payment, manage clearing rules, transfer files, manage logs, download semi-structured data based on Web, convert data formats, and operate the data based on SDO, which has practical value.Extensive experiments on the "Mercantile Toll Collect System" are conducted, and the contributions of this work are summarized explicitly. In addition, a few opinions and suggestions on SDO are presented at the end.