Unity Based Virtual View Of The Heterogeneous Data Integration Engine Research And Design

With the acceleration of information technology, many companies have set up their own information systems. However, due to the differences of specific business and functional division,various departments have built different information system platforms according to their own business, data information and the environment of computer software and hardware state. This has resulted in the different type of data information, including traditional database data and other structured, semi-structured data. In the field of international trade, the enterprise will also involve the electronic trade data, such as the EDIFACT standard data and ebXML standard data. Heterogeneous data have caused many problems for data exchange within the enterprise and between enterprises. So providing a platform for the enterprise which could shield the inconvenience caused by the underlying heterogeneous data through a unified query model,and easily achieves the data query and data exchange to enhance the efficiency of enterprises, is gradually becoming a problem need to be addressed.This thesis analyzed a number of solutions in the field of heterogeneous data integration, and designed a system architecture called heterogeneous data source integration engine based on the unified virtual view after a study based on XML technology and data mapping theory. This thesis presents a conceptual model of the unified virtual view, which is an XML-based data document model which defines the requests of data source, parameter substitution, processing rules and other metadata information. Script elements in the document model not only can describe the request of data source from the client, but also definition the data processing to achieve the function of data integration and data conversion. Especially designs the HDDocument, HDComponent and HDDriver document models, these models define the data processing processes and configuration informations.In this thesis,heterogeneous data source integration engine system consists of several modules.The main role is to achieve the function of parsing script of unified virtual view and data transmission. The system architecture of heterogeneous data source integration engine system including several major functional modules, such as connectors、script processor and adapters. Connectors provide the support for data transfer request on the network, script processor responsible for the parsing of the script elements, seamlessly connect to the underlying heterogeneous data through the adapters, then return the results to the users by the integrated document view.Finally, the thesis tests the relevant application cases with the heterogeneous data source integration engine. At the same time, making a summary of the research and design of the system and improving the further work.