Research And Implementation Of Pub/Sub-based Data Integration Technology And Management System

Data integration is the demand of coordination among different departments inside enterprises, and its goal is to realize data sharing among heterogeneous data sources, so as to utilize resources effectively and attain high performance of the whole application system. Today with the advancement of computer and network technology, current enterprises computing is asynchronous,dynamic and loosely-couples. The traditional date integration framework can not meet the demand of getting more and updated data.The publish/subscribe communication mechanism is widely attended for its better scalability and capability of supporting dynamic, asynchronous and many-to-may communications between loosely-couples systems. It has been widely used in large-scale distributed applications.In this paper,with "The data exchange platform of Shandong National Taxation Bureau" as the application background, an enterprise data integration framework that is suitable for the distributed heterogeneous environment is proposed on the basis of the publish/subscribe communication mechanism. By analyzing publish/subscribe communication mechanism and using message-oriented middleware (MOM) product InforBroker, we implement the asynchronous, dynamic, scalable and loosely-coupled communication in the data integration framework. The message is translated and transformed in the adapter by applying the universal data representation technology based on XML. Finally, on the basis of JMX (Java Management Extensions),we have designed a data integration management platform based on Web and solved the management problem of the data integration platform in the distributed environment.The proposed data integration framework has been adopted successfully in the project of "The data exchange platform of Shandong National Taxation Bureau" .It is proved that the proposed publish/subscribe data integration framework facilitates the development of enterprise application systems and provides important technical support to the building of the enterprise data integration platform.