The Design And Realization About Standardized Data Gateway

Owing to the significant development of business, the information amount is increasing rapidly, which leads to multi-source, distributed, mass, heterogeneous, multi-format characteristic of operation information and higher requirement of operation capability for information system in our uint. A distributed deployed integrate information handle platform is demanded. To build this new type of information processing system,we need fistly achieve data integration and centralized storage management,which is from heterogeneous front-end business data acquisition system,standardized data gateway is the middleware system which writes original message from data source into the data container according to the defined metadata specification, this is vital and essential component of the system. It is in this issue such a demand under-developed.In this paper, our unit's problems about business data-processing have been collated into, we have researched and established the object-oriented,J2EE,network storage,metadata of technology-based line,we alse have designed and implemented standardized data gateway's every modules' procedure.In the data structure,we have researched and designed a unique grade structure of the database table of relational database being combinated with XMLType based on referring to the mainstream definition of meta-data format;In the storage equipment,we have studied and selected the storage architecture of NAS combinated with IP-SAN technology according to the scattered document and block device's needs;In the data processing,we have integrated and packageed DMC TextFilter,TRS CKM,Javamail and other content management components, and have achieved the extraction of content, language recognition, e-mail analysis, and summary of the subject, and other text extraction processing;In the data integration,we have designed and implemented multi-source data scanning, standardized metadata, bus-functional data exchange and other modules.The subject's research results have been into practical productive forces,and the program is running stablely and reliably, gateway has good prospect of application. The system's realization can make reference to implement and research of other similar information processing system about heterogeneous data integration or application integration.