Design And Implementation Of A Metadata Integration System In Data Warehouse

With the rapid development of information and network technologies, more and more management information systems have been constructed among enterprises and in the departments of enterprises. However, these systems are not often interoperable and also are not able to communicate with one another to exchange information, which has resulted in the phenomenon of isolated information island, so-called"information island", the interconnections among businesses require enterprises to solve the problem of data exchange. Therefore, it's meaningful to solve the problem of data integration effectively. In recent years, the wide application of metadata has brought hope for enterprise data integration. The information on data structure and meaning contained in metadata can be very helpful for data integration. Therefore, metadata integration has been an important method for data integration.This paper has introduced the characteristics of metadata,requirements of metadata integration,design principles and aims of metadata intergration, and also the paper has introduced common warehouse metamodel(CWM), on introducing recent several popular solutions of metadata integration, it has presented a solution of metadata integration and analyzed the function of every part and system flow. This paper has laid emphasis on the extraction and storage part of the metadata integration system, introduced the implementation of these two parts. The aim of extraction is to extract specific metadata from relational databases for the preparation of load and storage. In the extraction part, with the knowledge of CWM this paper presents the range and objective of extraction, also the flow of extraction and the implementation algorithm. In the module of load and storage, firstly it gives out the structure of the module including keeping metadata in XML file storing in database and extracting metadata to build an XML file. Storage stratege is presented, storage model including keeping metadata in XML and storing metadata in database are introduced, and the algorithms are introduced.Experiment mainly shows that the performance of metadata extraction and storage, it shows that with the rules of extraction and storage algorithm the system could fulfill the job well, with good performance.