Research And Application Of Real-time Data Integration In TQC-DS System

The BaoSteel Group Co., Ltd. has done a lot of work concerning the quality of products, the craftwork and the status of the equipment, and has obtained good achievement. But there is still a long way to go to achieve the goal of quality controlling, so it needs to make some researching and breakthrough based on existing foundation to form the ability of comprehensive diagnosis for the whole production line. The TQC-DS system is just developed in such situation. The TQC-DS system connects the existing monitoring systems of the production line, but the data formats of each monitoring system are different, so solving the heterogeneous of the data and achieving the sharing of the heterogeneous system data has become the desiderate problem for TQC-DS.Facing at the integration need of the heterogeneous data systems in TQC-DS, the thesis researches and presents a kind of real-time data integration system, which comprehensively analyses the architecture of the system, the hierarchical structure of the data schema and the description of the metadata. The thesis presents a three-layer data integration architecture, analyses each layer's data schema and the integration method of the schema, makes the researching on the metadata description architecture using for the integration and transformation of the heterogeneous data, and then presents an architecture for real-time data integration. In view of the data heterogeneous problem, the thesis presents a solution using the data fitting to predict the data that is not arrived in schedule time, discusses the applicable conditions and gives out the specific of the fitting algorithm. At the later part of the thesis, this thesis designs and implements a data integration system based on the real-time data integration architecture that discussed before. This thesis comprehensively analyzes the architecture, the data flow direction, and the network topology of this integration system. For some important modules of the system, this thesis comprehensively analyzes them and gives out their implements.The data integration system this thesis discussed and implemented is now apply to the TQC-DS system of the BaoSteel Group Co., Ltd. As an important component of the TQC-DS system, it has run for at least half a year, and is stable all the time. The data integration system connects BaoSteel's IBALOGIC, BPC, L3 and some other data sources, and presents good quality of data integration service for the TQC-DS comprehensive analysis sub system and other data applications, obtaining rather good operation effect.