Design And Implementation Of The Massive Heterogeneous Data Integration System

With the continuous development of the information and the increase of data, we have accumulated massive data in different fields and at the same time, the requirement of sharing information has more and more improved. But however, in different fields or enterprises, there may be significant differences in the organizational form of the data between loose-distributing data sources, which makes the sharing of data great difficult. The emergence of massive heterogeneous data integration system solves this problem.In this paper, we create a prompt integration system called the MassDIS using great effective design and realization. The main work includes the following aspects:1. Investigate and study the main domestic and foreign data integration programs. By comparing the advantages and disadvantages of different data integration solutions, we suggested a solution based on the actual situation of the specific problems;2. Study the development of this massive heterogeneous data integration system, and choose the key technologies involved for the actual situation of the system to learn in-depth;3. Design and implement a massive heterogeneous data integration system based on the data view and artificial neural networks, which can provide a unified end-user data view.The results when using this system showed that in the aspects of data processing efficiency, data throughput, scalability, security, accuracy and user-friendly interface described in this article, the heterogeneous data integration system has reached a high level and also enlightens the way we dispose the massive heterogeneous data integration.