A Research On Synchronization Technology Of Heterogeneous Structured Data

In the field of network resource management, directory service integrates fragmented basic data such as user information and physical device information to an authoritative data set. If a large number of applications use LDAP query to access authoritative data directly, it will bring high load and security threats to the directory server. Since most of the applications are built based on relational databases, the data synchronization mechanism established between the LDAP directory and relational databases could eliminate the data value difference between the two kinds of storages, and makes directory service share data effectively.Firstly, based on the research and analysis of existing heterogeneous database synchronization technology, and with consideration of the characteristics of the directory service in the source data side, as well as the existence of multiple heterogeneous relational databases in the target data side, the paper proposes a data synchronization scheme from LDAP directory to relational databases. This scheme uses hash shadow based method to capture change data of LDAP directory layer by layer. In the meantime, use memory database to improve the performance of data extraction. Synchronous data is packaged by JSON format for transmission. ODBC driver management could execute unified data manipulation for multiple target databases. Secondly, this paper describes the architecture, detailed module design and implementation of data synchronization system according to the synchronization scheme. Last but not least, the paper describes running instance and performance analysis of data synchronization system, and the summary of research result.