Design And Implementation Of The Data Quality Control Subsystem Of A Master Data Management Platform

Master Data, the common data shared among enterprise applications, serves as the foundation of information system integration. Master data quality control is a kind of process that ensures the master data quality through related tools, techniques and a series of management processes, which is the core of the master data management. A group company has built a master data management platform, and fulfilled the management of a variety kinds of master data. But with the expansion of the scope of master data management and the growth of integration system quantity, it also faces a lot of problems, such as quality rules change frequently and the data size increases, which causes performance degradation and increasing difficulty of system integration, and restricts the quality control level of the master data management. Data quality control subsystem is a feasible solution to deal with these problems.According to the problems faced by the master data management platform and based on theory and practice the of master data quality control, this thesis presents a scheme for the isolation of the data rules and the master data service. The scheme separates the data quality rules from the master data services and decouples rule configuration from rule implementation referenced to the design principles of rule engine. Thus, a data quality control subsystem is implemented, which supports data rule profiling, verification, quality control and other functions.The major work completed by the author is as follows:(1) Designed a data rule database covering all kinds of master data quality control business which realizes the unified management of data rules, and designed a data rule management website that supports batch rules maintenance and single rule maintenance and provides convenient rule management services for the business user.(2) Proposed a strategy based on rule engine, and realized a rule engine which support standard conversion, normative verification, integrity verification and unique verification, and implemented a mechanism of flexible and efficient data quality verification, profiling and analysis.(3) Designed the system deployment plan and realized the high available system structure, and completed the validation and testing of the system function.Through the research, we have realized a master data quality control subsystem, which has been put into use in certain national groups. It is proved that the subsystem can provide reliable quality control services for master data management platform. The subsystem has the characteristics of strong performance, strong expansibility and high availability, and greatly reduces the complexity of the integration between the master data management platform and other business systems, effectively improves the master data management level. At the meantime, the subsystem generate new thoughts about master data quality control, and it will contribute certain valuable reference on domestic and foreign master data management fields.