A Quality Inspection System Based On Data Stage Project Document

Data Stage software is a integration tool that provides data integration solutions with a graphical user interface. Since the data integration process involve a lot of data processing and transform, managing multiple integration process, when users follow Data Stage optimization strategies and normative principles to improve data integration process, it can improve the efficiency of data processing effectively, saving system resource overhead, enhanced normative and legibility, reduce the maintenance costs.The objective of this thesis is aiming at data integration process established by Data Stage tool, build a platform that can obtain improvement proposals for data integration process through optimization strategy analysis. Due to the whole data integration process that can be described by.dsx format document which exported by Data Stage tool, so we can get optimization strategy determination and improvement proposals through analyzing the source code of this file, translating optimization strategy to rules and using code quality management methods.This thesis accomplished the following tasks: Introduced the theoretical background of the quality inspection system based on Data Stage project file, analyzed the current situation of optimization of Data Stage and code quality management, introduced the concepts and related technologies of this platform. We used Grails framework for the overall system architecture planning, design, development and management, integrated code quality management platform Sonar Qube, continuous integration tool Jenkins and version control tool SVN to build quality testing platform. Accomplished the Sonar Qube language plugin based on Data Stage project document, including parsing the.dsx document and coding the detection rules. Design and implementation of background system, including user authority management, quality detection workflow, processing of quality test result data, history retrieval, and describe the the quality testing process of Data Stage project document in detail.