Design And Implementation Of Data Verification Engine In Soil And Water Conservation System

The soil and water conservation system comprehensively utilizes information to form a national interoperable geographic information network.The problem of soil erosion has led to flood disasters and the destruction of ecological balance.So,soil and water data are important.The data verification method in the soil and water conservation system has the following requirements:1.It needs to support automatic collection equipment for data verification 2.The rules are related to factors such as regions and seasons,and the rules change frequently,so it needs to adapt to the changes of the rules.3.With the development of soil and water conservation systems,there will be more and more data at monitoring points in the future,and it can write configuration rules for new data with low or no coding.4.The rules of different information systems are similar,but cannot be shared.Any information system development data validation requires software engineers to understand the rules and code in the information system,it needs to reduce the time cost of coding 5.It needs to support the validation of different data sources,including excel files and streaming data.The design and implementation of the data validation engine provides developers with the opportunity to solve the above problems.Through requirement analysis,data model and rule model,decouple rules and business systems.This paper entails designing and developing a data validation engine to address the problem that rules can be changed and configured.It is necessary to design the data transformation component so that the engine supports both excel data verification and streaming data verification;it is necessary to design the automatically generated configuration interface component,so that there is no need to develop a front-end interface when the data changes.In addition,the data validation engine also needs to address validation efficiency and scalability issues.This paper proposes a general solution for data validation and has been successfully applied to soil and water conservation systems.Solved the problem that data validation cannot be automated,and rule changes require coding.The data verification engine has changed the traditional development method and greatly improved the development efficiency.The business personnel who use the data validation engine can edit the rules,which is convenient to use.In addition to being used in soil and water conservation systems,the data verification engine can also be extended to other business systems,suitable for risk control in the financial industry,drug control in the medical industry,and promotion decision-making systems in the e-commerce industry.The validation rules preset by the engine can cover common data validation requirements.For more complex rules,the engine also reserves extension interfaces to support software engineers to modify the engine.This engine has high scalability and strong reusability.