| China conducted the first national water resources census in 2010.In this survey,the soil erosion model,which mainly included soil erosion factors,soil erosion modulus and soil erosion intensity,was used to calculate the erosion modulus nationwide for the first time.In the dynamic monitoring program of soil erosion proposed by the Ministry of Water Resources.The dynamic monitoring also needs to use the soil erosion model to calculate the data in a large range.However,due to the limitation of technical means,most of the data is calculated manually,which is difficult to deal with a large number of computing tasks in many counties and monitoring areas of the country.On the other hand,As the soil erosion model research develops and the development of soil erosion sensitive factors,the calculation of soil loss equation has put forward higher requirements in scalability.But the calculation through the improvement of GIS and other methods exists many challenges.Based on the above background,this paper designed and implemented a data calculation system for soil and water conservation dynamic monitoring by means of distributed microservices,which modeled and managed tasks and various operators based on DAG workflow and calculated various operators in the soil erosion model using CSLE equation.The construction vision of this system is to enable the water conservation staff from all over the country to calculate a certain operator or the whole soil loss equation.To support the expansion of the operator,the calculation method of factors(unique to some regions)can be integrated into the soil loss equation through the system to participate in the calculation.At first,this paper based on the needs of the water conservation work,briefly describes overall demand,specifies the user type.Then the functional requirements and non-functional requirements of the system are both analyzed.System function is divided into task management,instance scheduling and instance calculation.Secondly,this paper makes a general design of the system,including designs of the hierarchy division,network structure,functional module division and database.Based on the microservice architecture,the system is divided into two categories of microservices,one is responsible for task management and scheduling,and the other is responsible for specific computing.Next,each functional module of the system is designed and implemented in detail,in which the design and implementation of DAG workflow is mainly described as the foundation of other functional modules.After that,UML class diagram and sequence diagram of each function are displayed.The components,data structure and business process of each module are analyzed.Finally,through the test of each function and the non-functional requirements of the system,this paper shows the realization interface and performance indicators of the system,so that all aspects of the system requirements can be met. |
