Design And Implementation Of Multi-User Data Fusion Subsystem In Soil And Water Conservation Dynamic Monitoring System

Dynamic monitoring of soil and water conservation refers to the regular or irregular monitoring and evaluation of soil and water conservation indicators such as land use,soil erosion,and vegetation cover to understand changes in soil and water resources,risk status,and ecological environmental quality,and provide scientific basis for soil and water conservation planning,decision-making,and management.Currently,there are significant differences in the monitoring data structure and standards among different administrative regions in China,and there is a lack of centralized data centers,resulting in low utilization and difficult data sharing of data resources.Therefore,this paper designs a multi-user data fusion subsystem for the massive multi-user data generated in the dynamic monitoring of soil and water conservation,which adopts a microservice architecture,proposes data coordination schemes from the aspects of data inflow,fusion,and circulation from the perspective of data services,and forms a unified data collection to provide data services for the monitoring system and other subsystems.The system has been successfully deployed and tested,and the proposed scheme has been proven to be correct,feasible,and meet the expected requirements.The main work content and implementation effects of the paper are as follows:1.In the data inflow aspect,a MinIO cluster is built to store multi-user files,and the original directory structure is maintained by LDAP to achieve a web-based efficient upload method for large files.The scheme supports concurrent upload,breakpoint resume,front-end direct upload,and other methods,supports uploading multiple files,folders,compressed packages,and other different types of files,and can correctly maintain their directory structure.2.In the data fusion aspect,a multi-user data fusion scheme is proposed based on the physical distributed storage of file data and the logically centralized management method,which integrates the file structure of multi-user data into the same resource directory tree,unified organization and management of multi-user data.3.In the data usage and sharing aspect,a layered access control model based on RBAC and ABAC configurable policies is proposed to achieve fine-grained access control of resource files.The access policy of any file can be flexibly configured to control the data permission scope of users from different parties.Finally,a data sharing scheme is proposed based on this,which ensures data circulation among different subjects and fully realizes data value.Data sharing is transformed into an open access permission,implementation data is not visible when available.