Design And Implementation Of Data Middle Platform System Based On Microservice Architecture

With the rapid development of Io T technology,people are now living in an increasingly digital world.According to the law of large numbers,once the recorded data tends to be infinite,everything mapped in each business system will be replaced by data.Many businesses nowadays need to use data to participate in the process of production or business processing,and use data analysis results to assist business implementation,such as intelligent recommendation business.However,under the current status quo,the traditional production process of first business and then data can no longer meet the needs of the public,and the emergence of data middle platform has changed this traditional development ideas.It makes the data no longer appear as a subsidiary product of the business on the basis of creating value,but makes it directly used for business development,which not only speeds up the development efficiency between the foreground and the background,but also improves the innovation ability of the business department.On the basis of my own practical work,this paper designs,develops and implements a data middle platform system based on micro-service architecture.The final effect is that the data can be managed uniformly.Firstly,this paper briefly introduces the research status and system construction status of domestic and foreign data middle platform,and gives relevant technical and theoretical explanations.According to the problems to be solved and the relevant requirements of the business department,the corresponding demand analysis is carried out,and the corresponding process design is given for the functional requirements.At the same time,considering the limitations of the current single application system,the development of the system chooses the current popular Spring Cloud microservice framework.This paper abstracts and groups the micro-services involved in the system,which are roughly divided into micro-services of data access management,micro-services of data asset management,micro-services of metadata management,micro-services of data quality management,micro-services of data service management and micro-services of data security management.Then,based on these major micro-service systems,the design and implementation instructions of each micro-service module are given from the aspects of database design and interface implementation.Finally,the necessary functional tests and performance tests were carried out on the system.The test results shows that the system meets the development needs of the system in terms of security,stability,portability and other non-functional requirements.In addition,based on this system,relevant stakeholders of the system can not only realize the comprehensive and unified management of data under multiple data sources,but also use the data connected to the system to make more accurate decisions.