Design And Implementation Of Microenvironment Monitoring Platform Storage System

With the continuous development of modern society,people pay more and more attention to the environmental characteristics and changes in a small range.In order to meet the needs of small-scale environmental monitoring,this thesis designs and develops a micro-environment monitoring platform.Aiming at the performance requirements of platform cache,high concurrency,read-write separation and real-time,this thesis designs and develops a storage system for micro-environment monitoring platform.In this thesis,the problems between micro-environment monitoring platform and mass data storage are studied.The research contents can be divided into three parts:(1)Design of high concurrency data interface.We design a high concurrent data interface and implements the server program.By using thread pool technology,the maximum data processing capacity can be achieved with a reasonable number of threads,and Http interface is used to complete the data transmission between gateway and server.(2)Design and optimization of database storage scheme based on read-write separation.According to the different requirements of different business data on different platforms,we design two separate storage modes of adding read-write database and data cache,in which the way of adding read-write database is to use MongoDB database as the main database and multiple MySQL databases as the main database.As a read library,the data caching method is to use Redis database as a memory database to achieve caching,and achieve high concurrency and real-time performance requirements of the platform.In addition,according to the different characteristics of the database storage data,this paper designs different optimization schemes for MySQL database and MonoDB database,to improve the utilization of the database and reduce the waste of resources.(3)Design and implementation of data storage Middleware.Combining with the requirement analysis of data storage in micro-environment monitoring platform and the specific business of the platform,a design scheme of data storage middleware suitable for this platform is put forward,and the scheme is designed in detail from two aspects of vertical slicing and horizontal slicing.This scheme improves the query efficiency of the micro-environment monitoring platform to the greatest extent.The experiment results show that when the platform accesses massive data,the whole platform runs stably,the storage efficiency is high,the data access is normal,and the real-time performance of the platform data can be guaranteed.The storage scheme designed in this thesis is feasible and effective.At the same time,this thesis summarizes the research,and puts forward the improvement ideas of platform design combined with the actual needs,which provides a reference for further in-depth study of the subject in the future.