Research On Geographical Space-Time Big Data Management System Based On Distributed Storage

At present,China's BeiDou Navigation Satellite System has become increasingly mature and perfect,and the Internet of things technology has been comprehensively promoted,resulting in massive growth of geospatial data.This paper relies on the topic of "integration and visualization of big data in multi-earth space",a sub-project of "integration,association and collaborative cognition of big data in multi-earth space" of the national defense science and technology innovation zone project.On the distributed cluster platform,a structured development method is adopted to build a geographic spatio-temporal big data management system based on distributed storage,load balancing,WebGIS and data visualization technology,starting from the requirements and feasibility of the system,and integrating NoSQL database and GeoMesa,a spatio-temporal data management tool.The following research results are obtained:1.According to the data structure of spatio-temporal big data,combined with the advantages of real-time processing of distributed database and mass data storage,Cloudera Manager,CDH suite and GeoMesa,a big data management tool of big spatio-temporal data,are adopted to build a geographic spatio-temporal big data management platform,so as to realize fast storage and query of spatio-temporal big data.2.According to the data model of raster tile,using the advantage of cluster to solve the high concurrency of picture server,using Nginx load balancing technology,a raster tile cluster service system is built on three servers.3.According to the rendering model of the browser,data visualization algorithms for geographic spatio-temporal big data and raster tiles were designed.Taking wind field,thermal data and air quality index of meteorology as examples,Leftlet,a data visualization engine,was used to realize geographic spatio-temporal big data visualization.This paper mainly studies the geographical space and time of big data grid tiles and vector data of spatio-temporal data access,data visualization and standardization management technology,and based on distributed storage system is constructed of geographical space and time of big data management system,and with the wind,the thermodynamic data of meteorological and air quality index data,for example,realize the visualization of spatiotemporal data show.