Design And Realization Of Real-time Storage And Switching Technology For Massive Satellite Remote Sensing Data

With the development of human observing satellite systems,the amount of satellite remote sensing data exploded.Mass remote sensing data on today's storage system storage capacity,data availability and I / O performance and other aspects of the increasingly high demand.Simply using the system to provide asynchronous storage solutions or the use of distributed file system high-speed mass storage has been unable to meet the actual environment of large amounts of real-time data storage needs.How to store the massive remote sensing data more reliably and efficiently,ensure the high real-time performance of data service and realize the rapid sharing and distribution of satellite remote sensing data.It has become a hotspot in the field of satellite ground data processing.In this paper,we propose a real-time storage and exchange mechanism for massive satellite data based on shared file system and file cataloging information.At the same time,it is necessary to meet the requirements of real-time exchange of massive data in time index.This paper presents a real-time access switching mechanism for mass satellite data based on shared memory.The main work of this paper is as follows:(1)Research on real-time storage and exchange framework for mass satellite dataThis paper analyzes the problem of real-time storage and exchange of massive satellite data,analyzes and designs the overall hardware architecture,software architecture and data flow of real-time storage and exchange of massive satallite data.(2)Design and implement a real-time storage and exchange service for mass satellite data based on shared file system and real-time message push mechanism.Aiming at the requirement of low latency and the requirement of data exchange in demand storage of massive satellite data storage,a set of real-time and exchange service of massive satellite data based on shared file system and real-time message push mechanism is designed.To solve the massive satellite data stream stored in the process due to the occasional call blocking,resulting in the call is too high delay.As well as real-time data exchange between different operating systems by sharing file systems and real-time messaging mechanisms.(3)Design and implement real-time access exchange services for mass satellite data based on shared memory.For the massive satellite data storage business process,some specific scenarios of structured data,unstructured data query time demanding.According to the different types of query data,a set of real-time storage and exchange services of massive satellite data based on shared memory is designed.Aiming at the unstructured data,a real-time data exchange service based on Redis memory database is designed and implemented for the structured data,and real-time data access service based on TimesTen is designed and implemented.Design and implementation of the service in dealing with the corresponding type of data in the process,have achieved very good results.