Research On MUSER Massive Data Storage And Retrieval Based On Non-relational Database

With the continuous development of astronomical technology,the methods of observing solar activity have shown a variety of trends.The amount of data generated by various observation methods has also increased dramatically over time.To better study the solar activity,the processing of these observations has become an important part of current astronomy.In particular,how to efficiently process and store the massive astronomical data generated by MUSER becomes particularly important.According to the requirements of MUSER massive data processing,this paper designs and develops an efficient and stable MUSER data storage and retrieval system based on the non-relational database Cassandra design.The main contents of the work are as follows:Firstly,based on the data processing requirements of MUSER,the MUSER data characteristics and storage requirements are analyzed,It is proposed that MUSER data processing in the traditional storage process is faced with a large amount of data,a large number of records,a complicated processing process,and a problem of data storage consistency.According to the characteristics of different non-relational databases,design performance experiments and select NoSQL database suitable for MUSER massive astronomical data.Secondly,The data modeling is conducted according to Cassandra data model,and the MUSER data is stored using Cassandra database.The adoption of the new storage model fundamentally solves the problem of data inconsistency faced by the separation of metadata and astronomical data in the traditional storage process,and avoids the inconsistency of MUSER data storage.And design NoSQL adapter to speed up data conversion and transfer rate.Thirdly,Unified storage for MUSER metadata and frame data,designed and realized the MUSER massive astronomical data management system,according to different database provides data retrieval and storage interface,at last,through contrast experiment,verified the Cassandra database when making MUSER data storage and retrieval has a good effect.In summary,the paper designs MUSER massive astronomical data management system based on Cassandra database.Under the premise of guaranteeing the consistency of MUSER astronomical data,it improves the management and processing efficiency of MUSER massive data.Also provides reference for other massive astronomical data processing.