Font Size: a A A

Design And Implement Of Data-Template-Based Scientific Data Processing Services Model

Posted on:2012-09-01Degree:MasterType:Thesis
Country:ChinaCandidate:Y G WangFull Text:PDF
GTID:2120330332989250Subject:Computer Science and Technology
Abstract/Summary:
Space science and technology is highly integrated technology, which adopts the development of many new disciplines and technologies, and has made great progress in practice, such as satellite communications, GPS navigation, meteorological observation, aviation and so on. China has a rapid development of space science and technology in recent years, but is still in the initial stage, which still lags behind the developed countries. With the development of China's aerospace and space technology, the demand for the protection of self-made space environment is increasingly urgent. The Meridian project is the response to this demand, which can run continuously and comprehensively, and will be a cross-regional, large-scale space environment observation network. The Meridian Project plays an important role for China's geographical advantages, as well as the access to space environmental data, the understanding of space weather and the prediction of weather.The instruments for monitoring space weather differ from each other and the observed scientific data has following features: the amount of the data is extremely large, information-rich metadata, a variety of data formats, contents and other characteristics. Faced with these complex data, how to effectively deal with the integration and processing of the data, access to the information we need, and further serve the scientific research is a great challenge and is extremely important.This paper mainly focus on the Meridian project's engineering data processing services, according to the Meridian project's needs, this model determines a standardized file format for space science data and data processing services. As for the raw data file structure and characteristics, product processing service model is designed based on Twisted's non-blocking asynchronous service model, the introduction of a "data template" for describing the raw data file, the"data template"file specifies the data structures, including the corresponding metadata description , data parsing, standardization, visualization and other operations, providing central control module and produce service module as well as the data processing, requests processing requests. It greatly improves the system's flexibility and scalability. The service model uses the CDF (Common Data Format) as a standard file format for observational data. CDF has a better self-descriptive, and flexible, scalable, easy to handle complex data and so on. This paper introduces the model of data processing concepts, subject background, followed by the template design and CDF file format to do in-depth research and analysis, and the detailed description for the product processing model of service framework, functional structures, and finally a brief description of the logical structure of the data processing model and the specific implementation.In addition, I also made a sum up for the data processing service model, Considering the processing services model's maintainability and scalability, I made some related prospects for this model.
Keywords/Search Tags:Space Weather, Data Template, CDF, Visualization, XML-RPC
Related items