The Design And Implementation Of Data Collection Subsystem Of Meridian Project

Space weather is a relatively new discipline. It plays an important role in strategic interests, economic interests, the interests of science and technology, as well as education and other interests. Therefore, all countries attach importance to space weather research and accelerate the development of space weather research and monitoring. Compared with the United States and Europe, the research on space weather in China is still lagging way back and is still in the starting stage. Especially in space weather research, modeling and forecasting, China did nothing before. The Meridian Project is the state-level project which will fill this gap. The project covers the monitoring of space weather, space weather research, modeling and forecasting and so on. It is one of China's major scientific projects.The Data collection subsystem is an important element in the core issues of Meridian project. The subsystem collects data from all the nodes in the Meridian Project through the network, and carries out recording of basic information of data files, name standardization, raw data storage and so on. Based on the functional requirements analysis and system architecture design, the data collection subsystem can be divided into four parts: the client, the central control server, the collection server and the management client. The client is responsible for monitoring data collection and data uploading; the central control server is responsible for scheduling the collect servers and transmitting data files; the collection server is responsible for the collection of data files; the management client is responsible for providing management services for system administrator.In this paper, based on design and implementation of the data collection subsystem, the focus on the subsystem functional requirements, structural design, business processes as well as the use of key technologies. Especially in the face of problems such as scheduling the server cluster in the data center, converting the external network data to internal network data, as well as the communication technology between heterogeneous systems, this thesis elaborated several related load balancing algorithms, data gram address translation methods, as well as two implementations of Web Services technology, then provided the optimal solution so far conditions based on the characteristics of the data collection subsystem.Through unit test, functional test, system test, joint test and stress test, the requirements analysis, software design and implementation of the data collection subsystem fully meet the standard of the first phase of the meridian project. Moreover, taking into account the future expansion of the meridian project and the upgrading of system performance, this thesis conducted a more in-depth research and prospects in preparation for the future upgrade of the data collection system.