Research On Scientific Database Management System

With the development of scientific research, huge amounts of scientific data hasbeen generated in various research fields, such as air quality information based ongeographical coordinates. Most of this data is organized in a multi-dimensional arraymodel structure.Relational database system and Key-Value database system have been widelyused in the commerce, with having achieved great success. But so far, because thestructure of scientific data is different from the tranditional data, the application ofthese commercial database systems in scientific research fields is confronted withmany problems difficult to overcome. Commercial relational database system andKey-Value database system will change the natural array structure of the data duringstorage or processing, and it will make follow-up data management and analysisbecome too complex to complete. Traditional commercial database systems can notmeet the needs of such scientific data management. So we should go to research anddevelop a new scientific data management system.This paper begins to collect the requirements of scientific data management incurrent scientific research fields. And we designed and implemented a prototypescientific data management system named SDBM. In the aspect of system architecture,SDBM uses a non-sharing distributed architecture, through a reliable message andtask mechanism to keep the stability of the system. In the aspect of storagemanagement, SDBM uses a write-once multi-dimensional array model. It guaranteesthe success of dynamic updating of the array data and keep efficient compressionstorage with an efficient version control mechanism. And it distributes all the arraydata to store on all the nodes in the cluster using a certain partition mechanism. In theaspect of data query, SDBM achieves a simple functional programming languagecalled AFL and provides query interface and programming interface for users. Finally,for verifying the feasibility of SDBM, we build a telescope system and a FITS filemanagement system based on SDBM.