Design And Implementation Of A Unified Access Method For EAST Experimental Data

EAST(Experimental Advanced Superconducting Tokamak)is the first fully su-perconducting magnetic confinement nuclear fusion experimental device independently designed and constructed in my country.The EAST experimental data is mainly divided into the physical diagnosis data of the discharge experiment and the engineering mon-itoring data of the device.At present,it is mainly stored in a heterogeneous storage system.With the development of fusion experiments and the continuous upgrading of experimental equipment,the total amount of data has continued to increase,and it has reached the PB level.Due to the scattered data storage and the inconsistent storage struc-ture,the mutual circulation of data is seriously hindered,resulting in the phenomenon of"data islands".The unified data access method not only integrates data from different sources and different formats,but also provides a unified data access interface,which effectively hides the storage location and storage structure of the data,and realizes the transparent access of the data.Therefore,with the development of fusion experiments and the upgrading of equipment,how to achieve efficient data integration and rapid access has become the key direction of fusion experiment data management.Based on the current storage status of EAST experimental data,this paper designs and implements a unified data access system,which mainly includes four modules:data integration,data transmission,data access and data security.The data integration module adopts middleware integration technology,which effectively realizes the rapid integration of multiple heterogeneous data sources.The data transmission module im-plements a high-concurrency,low-latency RPC framework based on technologies such as Protocol Buffers,thread pool,memory pool,and Reactor model,effectively reducing the complexity of data transmission.The data access module is mainly based on IDL(Interface Definition Language)technology,which implements a data access interface that supports multiple programming languages.At the same time,it also provides a visualization tool based on the Vue and Flask framework for data browsing and export.The data security module is based on dynamic token JWT and graph database Neo4j technology,which realizes identity authentication and authority authentication,and ef-fectively guarantees the security of data access.The system test results show that the EAST experimental data unified access sys-tem can quickly respond to user requests,support multi-user concurrency,and the data access interface and visualization tools are simple and easy to use.The system function and performance meet the design requirements.