Research And Implementation Of A Multi-level Data Flow Graph Model Visualization System In In-situ Systems

With the continuous improvement of computing power,the amount of data obtained from numerical simulations of flow fields is exploding.However,the I/O speed of storage media such as hard drives has not increased further,resulting in unavoidable lag in post-processing and visualization of large-scale simulation data.Currently,most in-situ systems only focus on data input and final visualization output,and do not pay enough attention to the behavior of in-situ systems and the flow of data within them.This increases the cost for CFD researchers to understand the data and reduces their work efficiency.The work completed by this project is as follows:(1)To address the challenge of complex topological relationships in computational fluid dynamics scenarios,this research develops and designs an in-situ topological data structure to support the application of multi-level topological structures in large-scale data and provide support for CFD researchers to conduct research in complex topological relationships.In addition to representing complex topological relationships,this system also implements topological structure splitting and aggregation to achieve load balancing between nodes in a multi-cluster environment with large-scale data,avoiding the situation where other nodes hang due to the heavy workload of a single node and improving the overall operational efficiency of the in-situ system in a high-performance computing environment.(2)This project addresses the characteristics of multiple and incompatible subsystems in the in-situ visualization scenario,as well as the confusion and complexity of data processing during the process from the simulation sub-module to the visualization sub-module,and the fact that the in-situ system is too focused on input and output while ignoring the changes in data during the intermediate process.From the perspective of data flow,a data flow graph-based in-situ analysis system is designed and implemented,replacing the traditional task flow method in the original insitu system.(3)This project designs and implements a data flow graph visualization system for in-situ systems,providing users with visualization management and analysis functions for in-situ data flow graphs.