Research On HCI Technology Based On Multi-sensor Data Fusion Simulation System

The development of distributed information technology, sensor technology and network technology has contributed to multi-sensor data fusion technology, the technology has been widely used in various fields of military and civilian, play an active role in all aspects of people's production and life. At present, the research of multi-sensor data fusion is focused on the integration algorithm, the technology of human-computer interaction(HCI) is inadequate. Interaction aims to enable users to achieve a variety functions in a safe and effective way. The design will have a direct impact on the spread of the system, so the research of HCI on multi-sensor data fusion system has a strong theoretical and practical significance.The thesis studies HCI technology under the special environment of multi-sensor data fusion simulation system, and main research work are as follows:(1)Analyze the specific needs of multi-sensor data fusion simulation system, including function, performance, input and output, data management, security and so on.(2)Study some classic HCI models, analyze their strengths and weaknesses, combined with the specific needs of multi-sensor data fusion simulation system, task-oriented human-computer interaction model-PITA model (Presentation-Interaction-Task Management-Application) has been proposed, which divides the process of HCI into presentation layer, task layer, task management and application layer;(3) Analyze the similarities and differences in the structure between PITA model and MVC model, PITA-MVC implementation model is proposed by combining them;(4)Study the design of HCI in multi-sensor data fusion simulation system, based on PITA model and PITA-MVC implementation model, including system structure, system display style, interaction between the various parts of the system and the network transmission process between systems;(5)Achieve multi-sensor data fusion simulation system, achieve three dimension-al simulation interface, prompt interface, navigation interface and system interface; Taking into account the heterogeneity of different terminals, the system interface using adaptive technology to ensure the system can be used on different platforms; Achieve a variety of interactive technologies, including double buffering graphics technology, XOR graphics technology, Hawkeye technology and so on.The research of this thesis show that PITA model fits multi-sensor data fusion simulation system, it can satisfy the needs on function, performance, security and stability. PITA model supports dialogue independence, adaptive interfaces, application portability, controlled task and give user immediate feedback. Achieve multi-sensor data fusion simulation system, and many HCI technologies are used in the system.