Research And Development Of Human-computer Interaction System Based On Intelligent Sandbox

The existing intelligent sandbox teaching demonstration system only supports traditional interaction methods such as mouse and keyboard.In order to further improve the user's sense of immersion and participation,this paper develops an intelligent sandbox human-computer interaction system based on gesture operation.The intelligent sandbox human-computer interaction system uses augmented reality technology,3D graphics modeling related technology,somatosensory development technology,and gesture recognition technology.This paper applies gesture recognition technology to intelligent sandbox.Use natural and direct gestures instead of mouse and keyboard input to get an interactive augmented reality experience without wearing any interactive equipment.Based on Kinect v1.8,this paper realizes the recognition of six gestures with one hand,multi-hand gesture recognition,and dynamic gesture recognition,thereby realizing the rich human-computer interaction function of the intelligent sandbox.It can trigger different weather systems and natural disaster systems according to different gestures of users,determine the relative positions of gestures and sandbox platforms and virtual objects on the platform,identify the palm trajectory of dynamic gestures,and place and move virtual objects on the sandbox.On the basis of the intelligent sandbox teaching demonstration system,the intelligent sandbox human-computer interaction system has developed six systems including terrain synchronization system,weather system,natural disaster system,military system,gesture interaction system and graphical interface system.Including basic functions,scene functions,interactive functions,synchronization functions,a total of four major functional modules.The intelligent sandbox human-computer interaction system applies gesture recognition technology to the intelligent sandbox,which further improves the functions of the intelligent sandbox,further improves the immersion of the intelligent sandbox system,and increases the sense of participation of the user group.Stimulated the user's interest in learning and innovation,cultivated the user's creativity,imagination and practical ability.