| Human-computer interaction in Virtual Reality,as a cutting-edge application of humancomputer interaction technology,allows the operator to directly manipulate virtual objects in the virtual environment and obtain feedback on the operation in real time.Compared to traditional desktop keyboard and mouse interaction and touch screen interaction on flat panels,3D interaction in Virtual Reality is more intuitive and efficient,and can effectively improve the immersion and realism of human-environment interaction.In this paper we investigate the human-computer interaction technology in existing Virtual Reality systems,and find that the input and output of the interaction are subject to many limitations,such as: the positioning and tracking of the head-mounted display and handheld controller are easily affected by occlusion,and are also limited by the field of view of the positioning device;for haptic interaction in specific scenes,the corresponding prop recognition function is lacking,and low-cost flexible haptic sensors and their interaction technologies need further research;and the force haptic feedback is mostly limited by the size of the device,which is not easy to move.In response to these problems,we investigate the design and interaction technology of mobile Virtual Reality handheld controllers and propose corresponding solutions to each of these three aspects.Firstly,a new six-degree-of-freedom pose input system based on Visual-Inertial SLAM is proposed,which enables the handheld controller to obtain six-degree-of-freedom pose input in a wide range of scenes at a low cost,free from the limitations of occlusion and working range to complete the task of interaction with the virtual environment.We also investigate the user’s spatial perception of virtual objects in Virtual Reality,and proposes a pose-smoothing method to address the common problem of pose jumps in interactions.User experiments show that the pose-smoothing method can effectively reduce the user’s sense of anomaly when the poses of virtual objects jump and improve the immersion consistency of interaction.Secondly,for the tangible interaction and props recongnition in Virtual Reality,a discrete single-point touch control system based on the communication between microcontrollers is proposed in this paper,which can response and recongnize different touch point in real time in VR.The system uses the "virtual simulation system for teaching and training in police combat" as the application,to reproduce the police handling scenes and workflow,verifying that the system can realize the recognition of various props and complete various police tasks.At the same time,this paper further proposes a low-cost flexible tactile input device with high flexibility and extensibility,and studies its various interaction methods.Finally,for haptic feedback in Virtual Reality human-computer interaction,a handheld haptic feedback device is proposed that can control the shape of a brass tape using several motors according to the surface shape of the virtual object,thus realising a variety of shape feedback and softness feedback.Unlike most pin-based desktop shape feedback devices,the proposed handheld feedback device has good portability.Application experimental results show that the low-cost feedback device has good real-time performance and high realism in Virtual Reality haptic feedback applications. |
