Research On Display And Control Mechanism Of Virtual Space Controls Based On Gesture Natural Interaction

In recent years,with the booming of virtual reality,and mixed reality the display and design space of the human-computer interface has expanded from two-dimensional space to three-dimensional virtual space.The consequent emergence of various virtual and mixed reality applications has brought more feasibility to interface design.The display hardware of the virtual space includes multiple types of head-mounted displays,which is significantly different from the two-dimensional interface in terms of the display range,interaction equipment and interaction space.That leads to the fact that the traditional interaction methods applied to twodimensional screens are unsuitable for three-dimensional virtual spaces.Therefore,it is necessary to study the relationship between the interaction modes and the display mode of controls in the three-dimensional virtual environment.The natural interaction of hand gestures is one of the most commonly used interaction methods in virtual and mixed reality with headmounted displays as the display medium.The input characteristics of gesture interaction need to be fully considered in the design of virtual interaction controls.This article aims to start with the relevance of gesture interaction and interaction controls in virtual space and the study the basic specifications of design of virtual interaction controls.Through the combination of theoretical research,experimental research and empirical research,the association mechanism of natural gesture interaction and interaction controls of virtual space was explored in this research.First of all,analyzing the theoretical of human physiology and psycho-visual factors,the differences between the real world and the virtual world in human eyes is given,which can provide theoretical support for constructing a virtual space looking closer to the real world.Then,proved from two performance experiments of finger clicks in virtual reality,the effective interaction area of hand-eye collaboration and the reasonable control size in virtual space based on gesture interaction were clarified.Finally,as a smart home application was created as a design demonstration,the study results were integrated and applied through specific designs in mixed reality.Based on the results of the gesture click experiment,the design suggestions for interaction controls in the virtual space are summarized.The best operation area for hand-eye coordination should be set from 20° on the left side to 30° on the right side in the horizontal direction and from 15° on the top view to 20° on the down view in the vertical direction.For the finger-click control in the central area of the field of view,the minimum size is 2°,the optimal size is 2.9°;the minimum spacing is 1.4°,and the optimal spacing is 1.8°.In addition,the design threshold should be adjusted according to the location of the field of view.As the relationship between gesture input and interaction controls in virtual space is the center of research,this paper studies the range of interaction space and the arrangement of controls suitable for hand-eye cooperative operation in virtual space.A series of control threshold design suggestions that can be directly applied in practice are summarized.The results of this research not only provide a design basis for the improvement of the interactive experience in the virtual space but also provide theoretical support for the design of gesture interaction controls in the virtual space.