Research And Application Of VR User Interface Pointing Behavior Based On Natural Gesture Interaction

With the emergence of interactive technologies such as virtual reality(VR)and augmented reality(AR),traditional computer-based user interfaces(GUI)cannot meet the requirements of emerging interactive technologies.In order to meet diverse and personalized interaction needs,users need to explore New interface forms,interaction methods and interface metaphors.The virtual reality user interface was born under this background.In order to better design the virtual reality user interface and improve the efficiency of natural human-computer interaction,this paper conducts a detailed study on gesture interaction and pointing behavior and proposes a method based on natural gesture interaction.The user interface points to the behavior method.This article mainly studies the following aspects:1.Human pointing behavior is a basic movement behavior in virtual reality interface interaction,which usually involves two related factors: user and interface.In order to conduct research on user interface pointing behavior,firstly,research on human-computer natural interaction technology and gesture interaction technology;secondly,analyze and study the human body pointing behavior and Fitts' s law principles,and then analyze the usability of the user interface to summarize the human body Pointing behavior characteristics and user interface usability methods;finally,it provides a method paradigm for constructing a user interface pointing behavior model based on natural gesture interaction.2.Constructed a user interface pointing behavior prediction model based on natural gesture interaction.The implementation of directed behavior takes virtual interactive technology and Fitts' s law theory as the carrier.In order to ensure the applicability of natural gesture interaction and improve the accuracy of the user's pointing behavior,the Leap Motion gesture-based interaction system framework is determined;the interaction logic between the three "gesture interaction-VR environment-three-dimensional interactive tasks" is discussed;The principles of natural gesture design and the semantic mapping relationship of gesture interaction are discussed.Finally,this paper uses the improved Fitts' law combined with the natural gesture interaction method to establish an effective method model for predicting the time of user interface pointing behavior.3.Designed a Leap Motion gesture placement task experiment based on Unity 3D.Most of the traditional user interface points are two-dimensional,that is,clicking the target task back and forth on the plane,and the interactive tools are also limited to traditional tools such as mouse and handle.This paper adopts a new experimental method to simulate the user's gestures or finger movements in a virtual reality environment to complete the task of placing objects.This method replaces the click behavior of the two-dimensional interface with pointing and placing behaviors,considering multiple factors.Methodological research.4.Developed a railway VR roaming experience system to verify the user interface pointing behavior method based on natural gesture interaction.Combined with UE4 and Leap Motion,a high-speed rail VR roaming experience system was developed,and the interface in the virtual reality system was designed.Through the above-mentioned research work,a set of theory and method system suitable for virtual reality user interface design was finally formed,which was verified in combination with an interface case of a high-speed rail VR roaming experience system.The example proves that the method in this paper has certain practical value for improving the design of virtual reality user interface.