| With the development of Virtual Reality(VR)and Augmented Reality(AR)technology,three-dimensional user interface beyond desktop has become a research hotspot in human-computer interaction.In 3D user interface,pen-based interaction simulates the real-world interaction,and users can operate object in a more natural and intuitive way.It reduces the cognitive distance between human and virtual scene,and enhances the user experience in telemedicine,education and training.As the most basic tasks in 3D pen-based user interface,target selection and manipulation mainly have two problems in speed and accuracy.For 3D interaction task such as wide range target manipulation,there is a mismatch between the user’s motor space and the display space,which reduces the speed of the target manipulation.The "Heisenberg effect" caused by the discrete input mechanism used for interaction intention expression reduces the accuracy of3 D target selection and manipulation tasks.The “rotation gesture” interaction technology for 3D pen-based input interface realizes rapid 3D interaction through continuous data input of handheld controller.It has been widely used in 3D interaction fields such as text input and menu selection,which provides a new method for improving the interaction efficiency of 3D user interface.However,due to constraints such as the lack of support plane in the 3D user interface,the application of rotation gesture to achieve accurate interaction in 3D space mainly faces three problems: inaccurate detection time of interaction intention expression,low accuracy of remote target selection,and insufficient scaling accuracy for wide range target manipulation.For the interaction intention expression,in the process of using continuous rotation data to express interaction intention,due to the inaccuracy of interaction intention expression time detection,there is a time deviation between interaction intention expression time and interaction intention detection time.This time deviation makes the direction degrees of freedom(DOF)of pen-based interaction tools offset,and finally reduces the pointing accuracy of pen-based interaction tools in the process of interaction intention expression.For the target selection task in the 3D user interface,due to the lack of plane support and the lack of stability during the controller operation process,the target selection method developed for the desktop interaction paradigm does not consider the characteristics of the 3D target selection process,which resulting in miss selection and wrong selection of the ray selection tool.For the target manipulation task,the current target manipulation methods for 3D user interfaces do not consider the difference between the translation DOF and the rotation DOF of the handheld controller in the target scaling performance.The depth characteristics of 3D pen-based user interfaces are not effectively integrated in the design of scaling interface.There is no existing interaction strategy for wide-range accurate target scaling.To solve above problems,this thesis develops a 3D user interface tool and software platform using a 6-DOF pen-based interaction device and a commercial HTC Vive controller.Based on the analysis of the 6-DOF data characteristics of the ray selection tool,combined with principal component analysis and other data processing methods,a method of interaction intention expression and recognition based on rotation gesture is proposed.The speed and accuracy requirements of target selection task and scaling task are analyzed,and the target selection method of 3D user interface based on rotation gesture is studied.This thesis compares the data difference between the translation DOF and the orientation DOF in the process of rotation gesture,and studies the three-dimensional user interface target scaling method based on the fusion of orientation DOF and translation DOF.This thesis aims to provide a reference for the development process of new interaction metaphors and interaction techniques in the development of 3D user interface.The main contributions and innovative work of this thesis are as follows:(1)A method of interaction intention expression and recognition for 3D pen-based device based on rotation gesture is proposed to solve the problem that the expression moment of interaction intention cannot be accurately detected in 3D user interface.In this method,the interference of discrete input such as keys on pen-based device is removed by rotation gesture with roll angle change of pen.According to the 6-DOF data characteristics of rotation gesture with pen,the problem of interaction intention recognition with rotating pen gesture is transformed into the problem of detection abnormal change signal of 6-DOF data of pen-based device,and the influence of data length on the accuracy of interaction intention recognition method of rotation gesture is determined.The experiment results show that the interaction intention expression method and interaction intention recognition method with Principal Component Analysis and Kernel Principal Component Analysis model reduce the influence of this effect,improving the pointing accuracy of the ray selection tool in the process of interaction intention expression by 0.5cm,and the recognition rate of interaction intention with rotation gesture is more than 95%.(2)A 3D target selection method based on rotation gesture is proposed to solve the problem of insufficient stability of 3D target selection with ray selection tool.On the basis of the recognition method of the interaction intention of the rotation gesture,a processing mechanism for the misrecognition of the interaction intention of the rotation gesture is designed according to the characteristics of the rotation gesture action’s 6-DOF data,which reduces the misrecognition rate of the interaction intention of the rotation gesture.A 6-DOF control display gain function of rotation gesture is established based on the interaction stage of target selection task,which ensures the stability of the ray selection tool and improves the accuracy of target selection.The experiment results show that the proposed method improves the accuracy of target selection by 10%.(3)A wide range and high precision target scaling method combining translation DOF and orientation DOF input is proposed to solve the problem of accurate manipulation of wide range target scaling scene in 3D interface manipulation tasks.The proposed method incorporates the difference in scaling speed and accuracy between translation and rotation DOF of the 6-DOF controller and between linear and nonlinear scaling.According to the orthogonal relationship between the two kinds of DOF operations,a second-order scaling operation model is proposed,which integrates the input of translation DOF and rotation DOF,and realizes the free switching of the two scaling modes.Experiment results show that the proposed method can reduce the scaling error by more than 55% without significantly increasing the scaling time in the wide range target scaling task. |
