Research On Key Problems Of Pen-Based 3D User Interface In A Large-scale Space

The pen-based three-dimensional interaction of large space can provide a more natural interactive experience,and has broad application prospects in the fields of virtual reality(VR),augmented reality(AR)and electronic whiteboard.Through the 3D pen-based user interface,people can easily interact with 3D scenes,capture ideas and record events,it extends the functions and dimensions of pen interaction.The development of computer graphics makes 3D virtual scenes more realistic and rich,and it puts forward higher requirements for 3D user interface.Therefore,the performance improvement and function expansion of the 3D pen-based user interface.has important practical application value.With the maturity of spatial positioning and sensor technologies,pen-based interaction is no longer limited to the two-dimensional user interface,however there are still two problems that need to be solved: The existing pen-based interactive interface is difficult to meet the ever-increasing performance requirements of three-dimensional virtual scenes,including object placement,object rotation and and some complex object selections in a 3d user interface.The research of pen-based 3d interaction is still mainly based on two-dimensional user interface,the application of multi-channel three-dimensional input information in pen-based interaction,such as three-dimensional position and posture,needs to be further explored.Therefore,based on the project team's ultrasound positioning three-dimensional interactive platform,this paper focuses on the two key issues,and the research content includes three aspects: Analyze the interactive motion process based on Fitts' law,and establish a three-dimensional interaction model of motion process.Study the accurate interaction based on progressive refinement to achieve efficient and precise interaction of basic tasks and complex interactive tasks in 3D interface.interaction.Introduce the pen-based metaphor based on depth location information to study the application of 3D pen input information in system control.The main innovations of this paper are as follows:(1)Aiming at the problem that the existing interaction model does not adequately analyze the interaction process,an interaction model of motion process based on Fitts' law is established.Different from Fitts' law's description of the interaction causal motion,the model aims to give a description of the interaction motion process,and then propose the theoretical path to improve the interaction efficiency by shorten the control phase duration: reduce the motion amplitude or accuracy requirement in the process of interactive motion.(2)Aiming at the problem of insufficient interaction accuracy in complex 3D scenes,an accurate interaction technology based on progressive refinement RAIPR(Rapid and Accurate Interaction by Progressive Refinement)is proposed.Based on the motion process,RAIPR technology realizes the improvement of interaction accuracy by progressively predicting the target position and giving CD(Control/Display)function,and then applies RAIPR technology to the basic tasks of 3D interface such as placement and rotation,as well as to the selection tasks in complex virtual scenes such as dense and visual occlusion environment.A three-dimensional interactive experiment platform is built.The experimental results show that RAIPR has some performance advantages compared with other accurate interaction technologies,and the performance advantage of RAIPR technology become more obvious when the interaction accuracy requirement is higher.(3)Aiming at the application problem of pen-based 3D input information,the paper introduces the pen-up metaphor based on depth information and proposes a system control technique based on the pen-up metaphor.In the framework of paper-pen metaphor,the user's pen-up movement in the depth direction is metaphorized into system control operation.Compare the interaction performance of three pen-based interaction technologies based on depth,tilt angle and rotation angle in system control tasks.The experimental results show that the system control based on depth information has shorter task completion time and higher task completion rate.