Research On A Pen-Based 3D-HCI System

Human-Computer interaction(HCI) system contents the human, I/O Devices of the computer and its Human-Computer Interface. With the popularization of personal computers, HCI adopts the interactive way that is more natural, which means realizing personification that is the new orientation of the development of the HCI system. One of the finger can moves in 6 degrees of freedom(DOF) in 3D space, but its corresponding input Devices - mouses and keyboards, can gather the information of only one and two degrees of freedom respectively. So increasing degrees of freedom of the input Device is an urgent requirement. Now, various write boards, joy sticks are improved partially, which can't gather the information of 6DOF in 3D space. As the result, this paper researches a pen-based 3D-HCI system. It researches the following contents:Firstly, analyzes the functions and indices of performance of the system, and builds its model. Then, the paper establishes a concept model of a pen-based 3D-HCI device, which converts the positional-posture of the penholder to the revolving angles of six encoders by the mechanical tracker. Show the mathematical model which calculates the 3D coordinates according to values of the angles and realize the algorithm by C language for verifying the model.Secondly, based the computer graphics and OpenGL, realizes the 3D scene and a geometric model of a pencil. Moreover, make the scene more picturesque by using the mapping texture technology. Uses the lighting, shadows and blend effect to enhance the real sense.Thirdly, researches the generation of 3D animation and display animation by double buffer for achieving the goal, realtime interacting.At last, by building the test environment which consists of a 2 degrees mechanical tracker, DSP device, bluetooth, PC and the interface software, testes the 3D-HCI system synthetically. The result shows that the system has good realtime performance and the UI supports the pencil to move in the 6 degrees of freedom.