The Actual Situation Integration Of 3d Human-computer Interaction Research

With the development of computer science, 3-Dimentional Human-Computer Interactive technology using Fusion Reality is starting be demanded in innovate Human-Computer Interaction. The Fusion Reality combines computer-graphics with real scene through video to enhance the user experience directly; while the 3D Human-Computer Interaction is an unconventional off-desk interactive technology, where users have more degrees of freedom in manipulation to achieve natural interaction. Therefore, introducing the Fusion Reality into 3D Human-Computer Interactive field can achieve direct and natural interaction and provide new conceptions and new approaches to Human-Computer Interactive Technology.Here proposed an linear object 3D tracking algorithm, then simulated and analyzed the tracking error, and made improvements in its application, including algorithmic and physical increasing the tracking stability and accuracy, and adding triggers that compatible with the buttons of USB mouse, and finished a prototype, Interactive Pen, which can be used as an 3D pointing device in 3D interaction.A critical technology in Fusion Reality is Registration, and vision-based planar tracking technology is being widely adopted. In the way of marker-based tracking, here developed and innovative marker-based tracking system that solved the traditional problem by tracking multiple marks, and increased the tracking precision.On another hand, based on marker-less tracking system, here introduced a blocking conception into texture matching algorithm, to tolerate the partial concealment of the target plane while tracking, and combined with virtual widgets that designed on the target plane, then finally developed an vision-based 6DOF(degree of freedom) input device, Interactive Pad.The final system combined the Interactive Pen and Interactive Pad as joint interactive devices, and here defined the basic operations and tasks, the model data structure, then designed user-level manipulations and graphic feedback, to fulfill the operation of create, select, translate and rotate, and sub-level edit.