The Research Of Some Key Technologies In The 3D HCI System

Being probably the most natural HCI method,3D natural interaction has attracted more and more attention in recent years. Compared with traditional mouse and keyboard devices, the 3D natural interaction makes the interaction system more immersive and easy to interact.We mainly focus on the two key technologies of the 3D HCI system:Planar target based AR registration and natural hand gesture interaction.For the Planar target based AR registration, a robust natural feature based parallel registration method is proposed. The method uses two threads for registration on a dual-core computer, one thread using KLT for tracking, while the other using Surf to reset the accumulated-errors. Delayed homograph is proposed to solve the problem of thread synchronization. At the same time, the idea of key-frame increased the accuracy and stability of the registration. The experiment results proved that the multi-thread method solved the problem of accumulated-errors, and it is a robust feature based real-time registration method.For the natural hand gesture interaction, two interaction situation are considered, in the situation of single camera interaction, we proposed an easy-to-use and inexpensive approach to track the hands accurately. Outstretched hand is detected by contour & curvature based detection techniques to initialize the tracking region. Robust multi-cue hand tracking is then achieved by velocity-weighted features and color cue. Experiments show that the proposed multi-cue hand tracking approach achieves continuous real-time results even for the situation of cluttered background. In the situation of two camera 3D hand gesture interaction, instead of reconstructing the whole hand structure, we extract some robust features from the 2D bare-hand images, and then reconstruct these features for 3D interaction. These features are concluded as Point, Line, Planar and Simple-Gesture interactions. We applied these features to several applications in AR systems and computer games for interaction. Experiments show that the accuracy and robustness can meet the requirements of the desktop...