| New technology flight simulator, which is based on virtual reality, takes head-mounted display as scene equipment and takes data glove as interactive equipment. Although it has many good points such as lightness and cheapness, at the same time, operating in the cockpit is also be affected. For example, head-mounted display keeps real buttons and hand's movement out of the sight and data glove affects the feeling of touch and force feedback. To solve these problems, this paper proposes a new finger tracking method with video based on colored markers on fingertips. This method will not affect the feeling and force feedback while tracking the fingers. It is hoped to accomplish the tracking function instead of data glove.The core of tracking method, which is based on computer vision theory, is camera model. Before the camera calibration, a modified method of accurate line detection based on Hough transform is proposed to make the eigenvalue of template figure more precise. In the special environment of flight simulator cockpit, a modified calibration method with vanishing points is proposed to calculate the parameters of camera model accurately.Based on the camera model, fingers tracking process is accomplished. First, the redevelopment of image sampling card realizes the function of device connecting and data converting, and achieves the satisfied capturing effect while hand's motion is simple. Then, the method of deviding different fingers with colored markers on fingertips is proposed. Besides the reduction of identifying difficulty, it passes over the complicatied process of character matching. Finally, according to the multiplicte vision theory, four cameras are laid rationally to reduce the limit of hand's motion, when system will not be burdened by controlling of several cameras.The whole tracking method is proved correct and feasible by theoretical analyzing. And every segment of the method is proved very effective and reliable by experiment comparing. |
PDF Full Text Request