A Study Of Hand Recognition And Virtual Input Technology

In recent years, with the rapid developments of information science and technology, all kinds of electronic products are available and spread widely. The traditional HCI means represented by the keyboard and mouse cannot meet people’s needs any longer. People are eager for more intelligent and convenient way to communicate with the computer. Due to its simpleness, intuition and nature, hand gestures become the first choice of the man-machine interactive way of the new generation. In this context, gesture recognition and the virtual input technology based on vision have become the focus at the moment.In this paper, we have done in-depth research on the gesture recognition and virtual input based on vision and have developed a new way of human-computer interaction based on monocular camera. The system only needs an ordinary monocular camera and a PC with typical configurations to achieve good static gesture recognition and fingertip detection. On this basis, we design virtual keyboards to input to the computer.First, the system combines skin detection and motion detection to achieve hand segmentation under complex backgrounds. After the hand sections are obtained, the template matching is done to recognize the static gesture simply and rapidly. The system can recognize 10 kinds of defined static gestures, with high accuracy and good instantaneity.Secondly, the system can detect fingertips on the basis of hand segmentation. After the centroid-distance method is used to sift candidate fingertips and other requirements are considered to exclude non-fingertips, the fingertips are confirmed. This algorithm can locate and remark the fingertips at the same time.It can detect the fingertips of single hand as well as double hands.It gains good performance under the simple backgrounds as well as complex backgrounds. Besides, it solves the problem of detection error when the hand is clenched and none finger is reached out.Finally, several virtual keyboard are designed and are used to input to the computers on the basis of fingertips detection. Thus,people can input to the computers with "fake keyboard" without any electrical characteristics, such as thin-film keyboards、projection keyboard.we can even free of any kinds of tangible keyboards to input on the desktops, on the wall and in the air without any keyboards.Moreover, the system has good extension feature.You can design your own keyboards according to individual needs or define any key’s meaning conveniently. It has a good application prospect.