The Man-machine Interactive Mode Based On Capturing Hand's Moving And It's Design

The usual way for human-computer interaction (such as a keyboard, mouse) are limited on a two-dimensional plane. Considering high price of data glove and bondage to hand as adorn and operation, we have developed a new type of human-computer interaction mode based on capturing a hand's moving. Two particular markers were affixed on handler's back hand and a finger tip respectively and using a single CCD camera to take of a series of images which of hand moving. To process and analyze these images using pinhole imaging mode. We can acquire markers'coordinate changers in the marker coordinates and achieve movement and button control of virtual mouse cursor. This non-contact man-machine interactive mode is easy set up and have low cost, so as to be applied to stereo vision, virtual reality, augmented reality and civil-class products. Our main researches content as follow:1. Theoretical analysis and system design: By analyzing various parts of the man-machine interactive system based on capturing a hand's moving, we determined the theoretical basis based on the pinhole imaging model and marker tracking algorithm. Considering the system design factors and the key issues to consider, choose the system's hardware and software platform, and ultimately determine the system's overall project.2. Had completed the development of system software using the chosen software development platform. Include five parts: which are the installation and configuration of the software development platform and hardware drivers, camera calibration, feature detection of marker, man-machine interaction process and human-computer interface design.3. Building a kind of man-machine interaction system based on Logitech camera. Had done experiment tests, we have obtained the most appropriate size of the markers connection between this mode's capability and the size of markers. At the same time, experimental results show the main technical parameters and product design program.4. Using Pointgrey industrial camera,we developed the man-machine interaction system,including the hardware architecture design, overall structure of this system and experiments effect of motion capture factor and different parameters.5. The whole system are summarized and analyzed, some suggestions have given for further research.