The Design Of Multi-Touch Hci System Based On Target Tracking

In recent years，with the advances of technology，especially the rapiddevelopment of computer vision technology，the field of HCI（humancomputer）also has large changes，and the interaction based on mouse andkeyboard has gradually caused the boring of people. The appearance of aseries of emerging application, such as multi-touch screen, interactivewhiteboard, data gloves, gesture recognition system and so on, causeda great change in the field of HCI． Especially the emergence anddevelopment of multi-touch screen, multi-touch technology has alreadydrawn people’s attention.This article systematically expounded the relevant technologies ofmulti-touch HCI system based on target tracking, such as target detectiontechnology, multi-touch technology, HCI technology and so on, fromthe current situation and key technologies. And basing on this， thestyle of multi-touch HCI based on target tracking appeared. Unlike thecommon multi-touch system, this system pulled in the target trackingtechnology. By using image acquisition, the computer was pulled into thethree-dimensional system of people, instead of making the computer guidehuman’s behavior.For this type of multi-touch system, the article analyzed itsimplementation process and related cases. The implementation processincludes hardware and software two parts. The effect of hardware systemwas to build a suitable system environment to serve the software systemby using image acquisition, projection and computer. Software systemwas divided into target detection&tracking module and multi-media response module. Due to the three different tracking methods, the articledesigned three typical cases of multi-touch HCI system: multi-touchstereo booth, step-by-scene interactive display system and VR booksystem.The main research results and innovations of this paper was:(1) The article researched and realized the integration of targettracking technology and multi-touch technology, and provideda new interactive style for multi-touch system.(2) Due to the three target tracking styles, the article achievedthree systems of multi-touch HCI. From the instance, thisstyle of system was proved to be reasonable and innovative.