The Research And Implementation Of The Key Multi-touch Technology Based On Wii Remote

With the continuous extension of computer applications to various areas, the bottleneck effect of existing human-computer interaction (HCI) channel has become more and more obvious. Nowadays, pervasive computing and the people-oriented concept make natural HCI an important research orientation in the field of computer applications. Technologies as Multi-touch (MT), voice recognition, and gesture interaction have become typical technologies of a new generation in the field of HCI. At the early stage, the ordinary users were unable to get access to MT technology due to its complex technical principles and high prices. With the development of the computer processing power, MT technology no longer relies on expensive equipment. Devices based on cameras, sensors, capacitors and resistance appeared. Among them, the vision-based MT has become a recent research focus because of its advantages of low cost, extendibility, and easy building.After a deep and thorough study of the related technologies and principles of the current multi-point interactive devices, the author, inspired by the Wii Remote Whiteboard, has designed and realized a Wii Remote-based MT system. A new method of realizing the MT input technology (equipment) is offered in this paper. Compared with the common touch input technologies (equipment), it has the advantage of lower cost, and easy building. Vision-based MT system is composed of hardware and software, the hardware is the base of the system as interface and the software is responsible for image processing and application development.In addition, the implementation of the system less expensive and easier to build, but there are also sensors are not sensitive enough, location is not precise enough and so on.Because the Wii Remote has the capacity of detecting 4 infrared points simultaneously; two infrared LED pens are used as the infrared light source in the research to capture the position of the infrared LED pens on the screen with the help of the infrared camera. The signals captured are then processed through the Wii Remote and the two-dimensional coordinates are then worked out. The information of the coordinates is passed to the computer receiving software through the Bluetooth module. Appropriate software are then developed to get the message of the date and to realize the transformation of coordinates before the use of the value of the coordinate (x1, y1), (x2, y2) to realize MT's various features.Based on the above principles, the author has developed an application with the help of XNA 3.0 framework which could realize the image translation, scale and rotation and other operations. The feasibility of the MT system therefore gets initial verification. In addition, there will be a detailed study and analysis of some key technologies of the HID (Human Interface Device) protocol, Wii Remote and computer communication theory, the coordinates of the location and conversion, image manipulation and interference elimination concerned. Finally, some existing problems of the MT system are concluded and some suggestions are offered through several experiments.