Research Of Gesture Library Building Based On Multi-Touch System

Today, multi-touch device, particularly multi-touch screen as input and also output device, has become a development trend of new generation of computer input devices. Multi-touch system is designed to overcome the traditional disadvantages of single-touch devices and make the input process more diverse, humane, and line with the operation habits of human natural action to avoid the complexity in remembering a series of shortcut keyboard setting. For accomplish the purpose, in addition to the multi-touch hardware support, the gesture library must be well designed and have corresponding properties.To build such a gesture library needs two aspects of support: One is a gesture classification that reflect the needs in the gesture developing process to be a base in building gesture library, and the other one is an useful method of testing the usability of gesture library. Therefore, in this paper we summarize the classification of user-defined Surface gestures and establish a taxonomy of gestures, named'Compositive Taxonomy Base On Developing Process', and use principles of this taxonomy to build two gesture libraries based on ActionScript 3.0 and the XNA platform, with revealing their process. In order to verify the usability of gesture libraries and explore a better method to do this, we design a series of test mission in a 3D interactive scene with a gesture library for multi-touch manipulating. By observing, recording, analysis and discussing we reach some conclusions and look forward to promote the future development and improvement of gestures library.