Research On Usability Design And Recognition Of Gesture In Pen-based User Interface

Pen-based User Interface (Pen UI) is designed on pen/paper metaphor .It simulate the well-known paper and pen from device to interaction style and make use of the convenience for copy and modification. It offers a natural and efficient interactive way for users to work with.Gesture is the main command interaction method under the pen user interface. The usability of gesture interaction affects the usability of the whole system importantly. The motivation and goal of this paper is improving the usability of gesture interaction and utilize the predominance of pen-based user interface more fully.In this thesis, we work on three sides: design, recognition and application. We analyze the process of gesture design and use in pen-based user interface based on cognitive view, and bring forward design principles for gesture function and sketch to improve the usability. In the research on gesture recognition, we modify the recognize arithmetic by compute feature value based on character of human recognition. The modification improves the recognition efficiency without increasing the cost too highly. And solves the problems arose by difference between features used in recognition arithmetic and human cognition.We analyzed the requirement for gesture interaction in the main application domains, and build a gesture library based on the design principles brought in this paper and improved recognition arithmetic. The gesture library includes gesture commands of handwritten mathematics editing, gesture commands of common text editing and some simple graphic symbols without definite interactive meaning. The library can be used to improve the design efficiency and uniformity of pen UI.A pen-based user interface design tool is designed and implemented. Pen-based Interaction techniques are applied in the tool. Designers can use stylus to sketch scenarios of project and define dynamic transition between different scenarios with Scenario-based design method. The tool transforms the design result into internal user interface description, which can be interpreted to create pen-based user interface. This tool can largely short the time wasted on creating prototype of user interface, and therefore improves the efficiency of design and development of pen-basedapplications.