Design And Research Of Pen - Touch Interactive Gesture Based On Multi - Touch Interface

With the rapid development of human-computer interaction, intuitive operation mode of touch interface has been embraced by more and more users, which is directly reflected in the popularity of iphone and other touch-type electronic products currently. Due to interaction mode of touch input and hardware constitution, the touch interface still has two major problems:low precision of direct click, that fat finger problem; Hand cover inconvenience to the user operation. Many researchers have conducted numerous studies around the two main issues, from the perspectives of technology improvement of the interface and the experimental analysis of interactive features, they mainly focused on the problem of improving the accuracy of direct click input. Pen has the input feature of high precision by nature. Pen+touch interaction mode can solve the problem of interface input accuracy fundamentally, while retaining the interactive features of intuitive touch. In addition, the advantages of gestures are that natural and intuitive operation. But with the increase of the number of gestures, in order to reduce the similarity of gestures, it is bound to increase the complexity of the gestures constitution, however, which is contradictory to the features and advantages of gestures, and therefore we need to find balanced design between the two factors. Pen+Touch interaction broadens input channels, increasing input mode, which provides a possible that design to simple and efficient new pen+touch gestures. To sum up, pen+touch interactions fuse their advantages of pen and touch interactions, compensating for their defects when utilizing one of both in isolation and enriching interactive properties of interface designs. In essence, the mode of pen+touch interaction is derived from users’daily routine "a user hold a pen with one hand and perform some tasks such as sketch and annotation by cooperating with the other hand", which accords with the NUI design concept.In this paper we provide a novel hybrid gesture technique based on muti-touch and pen-enabled interaction interfaces that involves the two different input modalities, i.e., touch and pen inputs. This gesture design can fuse the advantages of both inputs from fingers and pens, which can alleviate the "fat finger" problem by introducing the accuracy input from pen-tips while retaining the natural and intuitive touch interaction features. we will utilize the achieved common touch events and pen (or finger) strokes to design pen+touch hybrid gestures, provide a general gesture design method for pen+touch inteaction interface. The gesture design includes six types of hybrid gestures that carefully consider the inherent properties of both touch and pens. In this paper we demonstrate them one by one in detail. A user study was designed and conducted to simply test and evaluate gestures we designed. The experimental results show that our proposed gesture technique is more effective and give users intuitive and natural performances. We also reveal design principles for designing gesture-based techniques in touch-based interfaces by demonstrating our technique and its applicable scenarios.