Study Of Multi-parameter Pen Interaction Technology Based On Pen Gesture

Pen interaction is one of the important human-computer interaction technologies,especially for multi-channel interaction technology, which could provide perfect habituationthrough traditional pen metaphor. Pen as an input device has been used in more and moremobile devices due to its advantages such as short time learning curve, supporting directmanipulation, and ease of drawing and writing for users. However, the traditional pen devicesonly support x-y coordinate information on the pen tip, its characteristics hasn’t been usedadequately. Aiming at breaking through the traditional way of pen interaction and achieving amore natural and efficient interaction, this study provides2D pen gesture and3D pen gestureto trigger frequently-used commands so that develop a new kind of command layer inpen-based user interface.This paper involves two pen gestures which are2D-gesture and3D-gesture. For2D-gesture, this study uses x-y coordinate information on the pen tip to detect its motion curveand presents a template matching method based on the euler distance of x-y coordinate pointto achieve the2D-gesture recognition. For3D-gesture, this study calculates the projectedcoordinate of pen tail by monitoring the tilt angle and azimuth of the pen, so that the3D-gesture based on pen tail can be got. Then, make the projected coordinate combine with2D-gesture template matching method to achieve the3D-gesture recognition.Next, this study empirically investigates the speed, stability and accuracy of2D-gestureand3D-gesture by doing tasks according to different command symbol, and then discusses theprobable reasons why the performances of two input techniques were different and suggeststhe applicative symbol and appropriate device respectively. Experimental results indicate thatfor2D-gesture, thinking time is longer than painting time obviously, while there is learningeffect on thinking time. The more sample points, The lower matching rate. For differentsymbols, the matching rate of unclosed curve is higher than the closed ones while curvilinearones are easier to paint than rectilinear ones. When using3D-gesture, due to the hand structure,left direction ones are easier to operate than the right ones, but there is no difference betweendirection up and down.When comparing2D-gesture and3D-gesture, total time in3D-gesture is longer than it in 2D-gesture, but paint speed is quicker in3D-gesture. When sample points are64, the matchrate is higher in3D-gesture. From whole,2D-gesture is more suitable on direct device for thetetragonal structure symbols with curve element whose painting direction is right.3D-gestureis more suitable on indirect device for the up-down structure symbols with circular elementwhose painting direction is left. Finally, this paper presents future expectations in pen gestureinteraction and gives guidelines to pen interactive interface design.