Pen-Based Interaction Method And Its Application Based On The Handwriting Force Vector

With the development of pervasive computing, pen-based interaction (PBI) as a natural human-computer interaction (HCI) has become a growing concern and research focus. In the traditional pen-paper interaction, handwriting is the trajectory of the writing pen’s contact movement on the writing surface driven by writing forces, which includes three-dimension forces between pen tip and paper, contact positions, velocities and so on. The current reaches on the PBI is mainly for tacking the trajectories, which makes the computer percept the actual handwriting force information unavailability. The interface information is unmatched seriously between the human output and the computer input, leading to HCI divide. As a result, the computer cannot fully express people’s output and understand people’s intentions.Therefore, this dissertation analyses the existing problems of the current pen-based devices laid in the structure, interaction information acquisition methods and so on, which provides a starting point and technical support for proposing and designing a new type instrument of pen-based devices. Meanwhile, it is a feasible application platform to some extent for theoretical analysis and experiment research in interactive information acquisition interoperability, interface interaction design and field applications.The main research works which this dissertation launches are as follows:1) PBI information acquisitionChapter1and2analysis the existing problems which lie in the current commercial pen-based devices and propose a new pen-based instrument based on the force haptic methods. Through the use of a special structure of a multidimensional force sensor technology, the designed instrument can capture the pen-contact force information, trajectories, velocities and all other handwriting information in real time, and particularly implements a kind of "what you write is what you see" natural interaction experiences.2) PBI information accessChapter3gives a specification and implementation on the general interface access. From the view of information service and devices drives, it is important for different applications to access information via a standard interface. So, the designed instrument gives a realization on the general application interface based on the widely supported Wintab interface standard, which different applications can access the PBI information using a standard application program interface (API).3) PBI interactive modesChapter4analysis the defects and weakness of the uses cognitive capability and interaction efficiency in the WIMP-based interactive modes, which points out that the current interactive modes cannot be consistent with the human being natural active. Therefore, a new interactive primitive model named force-positions interactive is introduced based on arbitrary, multi-dimensional, fuzzy features of the PBI information form the point of the human cognitive load. Moreover, the new force-positions mixture control interactive modes is proposed and achieve a more natural interface interactive which is in line with people’s handwriting habits.4) PBI information expressChapter5and6discuss the problems on the cross-platform transfer and content expression of the PBI information. Digital Ink technology is proposed to implement the PBI information natural expressions which can be used to resolve the above problems. An InkML specification is adopted to apply for the storage the digital ink and creation of costumed digital ink files, which makes the designed digital ink shared by different application platforms, and finally realize a natural pen interaction and ink expression.