Research On Pen And Speech Based HCI Application

As steady progress and prevail in wearable and portable devices, traditional input by mouse and keyboard are not suite for those mobile devices. Speech and pen are compact and portable that is fit for those devices in mobile computing. With the incoming era of Ubiquitous computing, pen and speech will become the major research area in HCI research.The author introduces the character, design issues and state of the art of speech user interface (SUI). This dissertation analyses the virtues and defects of SUI and its applicable conditions. Hereon, the author brings forward the interactive model and metaphor of SUI. The author implements a prototype of speech user interface: HomeDoctor, which based on the design issues of SUI and carries out user evaluation on the system.This dissertation also analyses state of the art of the pen user interface (PUI), which includes pen based applications, interactive environments and hardware of PUI. Focusing on pen-paper metaphor of PUI and human-centered intelligent HCI guidelines, the author investigate introducing pen device in traditional working environment. In this dissertation, the author design and implement a pen based character input and document edition system: SketchEditor. It imitates how people use pen and papers in their daily life and try to build a human centered interface. In SketchEditor, the system captures and recognizes the user's input and takes corresponding actions. It keeps the naturally of pen-paper interaction and utilize the computing power of computer.The author also design and implement a conference note taking system: ASN, which can record both pen strokes and concurrent speaker's speech information.