A Motion-Based Perceptual User Interface Model And Its Applications

With the widespread use of interactive applications and the increased demand of consumer electronics, perceptual user interfaces (PUIs) have become an active research topic due to its advantages of naturality, spontaneousness and adaptability. As an important form of PUIs, motion-based perceptual user interfaces (MBPUIs) allow users to interact with computer through body movement physically. Aiming at providing principles and models for the design and development of MBPUIs, we explore and investigate the concept of PUIs, motion-sensing techniques, interaction design methods and user interface models of MBPUIs in this dissertation. In addition, two prototypes are also implemented to demonstrate how to apply the interaction design method and the user interface model in the development of MBPUIs.In particular, the main contributions of this dissertation are as follows:1. A systematic survey on PUIs is provided. Taking advantages of understanding of natural human capabilities, machine perception and reasoning, PUIs are given the capabilities of interacting with real world in a natural and spontaneous manner. The concept, properties, components, related studies and applications of PUIs are discussed in an integrated view.2. Motion-sensing techniques are investigated from the point of view of human-computer interaction. Motion-sensing consists of two parts: motion tracking and recognition. Motion tracking is to "sense" motions and motion recognition is to "perceive" the meaning of the motion sensed. We adopt appropriate approach to capture motionsin MBPUIs according to the characteristics of motion tracking methods and human motions. The method of acquiring motion data from motion sensors in realtime and the algorithms of motion recognition are also implemented.3. User-centered interaction design methodology is explored for MBPUIs. Interactive characteristics of MBPUIs are addressed. Within the framework of activity theory, principles of interaction design for MBPUIs, scenario-based design for MBPUIs and evaluation methods are proposed around user experience objectives.4. A motion-based perceptual user interface model is proposed. Typical user interface models are summarized and a model of MBPUIs is presented on the basis of the characteristics of PUIs and MBPUIs. The MBPUI model is composed of the user model, the interactive model and the systematic model.