Research On Design Strategies Of Multimodal Interaction

According to the spread of internet and the development of wireless communication methods, great challenges and opportunities arise in the area of human-computer interaction. Revolution has taken place in the field of graphic user interface. And as the need of users is no longer limited to the elegant interface and creativity, research of multimodal user interface increasingly draws more attention of designers and researchers.Multimodal user interaction is a diverse and interdisciplinary work. However, most of the current research relies on the revolution of computer science which may solve the problem of interaction method, instead of paying attention to the interaction design research itself. Moreover, there still lacks systematical theory conclusion which may support and guide the design of multimodal interaction. Thus this thesis is focused on the research gap of the multimodal interaction design. Together with the method and steps in interaction design, interaction design methods in multimodal interface are explored in this article. And the goal of this article is to introduce an interaction design methods of multimodal user interface, which may help design the tangible user interface to support the more natural interaction between the user and the technology and also helps the physical environment surrounding the user to become a meaningful information carrier.First, the concept of multimodal interface is introduced in this article, and followed by the history of interaction interface. Then the related research subjects in the area of multimodal interaction are discussed. The emergence reason and advantages of the multimodal interface are also analyzed. Based on the research result, the purpose of multimodal interaction is to eventually improve the reliability and performance of the interaction and also reduce the workload of single modality through the collaboration of several modalities.In this article, according to the analysis of the design concepts of user-centered interaction, users in the multimodal interface design are defined and classified. The classification method is introduced. Then user models are classified based on the education level and the influence of user diversity. And the existence ways of input-output design carrier in multimodal interaction interface is discussed.Through the research on the development of next-generation multimodal interaction, the new area of multimodal interaction - tangible user interface is thoroughly discussed in this article. The analytic design method of tangible user interface is discussed from several aspects. Finally, based on the purpose of tangible user interface design, we tried to eliminate the difference between the physical and abstract subjects, as well as the difference between the input and output devices in the interaction computation. We also discussed the design progress of computer peripheral devices, explained and analyzed the practical problems in the process using examples. To introduce the interaction design concept which combines both hardware and software is the main purpose of this article. Hopefully in the future we could build a real seamless interface, as a bridge between the abstract digital world and the concrete physical world.