Research And Implementation Of Multimodal Human-Computer Interface Based On Configurable Resource In Smart Home

With the development of computer technology and related technologies and the continuous improvement of people’s living standard, the computer is no longer surfing the web, office, entertainment, but we hope it can be used in all aspects of family life. Such as: home appliances controlling the indoor environment controlling. Thus, the family life of the intelligent is becoming the inevitable trend of development of family life.At present, human-computer interaction with graphical is applied to human-computer interaction. Although this approach has been to achieve effective control of the equipment, how people feel as important factor not considered. And requirements of the operating personnel is relatively high, especially people with disabilities can not use the system, resulting in significant limitations in the interaction of the user and the computer. For these reasons, this page presents a more suitable system that the user interacts with, the multi-modal human-computer interaction. For smart home systems, this page designs and realizations of multi-modal human-computer interaction module and the smart home system of resource configuration module, its contribution points can be summarized as follows:(1) It is used XML technology to display the configuration interface and Extend the traditional use of XML and XML Schema. The approach adds the interface display elements in XML, XML convertes to convert XML interface elements for the interface display XML Schema conversion XML Schema convertes to the template of XML elements and XML convertes to semi-interface elements. New uses of XML and XML Schema are suitable for smart home resource configuration, increasing the flexibility of the interface shown in.(2) It designs human-computer interaction input interface with an extended capacity and multiple implementations, such as:voice input, telephone voice input, MSN input, Gtalk input, Skype input and Google Calendar input. The human-computer interaction input interface facilitate the expansion of the input mode, the popular IM input and calendar entries to take full account of user behavior, user-friendly control of the computer.(3) It designs human-computer interaction output interface with an extended capacity and multiple implementations, such as:text to speech output, the command control output and video output. The human-computer interaction output interface is convinced to the expansion of the output mode.(4) It designs and implements of the configuration module of the smart home, including mainly the configuration of system, users, hardware and software resources. Hardware resources include the configuration of rooms and equipments. Software resources include browser, mouse, news reporting and control of equipment instruction configuration. The configuration module provides a strong flexible space resources change and convenient for users to manage resources in home.