Multi-channel Human-computer Interaction Technology

This paper focuses on the Multi-Modal Human-Computer Interaction technique, discusses some main topics in this field, including the modal description, system framework, integrate algorithm and so on; also, we have developed a practical MM-HCI system MM-TSBH(Multi-Modal TSBH), which will be introduced later, and, this paper also refers to some problems may be encounterd during developing and the resolvents of these problems. Through the MM-TSBH system, we have made a lot of researchs about the key problems in Multi-Modal HCI, a multi-modal integrate algorithm and its improvement are gave out. Further more, we put forward a thought of Common Integration Template (CIT). By the research of the representation method in MM-HCI, we developed a kind of model of CIT, it is provided to the MM-HCI system developers for reusing, help them to make focus mainly on the application itself, not the multi-modal support. At last, we give a prospect of the MM-HCI technique.