Research And Implementation Of Virtual City Planning System Based On Multimodal Interaction

The problems exsisting in human-computer interaction(HCI) in Virtual Enviroment (VE),resulted by the imbalance of I/O bandwidth, such as unnaturality, singularity of interfacecontrol modes and the gap between user’s action and system’s feedback, have greatly restrictfurther application of Virtual Reality (VR) in economics, society and military. How toimprove naturality and efficiency of interactions in VE has become a focus and difficulty ofboth VR and HCI.In this paper, on the background of city planning which is in urgent requirement of VR,in order to solve problems in traditional city planning modules, including high modificationcost and unnatural interaction, multimodal interaction technology was introduced to3Dinteractions in VE, and a virtual city planning system based on multimodal interaction isdesignd. The main work of this paper is as follows. Firstly, after the systematical introductionof multimodal3D interaction, some key issues, especially including advantages, supportingtechnologies, development course of technical design ideas and interaction techniques designrules of multimodal3D interaction are discussed thoroughly. Secondly, requirements of cityplanning system are analysed: based on analyse of the overall objective of planning system,the system’s requirements are divided into common VR system oriented requirements and cityplanning application oriented requirements from the perspective of system function, andanalyse each of them by its function. Thirdly, complete the system’s overall design: brieflyintroduce the multimodal user interface and interaction environment, then on the backgroundof analyse of overall system framework the dividision of critical modules and their mainfunction are introduced, and a hierarchical multimodal integration model based on semanticsextracting is described in detail in order to obtain the interaction intention. Finally,the mainmodules was complete detailed design and implementation: design the critical modules andimplement multiple multimodal interaction techniques which can be classified into twokinds,common and application-oriented.This designed system improved the efficiency of large scene travelling, model operationsand city planning. Meanwhile, theoretical researches including systematic design ofmultimodal interaction techniques and scenario-semantic-based design of interactiontechniques need to be further carried out, and the functions of the system should also befurther improved.