Study On Verbal Interaction-Based Virtual Assembly System In Network Environment

This paper studies verbal interaction-based virtual assembly in network environment. With the analysis of both home and abroad development and application status of speech teconology, and merit of verbal interaction-based interface, the paper develops and achieves a virtual assembly system based on speech recognition in network environment. The system uses Sphinx-4 speech engine which is written based on Java Speech API as the interface of verbal interaction, and it uses microphone as the input device.The paper takes jack for example, it investigate how the speech recognition system embedding into a virtual scene. The system designed in this paper takes models with VRML format as the manipulatory objects, it achives assembly/disassembly simulation via the hand manipulation or verbal control, and it also can perform assembly path in virtual environment.Developing a virtual assembly system based on speech recognition in network environment, it provides a natural and efficient virtual assembly system in man and computer interaction. The system constructes a virtual scene in B/S mode and provides a friendly human-machine interface, it adopts teconologies like Java Applet,Java 3D and VR, etc. With small network transmission load, the system makes multi-sited transmission and multi-sited collaborative virtual design available to the network bandwidth limit.