Research On Multimodal Interactive System Based On Smart Phone

With the development of robot technology and the improvement of people's living standards,more and more entertainment robots will service for the ordinary family.Entertainment performance of entertainment robot is its core competitiveness,and is related to the interaction.Therefore,the research on the interaction of entertainment robots is important.In this thesis,the multimodal interaction is used to improve the problem of human-robot interaction and enhance the user experience.The related techniques of speech interaction,gesture interaction are studied,and the validity of each interactive modal is verified in concrete scenes.The research on the information fusion of multimodal interactive system is carried out,and the information fusion strategy is established to express user's order completely according to different situations.Combined with the three interactive ways and the fusion strategy,the establishment of a multimodal interactive system.Finally,the corresponding hardware and software test platform is set up to verify the reliability of the multimodal interactive system.In order to allow users to interact with the entertainment robot friendly,this thesis adopts multimodal interaction to fully mobilize the modals of users.It not only help users to interact human-computer more efficient and naturally,but also allows users to experience a variety of Interactive way to control the fun of the robot,to achieve interactive features and interactive fun combination.