Design And Implementation Of Humanoid Robot Voice Interaction System

As a service robot,humanoid robots are widely used in welcoming guests,guided tours and other life scenes.More and more humanoid robots appear in shopping malls,airports,banks,restaurants,exhibition halls and other places.Humanoid robots have a similar appearance to human beings and can interact with human beings through language.This thesis designs and implements a voice interaction system for humanoid robots.Firstly,the requirements of voice interaction system are analyzed,and the functions and requirements of the voice interaction system of humanoid robot are determined.Then according to the function,the hardware platform is divided into several subsystems,including voice hardware,host computer hardware and human-like head model.The requirements of each subsystem are analyzed and the hardware selection is completed,and the hardware platform of humanoid robot is built.This thesis focuses on the software design of voice interaction system.Using modular design idea,the software system is divided into several subsystems,including voice software,cloud service software and host computer software.Cloud service software includes AIUI cloud service and custom cloud service.Voice software is an Android system application program.App AiuiHandle is developed to deal with all kinds of AIUI events,realize voice synthesis broadcasting,serial message processing between voice development board and host computer and communication function with AIUI cloud service.The voice skill of AIUI cloud service is developed,and the motion control of the robot is realized with the message parsing module of the host computer.By building cloud server and developing Web application to call Turing API,the ability of natural language processing is improved,and the robot can deal with most of the daily conversation scenarios.The information query function of third-party services further enriches the use scenarios of the robot.The host computer software is developed to realize the main function business logic,the control of the steering gear,the voice development board and the processing of the robot's face action.This thesis also studies the matching rules between mouth movements and pronunciation when humanoid robots speak.By classifying and summarizing the mouth movements corresponding to different human syllables,the relationship between mouth opening and syllables is obtained.When robots speak,appropriate mouth opening and movement speed are set up to achieve the basic matching between mouth shape and pronunciation when humanoid robots speak.Finally,functional and non-functional tests are carried out on the voice interaction system designed in this thesis.The results show that the humanoid robot can achieve the expected functions.