The Somatosensory Control System For Home-services Robot Based On Kinect

With the development of society,robots will be used more and more widely in our lives.There are many kinds of robots,according to the application,robots can be divided into industrial robots,military robots,medical robotics,service robots and so on.For ordinary people,Home-service robot is a kind of robot which we can contact mostly.There are many ways for people to interact with devices.The traditional method to interact with devices is using keyboard and mouse,or other equipment.Somatosensory recognition technology as a Human-computer interactive technology is very popular in recent years.People can control the machinery equipment through their body movements or speech.Traditional household products are mostly controlled by remote controller,keyboard and other devices,and many are based on one to one pattern,however,this kind of household control method is not suitable for some special populations(such as elderly or disabled people).According to this situation,this thesis will combine intelligent robot technology with somatosensory recognition technology,and explore the control mode of intelligent home service robot by using skeletal tracking,gesture recognition and speech recognition,and other functions of Kinect.This thesis explores a new method to realize the control of the Home-service robot,which not only provides a new way of Human-computer interaction for users,but integrates the control system of household devices and realizes the purpose of providing basic services for household through control of robots by body movements or speech control.Applying the Kinect somatosensory technology in the Home-service robot control is my thesis' s main research contents.User can control the robots to complete work through their body movements or speech.The following is the working process: Firstly,we should get user's depth data and speech data through Kinect.And then,recognize the user's action through action recognition technology and skeletal tracking technology.Recognize the user's speech through speech recognition technology.When we recognize the action successfully,we will get the control instruction.Finally,we send the instructions to the robot by wireless technology.When robot get the instruction,it can complete the work.In order to verify the effectiveness of the system,a humanoid robot was built.And we test the action control and the speech control.Experiment results prove that the system can control the robot through body movements or speech,basically achieving the desired results.The design of the system has a certain research value.