A Robot Dance System Using Images For Motion Imitation

Robot dance has many related researches because of its ornamental,interesting and interpersonal interaction.The current implementations mainly involve pre-writing action instructions for a specific sequence of actions or automatically generating actions based on features such as music and rhythm.If the robot can dance similarly by analyzing human dance videos,then the robot has the ability to imitate human motion.In this way,the robot can jump various dances without preset motion instructions,and enhances the interactivity with people.On the other hand,deep learning has achieved success in human pose estimation and behavior recognition.This makes it possible to analyze the key points of the human body directly through the RGB image,thereby getting rid of the dependence on the professional human body capturing device.This paper constructs a robot dance system that uses the deep learning method to estimate the human pose and dances through motion imitation.In this paper,the method based on deep learning is used to detect the key points of the human body.After analyzing the images,the position coordinates of each key point of the presenter are obtained.The inverse angle kinematics of the robot is used to obtain the angle values of the joints of the robot,and then the angle value of the lower body joint is adjusted to maintain the balance of the robot.Finally,experiments were carried out on the UBTECH alpha ebot humanoid robot.Experiments show that the system can obtain the 2D and 3D coordinates of each key point of the presenter by analyzing the RGB image to achieve the purpose of motion capture.The obtained posture information can be converted into a motion instruction of the robot,so that the robot can imitate the motion of the presenter,thereby improving the flexibility and interactivity of the robot dance.In the future work,it is necessary to improve the accuracy of human key point recognition,and select a humanoid robot with greater freedom to more accurately imitate human dance movements.