Robot Dance Composition Planning Based On Multi-modal Information And Its Simulation Experiment

The dance composition of wheeled robots is an important research field combining robotics with human dance art.Its research is not only beneficial to the development of contemporary artificial intelligence,but also helps to promote the rapid development of human-robot interaction.Robot dance both carry social service ability.The dance that leaves music is meaningless,and the dance combined with the beat of music,emotion,and tension is beautiful,vibrant,and natural.Most of the current robot dance is pre-compiled,for a kind of music on the need to manually adjust the relevant parameters,action,fun greatly reduced.If the drive robot dance not only get the beat of music,as well as music emotion,tension,etc.,and is not a simple pattern match,interesting will greatly increase.So,in the era of rapid development of high technology,robot dance research for the current China has an important practical significance.For the above reasons,this paper constructs a complete multi-mode driven robot dance composition system.The whole system is divided into three steps:First,the extraction of multi-mode information:1)First,the use of music structure analysis framework Timing structure characteristics of audio music files according to the music structure,get a number of different music structure;Layer emotional detection framework in turn to draw out each section of the music rhythm,emotion,tension and other information,get this section of the emotional information.2)According to the distance sensor to detect the distance with the obstacle,get the current car and the distance between the surrounding objects safety.3)extract the robot to take the floor color,corresponding to the atmosphere of the atmosphere.Second,the initial dance library:CMAC and compensation based on the use of adaptive control framework to initialize the original action library,according to the emotional dance into different categories,each category has a different composition of the dance.Third,combined with multi-modal information,matching and emotional corresponding to the composition of the dance.Mobile robot dance composition is a small branch of humanoid robot dance,it is an indispensable part of it for the humanoid robot dance composition laid a solid foundation,but also for humanoid robot dance composition provides a new method.