Dance Motion Synthesis Driven By Music

With the development of music signal processing and motion capture techniques,considerable research has been conducted on dance motion synthesis based on music,and how to improve the match of music and dance and the reality of synthesized dance become particularly important in aspects of music understanding and dance motion synthesis.Common rhythm and emotion in time synchronization is a cue to feature matching between music and dance.The reality of synthesized dance is reflected in the cohesiveness and spatiality of dance movements.Focusing on these two targets above,four aspects of main works are as follow:Firstly,feature extraction and segmentation of music and motion are analyzed to provide the basis for later work.We segment the original music and motion,defining all feature on the scale of the music and motion segment and ensuring same frame rate for music and motion.The rhythm and intensity feature are extracted based on constant Q transform,and the same feature of motion are also extracted based on Labanotation.Secondly,to solve the problem of cross-modal feature matching,feature matching based on rhythm and intensity is adapted.First of all,rhythm match is conducted based on the synchronization number of music and motion rhythm.At the same time,to make sure that synthesized motion look natural,connectivity analysis of neighboring motion segments is evaluated by motion distance.Then all possible motion segment sequence can be acquired by depth search of map.Finally,by evaluating the similarity of intensity component,the target motion segment sequent is obtained.The experimental results show that the musical rhythm and intensity are matched to motion rhythm and intensity.Thirdly,to solve the problem of poor transition between dance segments,the synthesis of music-driven dance motion based on interpolation between transitional frames is proposed.Spherical linear interpolation is used to preserves the characteristics both of neighboring segments,while avoiding sudden changes between segments.In order to measure the effectiveness of motion transition,the fluency function is proposed and the transition between synthesized dance based proposed algorithm,origin dance and synthesized dance without transition are compared.The experimental results show that the transition of synthesized dance based proposed algorithm is close to origin dance,and is far better than synthesized motion without transition.Finally,to solve the problem of lack of spatiality of synthetic dance,path editing algorithm based on cubic spline interpolation is proposed.Without path editing,the origin path of synthesized dance is irregular.The method edits the path of dance so that dance can move in specified path without distortion.