Research On The Registration Of Tai Chi Video Clips

With the accelerated pace of modern work and the popularity of mobile Internet technology,people are more inclined to urge and correct their fitness activities through mobile terminals.By watching fitness videos,the correct imitation of standard actions has become the main user appeal of mobile Internet fitness applications.However,without the real-time guidance of professional coaches,sports injuries have become the main contradiction between “Internet & Fitness” companies and users.Tai Chi is a treasure of Chinese traditional culture.It not only strengthens the body,but also cultivates ourself.How to spread the new format through the mobile Internet has been raised to the height of the national strategy.How to use the camera function of the mobile terminal to achieve end-to-end motion registration is a key technical bottleneck for online teaching and popularization of Tai Chi.In order to solve this problem,we need to break through two technical challenges: First,there is no limit to the rate at which Tai Chi can complete the routine.The time for different users to complete the same routine may be different from the template movement.Secondly,the image sensor mounted on the universal mobile phone terminal can only provide two-dimensional images.If you want to perform accurate motion registration,you need to provide the three-dimensional coordinates of each joint of the user,which becomes a technical problem in the online communication of Tai Chi.In view of the above technical challenges,this paper mainly completed the following work:(1)Aiming at the mismatch of Tai Chi action rate,this paper proposes a video registration algorithm based on joint angle and DTW.The main steps of the algorithm are as follows: firstly obtain the time series of the joint angle in the exercise video of the practitioner,and use the exponential smoothing method to improve the smoothness of the time series;then use the angular difference between the upper and lower frames to divide the time series;finally,using the dynamic time warping(DTW)algorithm to obtain the distance between the corresponding time series in the video of the split practitioner and the tai chi fighter,the registration degree between the practitioner and the tai chi master's video can be obtained.(2)Aiming at the lack of dimension of the Tai Chi video,combined with the idea of ying and yang conversion of Tai Chi,we propose a key frame extraction algorithm based on CCM causal analysis,and then use the key frame extracted by the algorithm to perform Tai Chi video registration.The main steps of the key frame extraction algorithm are: firstly,the human joint coordinates are obtained by the skeleton extraction model;then the causal analysis of the human joints is performed by using the convergence cross-mapping(CCM)causal analysis model to obtain a causal relationship matrix between the joints;finally,the causal relationship matrix is used to calculate the distance between the upper and lower frames,and the distance frame is used to find the video frame in which the causal transformation is performed,which is the key frame.