3D Human Pose Estimation Based On Binocular Vision

As the key part of human action recognition,3D human pose estimation has a wide range of applications in games,sports training,and human-computer interaction.At present,the common 3D human pose estimation requires the wearing of relatively expensive auxiliary equipment.To some extent,the moving target will be affected by these equipments and cannot be flexibly moved,and some motion capture devices cannot be used in complex scenes such as outdoors.Therefore,this paper uses more cheap and flexible binocular vision and 2D pose estimation to achieve 3D human pose estimation.Aiming at the 2D joint points extracted by the OpenPose algorithm,the same joint points of the left and right images may not match,resulting in the restored3 D pose cannot accurately reflect the true human posture.This paper proposes an improved method.Methods Fitting human limbs with deformable model can not only accurately locate the joint points of human limbs,but also meet the same joint points of the left and right images,thereby improving the accuracy and authenticity of 3D human pose estimation.The following research work has been carried out in 3D human pose estimation:(1)Design and implement a binocular stereo vision system,and call the open source OpenPose algorithm to extract the 2D joint points and recover the 3D coordinates to achieve 3D human pose estimation.The system can process images and videos.(2)Aiming at the inaccurate joint points extracted by OpenPose and the mismatch between the same joint points of the left and right images,the restored 3D pose cannot accurately reflect the true pose,and an improved 3D human pose estimation method based on binocular vision is proposed.The 2D joint points obtained by this method combined with the 3D posture restored by the binocular vision system can more accurately reflect the true posture of the human body.(3)Utilizing the binocular stereo vision system carried by the drone,shooting the actual scene to complete the 3D pose estimation of the complex scene of multiple people,proving the feasibility of the method in this complex scene,and verifying the binocular designed and implemented in this paper Stereo vision system has good robustness and practicality.