Research On Augmented Reality Broadcasting Technology Based On Real-time 3d Fusion

Nowadays,augmented reality(AR)technology is introduced in most of the virtual perform systems,which combines the announcer and the virtual scene to perform,greatly improving the visual effect of broadcast.However,most of the virtual broadcast systems do not have a good 3D fusion,visual feedback only stays in the 2D plane.Therefore,with the development of visual reality and 3D live broadcast,there is an urgent need for more accurate interactive real-time fusion of virtual and real in 3D space.The research of high 3D fusion degree virtual broadcast technology has high research and application value.This paper focuses on the AR broadcast technology based on real-time 3D fusion,with using multi-sensor and stereo vision technology.The main work of this paper is as follows:1)In this paper,a calibration algorithm of unified multi-sensor pixel domain coordinate system is proposed,constructs a linear regression model of conversion between pixel domains,and a calibration sampling method is designed.2)This paper proposes a kind of Human segmentation method with no shadow based on HSV assisted by Kinect;3)This paper constructs a simulated virtual scene,and based on the real scene data,a virtual and real combination space is realized with a high degree of 3D fusion.4)Based on OpenSceneGraph,OpenCV,Eigen and Kinect SDK,an example virtual broadcast system is implemented,which is combined with the actual scene effect.The experimental results show that the real-time 3d fusion based AR broadcasting technology proposed in this paper is a real 3d interactive broadcasting technology with high precision.Combined with a stereoscopic display or helmet system,the cast can leap out of the screen and approach the audience,and perform precise three-dimensional interactions,greatly improving the telepresence of the show.