Research On 3D Video Hybrid Digital Analog Transmission Method Based On Synthesis Distortion Estimation

With the rapid development of information technology,the multi-viewpoint plus depth format has gradually become the mainstream 3D video expression method.But the traditional digital transmission scheme for 3D video inevitably brings the "cliff effect" and "saturation effect",due to the use of quantization,entropy coding and digital modulation.In recent years,a hybrid digital analog transmission scheme named HDA has emerged,which can avoid the above disadvantages.However,using HDA to 3D video transmission is under-researched currently.Therefore,this article focuses on the key technologies such as HDA-based 3D video coding transmission framework and power optimization.The main innovations include:(1)A transmission framework for 3D video named 3D-HDA based on HDA is proposed.3D-HDA transmits the superposition of texture and depth videos in HDA mode to overcome the "cliff effect" and "saturation effect" of traditional digital transmission.(2)Based on the proposed 3D-HDA framework,an end-to-end recursive distortion estimation model named RSDE-3D-HDA for 3D video from encoding,transmission to view synthesis is derived.According to the model,one can estimate the distortion of the synthesized view of the decoder at the encoder,assuming the channel conditions are known.The simulation experiments prove the correctness of RSDE-3D-HDA.This model can be used to optimize the resource allocation for 3D-HDA.(3)The resource optimizations between digital and analog signals in 3D-HDA framework are designed.On the basis of the RSDE-3D-HDA,this article further researches the optimization scheme of the 3D-HDA video transmission,that is,minimizing the distortion of virtual view of the decoder at the encoder to realize the joint optimization of the source and channel.Specifically,we use the optimal power allocation factor and bandwidth allocation factor to significantly improve the quality of synthesized view,while bringing the negligible transmission costs.The experimental results show that the optimization scheme achieves the best 3D video quality,under the various channel conditions,compared with other state-of-the-art 3D video transmission schemes.