Software Design Of Free View Video Player Based On Embedded GPU

Free-view video is a kind of three-dimensional video that uses a virtual viewpoint synthesis technology to synthesize a single viewpoint video captured by an ordinary camera into a plurality of viewpoints in a horizontal direction.Free-view video is more closely matched with human vision and is the future direction of 3D video.In response to the above problems,this article uses NVIDIA Jetson TX2 as a development platform to accelerate the synthesis of multiple viewpoints in the horizontal direction through the embedded GPU by using the reference view video and the corresponding depth video.The viewpoint can be switched in real time according to user requirements,in telemedicine and visual.Meetings and other aspects have good application value.The main work is as follows:(1)The overall design of the free-view video playback software.Compare different embedded GPU development equipment,image pre-processing filtering algorithm and virtual viewpoint synthesis algorithm,determine the design requirements of the algorithm,and build the software and hardware development environment of the system.(2)Free-view video decoding and depth image pre-processing.The free-view video stream receiving module receives the reference view color image data and the corresponding depth image data from the collecting end by using the TCP protocol,decodes by the decoding module,and then performs filtering pre-processing on the decoded depth image to avoid synthesizing the new viewpoint small and medium.The creation of voids.(3)Virtual viewpoint rendering based on depth image.The virtual viewpoint image is synthesized by virtual viewpoint synthesis algorithm,and designed and used of an improved depth image based rendering technique.In the process of view synthesis,only one mapping is performed,and then the hole is filled by the hole filling algorithm to make the viewpoint synthesis speed faster to meet the needs of real-time playback,and analyzes the existence in the process of viewpoint synthesis.The hole problem and the pixel overlap problem are designed and the corresponding solutions are designed.The final synthesized virtual view image display effect is greatly improved compared with the direct synthetic viewpoint.(4)Free-view video playback optimization and interaction.In the traditional virtual view video synthesis method,it takes a lot of time and therefore cannot meet the real-time playback of the free view.In this design,the embedded GPU is called to accelerate the synthesis process and the void filling process of the virtual view through CUDA programming,and a free view point is designed.The way of interacting through the viewer gesture during the video playing process makes the viewpoint change according to the user's needs,and brings a strong sense of integration to the viewer to achieve the 3D video playing effect.