Reseach On The Algorithm Of Low Delay And Remote Rendering Of 3D Scene Based On Multi View

With the rapid expansion of mobile applications, more and more applications are installed on mobile phones from computer, while the application of three-dimensional programs on the phone enrich the application range of mobile phone. However, due to the limitations of physical hardware and computing capabilities of the mobile phone, the rendering process of large scale scenes and sophisticated models can not be rendering smoothly on the mobile phone. In recent years, a new method based on depth mapping (DIBR) has been developed, which is based on the idea of depth map rendering and remote rendering.However, the way based on depth mapping still exists some problems need to be solved, such as a large amount of network bandwidth and generating new viewpoint of image which is not accurate. This paper presents three methods to solve these questions.First, his paper proposes a prediction algorithm based on the edge of the depth of view, which can keep the prediction viewpoint maintain proper distance from the current viewpoint. Compared to the existing full search viewpoint selection algorithm and viewpoint prediction algorithm, this algorithm forecast reference view in real-time, and ensure the prediction image generated by the two reference view do not exist too large air hole.Second, in the light of different interaction styles, this paper proposes two cache strategies based on the interaction style:the cache strategy based on the left and right translation and forward and backward movement, the strategy based on left and right rotation and forward and backward movement. The cache strategy proposed not only save the predicted image of the two reference view point, and the reference view image of the last step and reference view image to the next step, which reduces client interaction delay。Third, this paper proposes repair algorithm based on block hole, the pixel data the lack of empty area previously acquired reference view under the middle view, in the premise to consume a small amount of image data transmission under the further improve the quality of image.Experiments show that the method based on the depth map of the remote rendering system has better effect.