Research And Implementation Of Virtual View Synthesis Based On Spatio-temporal Continuity

With the rapid development of 3D industry,people are increasingly seeking to enjoy themselves in 3D scenes.Driven by the market and technology,television technology has also undergone significant changes,from traditional TV with single function and single color to smart TV with high resolution and multimedia function,and then to traditional 3D television(3DTV),and to the free view television(FTV),which is now in the development momentum,and every change brings better viewing experience to the users.Free view point video is generated on the basis of video plus depth(V+D)virtual point rendering framework.Because of the limited bandwidth of video transmission,depth-image-based rendering(DIBR)becomes a commonly used method.Unfortunately,the virtual view image will have artifacts and holes,which affect the visual viewing experience of users.Secondly,most of the solutions are limited to single frame images and ignore the correlation between video frames,so the virtual point image sequences generated by the above mentioned will have the trouble about time continuity,which is reflected in frequent flickers.In view of the problems in the DIBR method,a virtual view synthesis framework based on temporal and spatial continuity is proposed in this paper.First,this paper makes full use of time domain information in video sequences and adjacent frames to extract the static background image of the whole scene through structural similarity measure and depth information.Secondly,we obtain the real artifacts by removing the interference from the foreground edge,and use the global static background image extracted to eliminate the artifacts.Finally,this paper proposes a weighted fusion hole filling method based on static background.The experiment results show that the solution framework proposed in this paper can improve the quality of virtual view images.The holes and ghost artifacts are greatly reduced to maintain the spatial continuity.Secondly,the method in this paper plays a great role in keeping the time continuity.