Research On Efficient Content Adaptive Plenoptic Video Coding

The light field camera inserts a micro lens array between the main lens and the imaging sensor.Light rays are recorded by the imaging sensor after passing through the main lens and micro lens.Thanks to the micro lens array,the direction information of the light is also recorded.A plenoptic image records a large amount of information,and its volume is several times that of ordinary pictures,which is not conducive to storage and transmission.Therefore,efficient compression methods are needed to.This problem has attracted many researchers to study.The research direction of the article is to find an efficient encoding method to encode plenoptic video.The specific research content is as follows:(1)A content adaptive coding method for plenoptic video is proposed.Based on the spatial correlations among subapertures,the plenoptic video is divided into two subaperture groups:the central view videos and the residual videos.Coding methods,multiview coding method based on spatial correlation(S-MVC)and multiview coding method based on temporal correlation(T-MVC),are adopted for residual videos according to correlation and residual energy analysis,while the central view videos are always encoded by S-MVC.Correlation analysis is performed first,and residual energy analysis is further performed if necessary.Coding the central view videos and the residual videos separately reduces bitstream,choosing different encoding methods for residual videos makes full use of the characteristics of different video content.Both the central view videos and the residual videos are compressed by MV-HEVC.The experimental results demonstrate that the proposed method outperforms a pseudo-sequence-based MVC method for plenoptic video by an average of 25.06%bitrate saving.(2)A hierarchical residual coding method for plenoptic video is proposed.Based on the content adaptive plenoptic video coding method,the central view video is graded to reduce the number of center-view videos.