Research On Some Key Technologies Concerning Multi-View Stereo Video Based On H.264

The Multi-view stereo video technology has developed to a new level with the development of the stereo video capture technologies, efficient multi-view compression algorithms, increasing bandwidth of communication links and three-dimensional video display techniques. However,multi-view stereo video has some new characteristics, such as hard to synthesize, massive volumes of data, difficult to store and transmit. These new characteristics cause problems in pre-processing, compression and transmission of multi-view stereo video, and these problems have not yet been well-solved and blocked the industrialization of multi-view stereo video technology. Based on the deep research on the multi-view stereo video technology, this paper envisages a scenario of stereo video application,put forward an overall solution of multi-view stereo video processing system based on H.264 and implement some key technologies such as compression algorithms, network transmission, 3D display.Firstly, the system of multi-view stereo video transmission and display based on H.264 is proposed, and all the algorithms and protocols are verified on this system.Secondly, based on the JMVC test model, this paper apply 2D video compression algorithm - the S-UMHexagon Search in 3D video for compressing and encoding. This paper also optimizes the multi-view stereo video coding algorithm. By this way, the speed of motion search is increasedgreatly; the coding efficiency is improved significantly by decreasing the coding complexity and determining the optimal mode in advance. As the result, the encoding time is about 30 percent of the original.Thirdly, this paper put forward a transmission protocol for multi-view stereo video transmitting over IP network for the first time, so called Multi-View Data Conduit protocol (MVDC) which is an efficient network transmission technology for stereoscopic video. After the implementation of MVDC protocol and experimental results are analyzed and verified,this protocol can achieve real-time and reliable transmission of multi-view video data,and synchronization of multi-view video data at the same time. Finally, based on the National major sicence and technology project, 8-view stereo video player on small-size screen is achieved for the first time, and display of the multi-view stereo video based on Windows Mobile's wireless platform has also been implemented. Through the multi-view stereo video player on Windows Mobile's wireless platform, users can easily watch the stereo video on the three-dimensional screen.