Based On Multi-camera High-quality Panoramic Video Generation With Immersive Display Technology

Rapid development of science and technology brings the explosion of information.So that the requirements of video quality and display technology are also getting higher and higher especially in such fields as visualization of large-scale science data,cyber-supporting telemedicine,virtual reality,CAD,business and entertainment.People require high-resolution and large field-of-view video,and large size and immersive display of high quality video.To satisfy these new requirements,combining image mosaic and multi-projector display technology to construct high quality panoramic video real-time generation and display in immersive multi-projector display system is a proper approach.This paper focus on high quality panoramic video generation and immersive display technology, implements an integrity system for real-time panoramic video generation base on multi-camera system and immersive-display with multi-projector display system.To generate high quality panoramic video in real-time,the paper calibrates the multi-camera system,adjusts and optimizes the homography between pair-wise cameras to reduce the mosaic geometry error,meanwhile combines the powder computation of multi-core and GPU to blend panoramic image.Finally,the paper uses the multi-projector display system to immersively display the generated high quality panoramic video.The main research works in this paper include:(1) Implements a GUI tool for adjusting homogrpahy to reduce mosaic geometry error and parallax effect.Besides,uses bundle adjustment to globally refine the mosaic parameters to generate high quality panoramic image.(2) Uses real-time stream transfer technology to transfer multi-channel video and combines the powder computation of multi-core and GPU to generate panoramic video in real-time.(3) Introduces multi-projector display system to display high-resolution,large field-of-view panoramic video to give the user strong immersive feeling.The development of constructing high quality panoramic video real-time generation base on multi-camera and display in immersive multi-projector display system challenges in various fields,ranging from computer vision,computer graphics, high-performance computing and stream media.The paper's contribution is mainly the system integration of different technologies stemmed from different research fields,including image mosaic technology,stream-media transfer technology and multi-projector display technology.