The Panoramic Video Broadcast And Display Via Web And Mobile Terminal

As the rising of the digital media,mobile internet becomes more and more popular and the video broadcast over mobile internet got massive concerns from the entertainment and news industry.Due to the capability to observe the surrounding scene without single blind point,panoramic video camera cannot only provide 360-degree field of view,but also let the users observe and control the whole area comprehensively as if they are virtually in the scene,which gives a great immersive experience to the users.In order to achieve panoramic live video broadcast and portable visual experience,we create a new framework that combines the panoramic video camera with mobile internet,in which the user can obtain virtual reality experience through the helmet.In the first part of this paper,we design a robust framework using a stream server with ActiveX control plugin to remotely distribute the live video through internet,which allows a number of users to watch panoramic video with different view angles simultaneously.In our framework,the stream server receives multiple live video streams from different panoramic cameras,and then re-encodes them as one stream to redistribute to different clients which can decode the stream and display the video using ActiveX control plugin.Furthermore,this technique can also be integrated with Baidu Maps or wearable virtual reality helmet to provide world coordinate position and immersive experience as demonstrated in the paper.In the second part of this paper,we focus on panoramic live visualization experience on mobile terminal,such as cell phone or tablet.First,we put additional time stamp on the H.264 streams to synchronize decoding process which can align the frames captured by different camera sensors for the rendering step.In the rendering step,an alpha channel is introduced to combine with original RGB video to achieve seamless boundary effect between neighboring cameras using OpenGL ES texture mapping and blending technology.Then,we connect mobile client with panoramic video PC server via socket protocol,which can broadcast a live video through internet to realize the real-time panoramic display on a mobile terminal.These results can also be experienced by a wearable virtual reality helmet such as Storm Mirror.