View-Dependent Stereoscopic Projection On Curved Display

Nowadays,with its booming,the virtual reality technology is applied more extensively,as an increasingly important role in in military,education,entertainment,medical fields,etc.As the basis of virtual reality technology,stereoscopic display technology becomes more and more mature.It is based on parallax of human eyes.In stereoscopic display system,different images obtained by user's left and right eyes merge into a stereoscopic scene in the user's brain.In the traditional stereoscopic projection system,users see the same left and right eye images at different locations,so the stereoscopic scene merged in their brain is distorted because of their different locations.This paper is about the stereoscopic projection system with projectors and large screen,studying on view-dependent stereoscopic projection technology which renders virtual scene images from the perspective of user's observation in real-time,allowing user to observe the virtual scene from different angles and locations,just like in the real world.This is more in line with the way of humans observing the world.In addition,in stereoscopic projection system,curved displays could create a greater sense of immersion and presence that the planar displays do not possessed.But the curved display surfaces also bring with it some problems,such as virtual scene distortion.In this paper,we first present the algorithm to project a view-dependent stereoscopic scene on curved display,using a Kinect to track the viewer's head position in real time and multi-projector display to provide a wider field of view and greater sense of immersion.It allows the viewer to walk around while still can get the appropriate observation of the virtual scene based on his location.To solve the problem when projecting the view-dependent scene to curved screen,we propose a method of dynamic parallax adjustment of the stereoscopic images.It calculates the parallax of three-dimensional scene on the curved display according to the viewer's head position toward the cylindrical display.The main contributions of this paper are summarized in the three following parts:1.This paper presents the algorithm to project a view-dependent stereoscopic scene on curved surface.To solve the problem of virtual image displacement and distortion caused by the complex relationship between the user's viewpoint and the surface screen,we propose a dynamic parallax adjustment method.According to the shape of the screen and the relative position of the user and the screen,dynamically adjust the parallax of the virtual scene to ensure that the user always feels comfortable when walking in the virtual scene.2.It presents optimization based on user testing.Through the user testing,we have put forward two common problems of view-dependent stereoscopic projection:virtual image drifting and shaking caused by the user's head posture changes and eye movement.This paper analyzes in detail the effect of user's head posture and eye movement on the virtual image that user observes,and solve virtual image drifting and shaking based on our analysis.3.In this paper we design a multi-projector displays system for view-dependent stereoscopic projection on any curved surface screen,providing projection and calibration parameters for real-time rendering of stereoscopic projection.The system can provide a wide viewing angle,high-resolution display on any curved screen,such as cylindrical screen,spherical screen.To verify the method proposed in this paper,we also developed three application systems including virtual fireman training system,virtual tennis training system and virtual shorting system.