Research And Implementation Of Real Time HD Video Stereo Rectification And Disparity Adjustment Algorithm

Technology for3D television program making with comfort is the basisof current3DTV applications. Vertical Parallax, as a kind of geometrydistortion, is caused by deviations of camera position. However, visualdiscomfort lead by it could be eliminated by stereo rectification procedure.In addition, disparity adjustment method could adjust the in-screen orout-screen effects when capturing stereo video, which could partlysubstitute some complex operations of physical parameter settings of thestereo cameras. So building up a real system according to these twofunctions is very practical and will be of great importance.We use fame-average stereo rectification method and add horizontaldisparity constraints when we recover the rectification matrix. Thusstabilize the rectification results and reduce the image information loss. Inaddition, we combine rectification and disparity adjustment procedure toreduce the calculating complexity of the whole procedure.A pixel-block based solution is suggested when implementing thealgorithm on GPU, which make better use of GPU resources. Afterachieving real-time processing speed on GPU, we develop a solutionbased on DirectShow, which could handle the whole stereo videoprocessing procedure from input, rectification to output.Finally, a stereo HD real-time processing system is built. This systemcould handle formats1080i50,1080i59.94and so on. Tests on this systemshows that our algorithm works and this system might provide somereference for other similar projects.