Model Based Projective Augment Reality Techniques

Creating vivid virtual world has been the eternal destination for computer graphics and virtual reality. Recently, Augment reality based interaction techniques is becoming more and more popular, using such techniques can break the existing bottlenecks within HCI and better develop the potential of rendering techniques in HCI. By utilizing pro-cam systems to augment real scenes, users of such systems can experience a co-existing real and virtual world. In such applications human can directly act to the system as if they are acting to the real world, thus, greatly improve the efficiency of interaction.The main object of this work is to study model based projection augment reality techniques, including real object mesh modeling, 3d model acquire acceleration, model post processing, virtue and real object registration, multi-projection compensation and relighting. The study of these basic techniques is very important for the application of projection augment reality techniques. The main contribution of this work includes the following parts:First, all related technique is considered and explained in detail in this work, and the concept of spatial augment reality pipeline is brought. By using the model based projective augment reality techniques, table top spatial augment reality applications are implemented to demonstrate the potential it has in improving the existing human computer interface.Second, structure light based modeling method is improved by using hardware to synchronize the projector with the camera, modeling efficiency is improved.Third, post process of the model is also considered, after mesh decimation and part model alignment, model is adapted to work well in the following phases.Fourth, virtue and real scene registration is implemented by using the parameters retrieved from the calibration. Correct rendering parameters is calculated, thus, making the real and virtue scene correctly aligned.Fifth, a pixel feathering technique is brought to handle the brightness inconsistency in the overlap area in the multi-projector environment.Last, spherical harmonic based relighting technique is implemented to show its applicability in spatial augment reality, experiments are designed to demonstrate its actual effect in the real environment. By all these sections, our work is dedicated to show and demonstrate the potential which spatial augment reality has in improving the existing human computer interface.