Research On Human-computer Interaction Applications Based On Projector-based Augmented Reality

Creating vivid virtual world has always been the eternal destinationfor computer graphics and augmented reality. Augmented Reality which isalso called ‘Mixed Reality’ is the technology that can combine realenvironment and virtual object into a same image or space in real time bycomputer. Thus in general case, augmented reality shows not only realworld, but also virtual world which enables users to immediately beingimmersed in the whole interactive environment. As one kind of augmentedreality, projector-based augmented reality (PBAR) is the hottest spot incurrent research on the area of augmented reality. Based on computergraphics and computer vision and using a projector-camera system, aPBAR interactive application enables user to avoid the limits of wearingdevices and freely interact with the whole system, thus greatly improvingusers’ experience. And the work in this paper aims to research andimplement a basic interactive application in the form of PBAR.And the main contribution of this work includes the following parts:First, the research background and current situation of the PBARtechnique and its application are described. Meanwhile, the basic prototype,the design goal and the potential occasions to be applied to of the PBARapplication which this paper works on are introduced.Second, this paper roughly analyzes users’ requirements for theapplication which this paper works on and then describes the wholearchitect design of the system including the hardware module and thesoftware module.Third, the algorithm of viewpoint tracking which is used in this PBAR application is introduced as well as implemented in this paper. Thealgorithm is also modified to improve its performance in the meantime stillguaranteeing the robustness.Fourth, how viewpoint position is calculated in real-time andview-dependent dynamic projection is implemented based on the steps ofviewpoint tracking and depth camera calibration is introduced and finalexperiment result has illustrated that the projection on a2D desk plane canmake an illusion of3D effect.Last but not least, the experiment done on the PBAR application isdescribed in detail and its result is analyzed in this paper. It mainlyincludes two parts: the first part is mainly about the analysis on theexperiment on the viewpoint tracking algorithm in the aspects of bothperformance and robustness and the second part is mainly about theanalysis on the performance of the whole application. By all these sections,the work in the paper is dedicated to demonstrate and show that interactiveapplication based on PBAR technology has a basic interactivity andpotential in future.