Research Of Augmented Reality On Handheld Device

Augmented reality is a research offset of virtual reality field. Through 3D graphic technique and vision tracking technique, augmented reality combines virtual objects and real scene, lets 3D virtual objects and real environment combined together perfectly, achieves the effect of augmenting real environment. People can augment the reality to alternate with it. Because augmented reality has the characteristic of combination of true and false and alternating at real time, it has a broad foreground in the domain of investigation of medical treatment, education training, industry designing, national defence constructing, city planning layout, cultural relic protecting, culture and entertainment. On the other hand, With the development of technology, PC is smaller and smaller, but its function is more and more powerful, as a mobile platform of providing computing ability, handheld devices like mobile phones and PDA can combine with augmented reality, bring new digital media technique and appliance, so this task has important research meaning and worth.This article researches and implements augmented reality techniques on handheld devices with camera, can put 3D graphics on the images taken by the camera on mobile phones. The article mostly treats of following works.(1) The research and design of markers of augmented reality: we can get videos in real environment through camera, but how can we build the mapping of the certain object in real environment and virtual object is a key problem. We research and analyze the relative works on PC and mobile phone platforms, import a kind of visual code into the augmented reality system based on mobile phones, as the markers of augmented reality, build a virtual and real information relative channel of mobile phones'computing environment and real environment, and it can support 2D-2D augmented reality applies, and we designed a kind of new colored visual code which increases the code capacity of the marker, supports more digital information exchanging between mobile phones and real environment.(2) Research of the tracking arithmetic of augmented reality on mobile phones: In order to replace the none-coding markers in traditional augmented reality systems and build the combining effect of virtual objects and real environment, we designed and implemented 3D augmented reality arithmetic based on the colored visual code, including marker searching, marker matching and recognizing, marker tracking and so on, comparing to the markers used in traditional augmented reality systems, our arithmetic improves the matching efficiency, matching and recognizing veracity and tracking stability, so it is fit for the lower image resolution and computing ability of handheld computing platforms.(3) The protracting of 3D graphics and composing of augmented reality on mobile phones: we researched several 3D graphics APIs on mobile phones, and selected appropriate 3D graphics platform on mobile phones based on the need of real time, and combined the 3D augmented reality arithmetic we designed and implemented, we implemented the augmented reality composing of 3D graphics and real environment.(4) The experiments and applying design of augmented reality on mobile phones: based on our augmented reality arithmetic, we take experiments on tracking speed, nicety rate and coding capacity, and analyzed and evaluated the result of the experiments. We researched and designed the corresponding apply of augmented reality.The organizing structure of the paper is: the 1st chapter introduces the research background and meaning; the 2nd chapter introduced the basic theory of augmented reality; the 3rd chapter introduced our colored visual code; the 4th chapter describes our augmented reality arithmetic; the 5th chapter analyzes and researches 3D graphics platform on mobile phones, and introduced the implementing of our system; the 6th chapter analyzes the result of experiment, and evaluates and discusses the result, the 7th chapter describes the corresponding apply of augmented reality; the 8th chapter sums up and prospects.