Research Of The Development Of Real-time AR Mobilization Simulation System Based On NyARToolkit

Augmented reality is a cutting-edge research branch of virtual reality. It uses three-dimensional tracking and computer vision technologies to combine virtual objects with real world scenes, which makes virtual objects perfectly immersed in the real world scenery. Then the scenery is augmented. Additionally, the virtual objects in augmented scenery is also interactive. Because of the real-time interaction and virtual integration characteristics, augmented reality systems has a bright future in many areas. On the other hand, with the advances in computer technology, real-time augmented reality system is possible now. With a bright future, the research of augmented reality becomes important.In this thesis, three major problems that can cause registration errors in augmented reality was treated as one of our research topic, which are optical distortion, camera pose estimation error and system latency. To deal with those problems, this thesis applied a chess-board based camera calibration and optimized the applied methods in camera pose estimation as well as improving the overall system performance.Moreover, an AR marker auto-switching extension library based on C-sharp language was developed to improve the efficiency of AR development.Finally, based on the above work, a mobilization simulation system with AR features was developed.This thesis was aimed to improve both developing efficiency and the stability and perfomance of AR programs.Firstly, this thesis designed and developed AR marker auto-switching extension library, it includes three auto-switching methods, and this improves both efficiency of AR development and usability of AR programs.Secondly, this thesis developed a prototype of multi-marker AR tracking system and applied some carefully designed test cases on it for the purpose of performance and stability improvements.After dynamic stability adjustments and pattern file resolution balance discussion. A balance of speed and stability was found.Through a series of experiments and theoretical derivations, this thesis had developed:1) A real-time multi-marking tracking program based on NyARToolkit.2) A training system with real-time AR features and an entertainment system with real-time AR features3) A mobilization simulation system with interactive AR features.