Study On The Museum Guide System Based On Mobile Augmented Reality Technology

Augmented reality (AR) is a technology, which combines computer-generated sensory with real-world environment to enhance one's current perception of reality. Recently, with the improvement of handheld device's performance, the augmented reality technology is gradually applied on handheld devices. At the same time,more and more people pay attention to the application of augmented reality on handheld devices,namely mobile augmented reality.In order to provide personalized guide services for visitors, we propose a novel museum guide system based on mobile augmented reality technology. Compared with the existing museum guide methods, our proposed system is more advanced and competitive which can fulfill the needs of the visitors. Our system has several advantages. It provides more abundant information, and the human-computer interaction is more intuitive and natural. Furthermore, visitors don't need to lease any devices.The main studies and achievements of thesis are listed as following:1) From the user's perspective, the functional requirements of mobile augmented reality museum guide system are analyzed, and the architecture of the system is designed. A dual-mode exhibits recognition architecture is proposed, which can make full use of phone-side and server-side hardware and software resources.2) On the server side, Vocabulary Tree is combined with image matching to accurately recognize mass exhibits. Meanwhile, on the mobile phones, Bags of Words is combined with Support Vector Machine to recognize a few of exhibits in real-time, and the spatial constraints method is adopted to reduce the number of exhibits to be recognized. These two recognition models are connected by vision-based location recognition technology.3) A markerless tracking method based on natural feature is implemented on mobile phones.4) A prototype of proposed system is developed. Experimental results show that our proposed system is feasible and practical.