3D Interaction For Mobile Augmented Reality Assembly

The traditional augmented reality assembly technology usually implemented the 3D registration of virtual parts based on 2D-artificial-markers or 2D-natural-features, and achieved the augmented reality assembly interaction through clicking button or the marker recognition. There were shortcomings in this method of assembly interaction, however. It needed a 2D-marker at least in assembly environment, which resulted in unsightly. The assembly interaction based on clicking button was simplex, inflexible and not entertaining. The assembly interaction based on marker recognition required an marker to completed a assembly process of a part, it was difficult to meet the demands of assembly interaction when there were much amount parts. In order to solve the problem, It researched and implemented the 3D-object-based 3D registration of virtual parts, implemented the collision detection of virtual parts, researched the mobile augmented reality 3D interactive assembly,and implemented touch-screen-based mobile devices manipulating virtual parts, finally, Completed the mobile augmented reality 3D interactive assembly. The main content of this paper is as follows.(1)It implemented a 3D-object-based 3D registration. It obtained the intrinsic parameter of camera with Matlab through researching the basis of 3D registration, and implemented 2D-artificial-marker-based 3D registration. Finally, It Researched and implemented a 3D-object-based mobile augmented reality 3D registration depended on analyzing the deficiencies of 2D artificial marker.(2)It achieved the rigid body collision, assembly direction and angle detection for assembly process. It researched the bounding box collision detection technology and implemented the functions such as the rigid body collision, the detection of direction and angle of virtual parts. It researched and improved the method of bounding complex parts, resulted in advancing the accuracy of collision. It researched and implemented the functions of collision detection and response in 3D interaction assembly process.(3)It achieved a 3D interaction in mobile augmented reality assembly process. It researched the assembly sequence, assembly path planning of the 3 kinds of product, and implemented the functions such as touch contact-based selection, translating, rotating, deep zoom for virtual parts. It defined and achieved the functions, in mobile augmented reality assembly, such as interactive button and guiding of assembly sequence, sub-assembly and assembly location.(4)It designed and developed a mobile augmented reality 3D interaction system application. It analyzed the system framework and the work process of system. It ran the system with mobile device and accomplished the mobile augmented reality assembly 3D interactive work of the toy car, vertical geared oil pump and motorcycle engine.