Research On Augmented Reality Assistant Technology For Manual Assembly Process

Augmented Assembly is an application of augmented reality in the field of assembly.Comparing to the manual instruction of assembly process,augmented assembly provides information for assembler at site to relief the burden of cognition and memory and improve assembly efficiency by displaying the video that is comprised of real world and virtual objects in real time.The thesis studied the multimedia presentation of assembly process information as an auxiliary for artificial assembly and employed the augmented reality technology to show both real and virtual objects in the video to promote the understanding of information and the implementation of assembly operation.First,the information demand of augmented assembly was analyzed and the information was classified into four types: process object,process method,process resource and operation feedback.An information model of part was set up for the management of 3D scene data.The concept of basic assembly process was proposed as the bridge of transferring process information between manual instruction and content authoring of augmented assembly.Second,the cognitive process of assembly and the process of information processing of multimedia presentation were analyzed and the types of multimedia presentation were given.A model of multimedia presentation based on the information model of basic assembly process was provided and the assembly step file of augmented assembly was expressed with XML as the file of the process information.Third,a method of occlusion between real and virtual object was proposed which achieved the correct occlusion via the segment of the rendering image including the right occlusion relationship.Finally,the frame of augmented assembly application system was built and two prototype systems named respectively AR-oriented Information Planning System and AR based Assembly Instruction System were proposed which proved the feasibility of the system.