Development Of Assembly Assistant Platform Based On Information Projection Technology

In the assembly process of complex products,operators often need to look over a large number of guidance manuals to obtain assembly guidance information.Although the assembly process information was recorded in the form of words and graphics in the assembly instruction manual,the information was separated from the assembly site,and operators needs to link the assembly site with the instruction manual,which affects the improvement of assembly efficiency.In order to assist operators to complete assembly tasks,the concept of augmented reality into the process of product assembly operation is introduced in this paper.The key technologies including on-site posture registration,gesture interaction and system integration are studied,and Information Projection Assisted Assembly Platform is built.Operators give instructions to the platform.After the platform responds,the assembly process guide is displayed accurately in the assembly scene,which assists users to complete the assembly task successfully.The main research work is as follows:1)According to the functional requirements of the information projection platform,the overall architecture of Information Projection Assisted Assembly Platform is established.On the basis of the above,the solution of the platform and the supporting function modules are determined.2)The registration of position and posture of projector in assembly scene is completed,and the posture relation between projector and assembly object is obtained.According to the characteristics of information projection,a on-site registration method based on camera-projector is proposed,and the calibration technology of the hardware is studied.On the basis of the completion of hardware calibration,the camera pose is solved by using the method based on the natural characteristics of the object,and then the projector pose registration is realized.3)According to the interactive requirements of the platform,the static gesture recognition technology based on geometric features is studied.The human skin color model is used to detect the hand area.A hierarchical recognition method is proposed,and the gesture recognition process is divided into two steps.Firstly,the number of fingers in the gesture images is detected.Then,the gesture model is built according to the finger angles and distance between fingers.Finally,the gesture recognition is completed by combining the number of fingers in the gesture and the characteristic value of the model.4)The projection information requirement of the assistant assembly platform is analyzed,and the projection information management model of the assistant assembly platform is established.The generation method and rendering method of the projection information are studied to realize the reasonable display of the projection information in the assembly scene.5)Based on the above theoretical research and related work,the hardware of the platform is selected.By using the integrated development platform of VS2010,the software of Information Projection Assisted Assembly Platform is built.Each function module is connected to realize data transmission between modules.The feasibility of the platform is verified by an example.