Study On Projected Augemented Reality Based-Assembly Guidance System Using Kinect

The assembling of complex equipment often requires staff to have rich experience.And it had been affecting the assembly and maintenance efficiency operation that operators need to manually check the assembly drawings or electronic manuals in actual.The assembly guidance system based on Augmented Reality(AR)technology overlays the assembly instruction information into the actual assembly scene,assists the workers in the assembly operation,which could free the hands of workers,improve the assembly efficiency and reduce the error rate of assembly.The projection augmented reality system directly projected the virtual information to the real scene by means of the projector.The operator did not need to wear any equipment.This project studied the projection augmented reality assembly guidance system based on Kinect,which projected the guidanced information into the assembly scene,assisted the assembly of workers,and identified the human visual position to achieve dynamic projection based on the change of viewpoint position during the operation of the workers.So it was of great significance in the field of complex mechanical assembly and individualized product assembly.The main research contents were as follows:(1)The overall scheme design of the projection augmented reality assembly guidance system.The whole scheme of the projection augmented-reality assembly guidance system was designed,the hardware equipment function and the software development platform were analyzed,and the display and rendering technology of text,picture,3D model and other information were designed.(2)Projection technology research based on view tracking.Firstly,the camera's internal and external parameters were obtained by the camera calibration,and the transformation matrix of model coordinate system to projected plane coordinate system was calculated.Secondly,adopt Kinect bone tracking technology to capture the three-dimensional coordinates of the bone points of the head as the position of the viewpoint,analyzed the method of human head point tracking,compared the two methods of orthogonal projection and perspective projection,calculated the parameters of the projection matrix,and realized the projection mode based on the point tracking.(3)Research on gesture interaction in projection augmented reality system.The hand image was segmented and threshold processed by skin color model segmentation,and then the contour map was obtained by using the Canny edge detection,according to the curvature of the human hand contour,the number of fingertip was judged,the HOG feature in the gesture image was extracted,the HOG feature and the number of fingertip points constitute the feature vector,the support vector machine learning classification method was adopted to recognize the gesture,and the gesture recognition was used to achieve human-computer interaction.On the basis of the study,this paper constructed a projection based on device augmented reality assembly guidance system,and with the reducer assembly guidanced model experiment,the experiment shown that the system assembly projection for workers out of the intuitive guidanced in the process of information,had a good visual effect of projection,workers can interact by means of gesture recognition,provided a more natural way of human-computer interaction,had certain engineering application value.