Research On Augmented Reality System For Industrial Visualization

With the rapid development of intelligent factory and Internet of things technology(Io T),the equipment centered industrial data visualization no longer meets the requirements of current industrial production.The visualization of human centered industrial data will become the focus of industrial visualization.This paper applies augmented reality technology to the visualization of industrial instruments and the guidance of disassembly and assembly process.Through the research of augmented reality registration technology,instrument visualization technology and model interaction technology in the process of disassembly and assembly,the paper realizes the visual guidance of industrial instrument moving visualization and disassembly and assembly industry,which is of great significance in industrial productionThe main contents of this paper are as follows(1)A small scene AR registration method based on QR code is proposed and implemented.Firstly,the QR codes in the scene are located by image filtering,binary and contour detection,and the pixel coordinates of four corner points are obtained.Then,the QR code’s information is obtained by perspective transformation,shear transform and decoding algorithm,and the pose matrix of camera relative to QR code is solved by RPP algorithm.Finally,the AR registration method based on QR code is realized by combining pose matrix and QR code’s information.This method lays a technical foundation for the subsequent visualization system of industrial instruments.(2)The visualization system of industrial instruments based on augmented reality is designed and implemented.Firstly,the data source is constructed by using the Ether CAT measurement and control system and OPC UA server,and the data forwarding interface is established based on the combination of OPC UA client,database and back-end server.Secondly,based on the instrument visualization development library,ECharts and Websocket protocol,the virtual instrument library is established,and the data transmission between virtual instrument and data forwarding interface is realized in the instrument library.Then,the instrument visualization configuration module is developed to bind virtual instrument and QR code in virtual space and configure related parameters.Finally,the display module of augmented reality industrial instrument based on QR code is developed and implemented.(3)The AR registration method for large scene based on vision inertial odometer is studied.Firstly,the basic frame of vision inertial odometer is built,then the camera and IMU are calibrated.According to the algorithm framework,the preprocessing methods of IMU signal and image are analyzed and deduced.Then,the initialization method of the system is analyzed and deduced.The optimal system state is estimated according to the multi-state constrained Kalman filter(MSCKF)algorithm,and the basic flow of the visual inertial odometer is realized.Finally,AR registration method of large scene is realized according to the output sparse map and carrier position and posture combined with computer graphics algorithm.This method provides the technical basis for the subsequent disassembly and assembly guidance visualization system.(4)A visual system of disassembly and assembly guidance is proposed,which integrates 3D animation planning module and AR visualization module.Firstly,the assembly model is lightweight.Secondly,the structure of the model is reset,which provides an interface for the subsequent realization of disassembly animation.Then,the3 D animation planning module and AR visualization module of disassembly guidance are designed and developed.The system can realize the disassembly process animation planning and AR guidance display simply and quickly,and the feasibility of the system is verified by an example.