Font Size: a A A

Research On The Design Of Assembly Systems For Complex Equipment Based On Augmented Reality

Posted on:2023-11-30Degree:MasterType:Thesis
Country:ChinaCandidate:J DuFull Text:PDF
GTID:2568306836474114Subject:Instrumentation engineering
Abstract/Summary:PDF Full Text Request
This paper mainly aims at the problems of high-density and narrow space electronic equipment assembly scenario,and uses augmented reality technology to assist and improve the difficulties existing in traditional assembly.This paper uses Holo Lens2 as AR display device and develops an assembly system in Unity3 D engine,which realizes three scenarios:The first scenario is based on the technical characteristics of computer virtualization,which realizes a virtual assembly scene,which is intended to be used to replace the assembly training before the actual assembly;imports 3D models and designs the assembly model in Unity,and writes scripts for different module models to control the data exchange and change between different assembly models to achieve visual effects such as assembly,decomposition and scaling;and the mixed reality toolkit is used to add different interactive functions to the assembly scene,making the use of the virtual assembly scene more flexible and changeable to adapt to different environments;the scenario also designs a direction solver,when the assembler loses the scene field of view,the direction solver calculates the orientation in real time to achieve intelligent prompts;finally,the virtual assembly scene is tested,indicating that the model is displayed clearly and the modules work normally.The second scenario develops an asynchronous server based on ADO.NET technology by using the object recognition algorithm and asynchronous communication technology of the Qualcomm Vuforia cloud platform;the corresponding event is triggered by the Holo Lens2 terminal to identify the specified object,and the data request information is sent to the server,and the server queries the specified information from the database through ADO.NET technology and returns it to the Holo Lens2 glasses,and the Holo Lens2 glasses display the received information on the specified object.This scenario accurately superimposes information into the real world through Holo Lens2,allowing assemblers to avoid relying on paper manuals as much as possible,reduce the burden on both hands,and improve the utilization of the eyes,so that the hands can carry out more assembly operations;finally,the assembly scene is packaged to the glasses end and tested,and the test shows that the network communication is in good condition and the information display is normal.In order to solve the problem that when there is a specific complex assembly operation,the assembly scenario will be bloated,cross occlusion and burden on the eyes of assembly personnel through the transmission of a large amount of text information,the third scenario is based on Web RTC communication technology and Web RTC technology is integrated into the application of augmented reality.Based on SDP protocol(Session Description Protocol),UDP protocol and other protocols,the audio and video stream are transmitted in real time using shared signaling channel,realizing the function of remote guidance by experts.Finally,the scenario is tested,and the test results show that the network delay is low,the audio and video transmission effect is good,which can meet the needs of remote guidance.Through the test of three scenarios,it is shown that the modules in the system developed in this article can operate normally and basically meet the expected requirements.
Keywords/Search Tags:Augmented Reality, MRTK, HoloLens2, Virtual assembly, Asynchronous communication, Remote guidance, WebRTC
PDF Full Text Request
Related items