Design Adn Implementation Of Assistant Maintenance System Based On Augmented Reality(AR) Technique

With the increase in the structural and functional complexity of electromechanical equipments,the traditional maintenance manner,which is heavily relied on the operator’s experience,will lead to high workload and error rates.Therefore,it can not meet the growing demand for maintenance requirement.By adopting the augmented reality(AR)technology,the operator’s cognitive and memory burden can be reduced effectively.Meanwhile,it can also help to improve the maintenance’s efficiency and quality.Moreover,AR-based assistant maintenance system provides a new technical means for the improvements of maintenance.This thesis aims to apply the AR technology in the field of maintenance,and based on the analysis of maintenance requirement,the core module of assistant maintenance system under the AR environment is designed.Meanwhile,taking a turbine engine as the example,an AR assistant maintenance system is developed.That system has the following characteristics,such as friendly human-computer interaction,multi-user coordination,and remote communication.The completed research works are as follows:(1)Based on the analyzing the maintenance requirement and system functions,the overall architecture of the assistant maintenance system is proposed.By combing the related technologies,the development process is determined.Among them,3ds Max is applied to complete the construction of the site and models,and Unity3 D is used to build the virtual scenes.Moreover,the data are collected by Kinect sensor,and C# is chosen as the programming language for system development.Finally,the software development,packaging,compilation and deployment are completed on the platform of Visual Studio.(2)Focusing on the tasks of maintenance operation,the key information of assistant maintenance is extracted and transformed to obtain the process files under the AR environment.By establishing the maintenance model,the traditional maintenance procedure is converted,transformed and stored to the process of AR maintenance.The database is designed for assistant maintenance system,and it has good flexibility and portability.(3)With the emphasis on the human-computer interaction module and collaboration module,the functional requirements and implementation methods of the assistant maintenance system are studied.The structure of human-computer interaction module is analyzed from the aspects of AR interaction,maintenance task and module elements.The system interaction task model is established.Aiming at the single gesture interaction,the development of gesture recognition module is completed based on Kinect sensor,and the function of user-defined gesture is expanded.Meanwhile,the concurrency control strategies in collaboration module and the technical route of sharing AR scene are determined.Furthermore,it is on the basis of the client-server architecture,and the TCP and UDP network communication protocol are applied to conduct the data transmission,encapsulation and analysis.(4)Based on the above works,the development and integration of relevant functional modules are completed.Moreover,the assistant maintenance system for a turbine engine is completed as a case study,and the feasibility and human-computer interaction characteristics of the AR-based auxiliary maintenance system are verified.The AR-based assistant maintenance system can help to promote the customer’s experience effectively.Meanwhile,it can also enhance the efficiency and quality of maintenance operations.Therefore,It has an important technical application prospect.This thesis has completed the design and development of the core function modules,including the backstage management,maintenance record management,maintenance guidance,multi-user cooperation as well as remote communication.The relevant research has made beneficial academic exploration and primary practice for the AR technology application in the area of industrial maintenance.