Design And Implementation Of Locomotive On-board Equipment Training System Based On Digital Twin And Mixed Reality

In order to comply with the theme of "strong base,standard,quality and efficiency" of national railway and the requirements of deepening reform of railway,integrated maintenance system reform is carried out in vehicle-mounted professional,which not only puts forward higher requirements for the adaptability and professional ability of the vehicle-mounted staff,but also has new requirements for staff training.At present,a large number of railway vehicle-mounted professional training systems based on virtual reality technology have emerged,such as the train-shifting operation training system based on VR and the railway business line construction safety training system based on BIM+VR.However,the existing system has some problems,such as lack of real-time mapping to the dynamic running state of the equipment,insufficient degree of simulation of training content,and single interaction mode.Therefore,in this paper,the application of digital twin and mixed reality technology,designed and developed locomotive on-board equipment training system,to achieve the training of training personnel under different operating modes.The main research contents of this paper are as follows:(1)Aiming at the problems of the lack of real-time mapping of the dynamic running state of the equipment and the insufficient degree of simulation of the training content in the current system,a construction method of digital twin of the on-board equipment of railway locomotive was proposed.Based on CINEMA 4D-Unity3 D platform and five-dimensional digital twin model,through the analysis and creation of five parts,including physical device running state analysis,virtual device modeling,twin data acquisition,real-time data-driven digital twin and human-computer interaction interface creation,the device sensor acquisition node is analyzed and optimized.Based on serial communication technology,real-time data interaction between physical equipment and virtual model is realized,and real-time training guidance based on equipment running state is provided for participants.(2)Aiming at the problems that the current training system has a single interactive way and cannot realize the whole process virtual simulation,a registration fusion method of virtual-real environment based on Hololens2 is proposed.Firstly,Hololens2 equipment was used to realize mixed reality training environment perception,real-time tracking registration of virtual objects,and correct superposition of virtual objects in virtual space.Secondly,by evaluating the accuracy of recognition and classification of on-board equipment by Mobile Net V3,Rep VGG,SE-Resnet and other networks,the recognition accuracy rate is statistically analyzed,and finally the optimal algorithm for image recognition and classification of on-board equipment is selected.Achieve real-time and independent acquisition of current training equipment-related professional knowledge and training guidance programs.(3)Design and implement a training system based on digital twin and mixed reality technology.The system includes digital twin module and mixed reality module.In the digital twin mode,the system can realize the guidance of standardized work flow,and students can independently check the standard work guidance according to their own work progress.In mixed reality mode,the system can initialize and analyze the information of each collection node and judge the preset equipment faults.Students can choose training guidance independently according to the search progress.The system provides corresponding troubleshooting solutions,judges the consistency between the students’ processing conclusions and the preset fault points,and gives corresponding prompts.Help trainees master troubleshooting methods more effectively.