Research On The Key Technology Of Multi-person Collaborative Disassembly And Assembly In Virtual Training

At present,virtual training has achieved good results in practical applications,but there are still some bottlenecks that need to be resolved.Virtual maintenance or disassembly of complex equipment is one of the problems.The disassembly and assembly training of complex equipment requires the virtual environment to be as close to the real environment as possible,including disassembly logic,user disassembly and assembly actions,and so on.Therefore,it is very important to be able to accurately track and identify the user's complex disassembly and assembly actions.In addition,the disassembly and assembly of complex equipment is often not done independently by a single user,but requires at least two people to perform collaborative operations to complete it.The subject researches the key technology of multi-person collaborative disassembly and assembly in virtual training,focusing on the two core common technologies of visual perception-based freehand interaction and virtual collaborative operation,and selects the multi-person collaborative virtual disassembly of the manual gearbox of complex equipment.As a specific research and development object,the installation system can meet the needs of vocational skill training colleges or institutions that require the use of virtual training instead of traditional training.The main research work of the thesis is as follows:(1)Parametric modeling of the collaborative disassembly process is carried out,and a collaborative disassembly process model is proposed.Summarized the disassembly and assembly process;proposed a collaborative disassembly and assembly process model,which can describe most of the disassembly and assembly processes;proposed an interactive object model to describe the real interaction process;specific design of the data representation of the collaborative disassembly process model,And design the construction and update process of the model in the system.The definition of the collaborative disassembly process model lays the foundation for the subsequent research on gesture interaction and collaborative disassembly and assembly,and also makes the system have better versatility and portability.(2)Research on the natural interaction of immersive gestures for virtual training.Analyzed the interaction requirements of virtual training,and obtained specific interaction goals;proposed a gesture interaction scheme;for the interaction goals,gesture design was carried out based on the principles of gesture design,including 5 basic gestures and 3auxiliary gestures,and Developed a gesture collection system to collect raw data to prepare for feature extraction;proposed a new gesture feature extraction method for application scenarios,and compared it with other extraction methods based on the K nearest neighbor classification algorithm,and the results showed that the new gesture The feature extraction method is more suitable for the application scenarios of this article;the specific interaction process of gesture interaction is designed.(3)The key method of multi-person collaborative disassembly and assembly is proposed and realized.Based on the combined C/S architecture,a multi-person interaction workflow is designed;a virtual avatar mechanism is designed to realize mutual perception between users,which specifically includes the pose control and synchronization,creation,and destruction of the virtual avatar;A method to maintain the consistency of the scene is proposed;a cooperative operation control strategy is proposed based on the object lock method.(4)Based on the above content,a multi-person collaborative disassembly and assembly system was designed and developed,and the disassembly and assembly of a complex equipment automobile manual transmission was used as an application example.Carried out the system design,including the system functional requirements analysis and overall frame design,disassembly mode design,human-computer interaction design;proposed the automatic disassembly and assembly method of the stand-in and the automatic alignment method of the tool;the application of the example and the system analysis were carried out.