Design And Implementation Of Human-computer Interaction System For Virtual Fully Mechanized Mining Face Based On “Human-machine-environment ”

Fully mechanized mining face is the main working area of coal mine production and also the high risk area of accidents.At present,great progress has been made in the research of intellectualization of fully mechanized mining face,and preliminary application has been realized.The number of workers has been greatly reduced,but it is still not satisfactory.Therefore,the research of fully mechanized mining face is of great significance to realize intelligent mine and green production with less and no people.Virtual reality technology,as a new technology means,has the characteristics of immersion,interaction and multi-sensory.It is the supporting technology for the construction of digital twin intelligent mining face.Combined with the characteristics of virtual reality technology and fully mechanized mining face production,it is a good method to realize unmanned production of coal mine by using virtual reality technology to construct virtual fully mechanized mining face from human-machine-environment and realize human-machine interaction.Through the method of demand analysis,this paper analyzes the demand and designs the architecture of the man-machine interaction system of the virtual fully mechanized mining face,uses the virtual reality technology to build the panoramic fully mechanized mining face scene,realizes the functions of interface interaction,character roaming,equipment operation and large-scale transmission,integrates the HTC vive interactive equipment to improve the immersion of the system.Finally,the interaction between virtual face and virtual face is realized.The main work and research results are as follows:(1)Based on the method of demand analysis,in the process of the overall design of the human-computer interaction system of the virtual fully mechanized mining face,the design goal of the system is established,and the relevant requirements of the system are analyzed from the two aspects of functional requirements and non functional requirements.On this basis,the framework of the overall architecture of the system is set,the software and hardware design of the system is determined,and the overall framework of the design and implementation of the system is established.(2)Based on the scene construction principle of "human-machine-environment",the construction mode of virtual fully mechanized mining face scene is obtained.Using 3ds Max and other modeling software to model and map the characters,equipment and roadway,and make the character bone skin and action.Using unity3 d to simulate the mine environment from the three aspects of sound,light and particle effects,the full view construction of the virtual fully mechanized mining face is completed,which lays a good foundation for the construction of the system.(3)Based on human-computer interaction theory and virtual reality technology,the human-computer interaction system of virtual fully mechanized mining face is constructed.The interactive interface of the system is designed by using UGUI,which realizes the various roaming modes and equipment introduction of virtual miners in the virtual scene.The function of hydraulic support operation is realized by using UI interface interaction and manual interaction,and finally the development of human-computer interaction of the system is completed.(4)Based on HTC Vive interactive equipment,the human-computer interaction mode of the system is expanded,so that users can operate the system through the handle,and the problem that users are vulnerable to external interference is solved.After the release of the system,the complete function test of the system and the performance test of Profiler based on unity3 d are carried out,the satisfactory test results are obtained,and the design and function of the system are verified.Based on the user test method,the user experience of the system is analyzed qualitatively and quantitatively,and the human-computer interaction design and user experience of the system are verified by experiments.Through the research on the human-computer interaction system of virtual fully mechanized mining face,this paper puts forward the design scheme of the human-computer interaction system of virtual fully mechanized mining face,realizes the relevant functions of human-computer interaction,completes the design and implementation of the system,lays a certain foundation for the combination of fully mechanized mining face and virtual reality technology,and provides technical support for the virtual real interaction technology of digital twin and CPS.