Sand-based Virtual System Based On Multi-touch

With the rapid development of virtual reality technology,computer graphics and computer hardware and software,2016 was defined as the first year of VR.A lot of virtual reality technology scholars and computer hardware and software manufacturers have put into the virtual reality technology.Virtual reality technology has been an unprecedented development,is widely used in stadium simulation,real estate roaming,online pavilion,online viewing and many other aspects.The thesis has developed and designed the sand painting virtual system,on the background of representing sand painting training by virtual reality.Through the extensive reading and in-depth analysis of the three-dimensional virtual scene construction technology and touch screen somatosensory interactive control technology related literature,as well as the technology in-depth research and innovation for the sand painting virtual system development process difficulties encountered a complete and effective solution Program.The main work of this topic is as follows:(1)A sand painting training indoor environment and desertification training props have been designed,and a sand painting training drawing board has been developed.With 3ds Max modeling software,a three-dimensional model of the indoor environment and props have been built.A real-time drive has been achieved by introducing a three-dimensional virtual scene completely built into Unity 3d three-dimensional engine.Collision detection optimization of the three-dimensional model has been accomplished by substituting simplified grid for complex models.Through the VS 2013 platform,C # language,WPF system sandpaper training drawing board has been developed,possessing various functions that sand painting needs.(2)This paper has carried on the thorough research to the question of the multi-touch indirect instruction,on the basis of the thorough analysis of related literature at home andabroad,a multi-touch sand painting gesture recognition system has been proposed,which is controlled by time,space and shape information.The recognition system has been realized by gesture graphics modeling,clustering algorithm,reference method HBF49,graph embedding method and SVM classification.Experiments have shown that the accuracy rate of the recognition system is as high as 94.75%.This study provides a solid theoretical foundation for somatosensory interactive development of later software.(3)The virtual sand painting drawing board and PQ Labs touch screen have been made able to complete multi-touch interactive work,and 10 kinds of sand painting training gestures commonly used have been defined.The second development of the PQ Labs SDK on the VS2013 platform has made the sand gesture defined by the virtual sand painting drawing board recognized by tracking the time,space and shape information of the gesture,to achieve the system of physical interaction;software development is completed,the software testing and user experience work.