Research On Multi-Camera Virtual Experiment Platform With MR Glasses Based On Kano Theory

In this information highly developed time,many aspects of human society are changing quietly.More and more things are changing from the real to the virtual,and the real and the virtual have merged,helping human beings to better carry out actual production and life.Among the real world,virtual world and users,we connect them by building an interactive feedback information loop through a technology,namely Mixed Reality(MR).This interactive method based on the real world and augmented by virtual data provides a brand new way of education.The technology combined with smart glasses is widely used in teaching and training fields.Through the research of traditional middle school students' physics and chemistry experiment courses,this thesis summarizes two main issues.First,students often need to understand the flow direction of DC current,the density of magnetic lines of induction and the flow between NS poles,wave motion trajectories,and microscopic biochemical experimental phenomena in experiments,which are often impossible or difficult to observe in reality.Second,some experiments may have potential dangers such as electricity,corrosion or combustion,which cannot completely guarantee that students will learn experimental knowledge without danger.Based on this,MR technology provides new solutions for the new era.Through the function of harmless virtual presentation,traditional experimental phenomena can be observed under the condition of ensuring the safety of the experimenter,and dynamic current and magnetic lines generated by virtualization can be observed.At the same time,this research platform uses texture markers trained offline to ensure that virtual current and magnetic induction lines can be seen to move and rotate with real objects accurately,and the experimenters will know the virtual object represented by the texture patterns before the experiment.The work of this thesis focuses on the application of mobile MR technology to the experimental education of physics and chemistry in middle schools.A set of mobile MR experimental platform was developed based on the experiments of physics and chemistry in middle school.Compared with the desktop fixed multi-camera MR platform,the platform proposed in this thesis has greater flexibility and natural operating experience.The desktop fixed multi-camera MR platform requires the experimenter to interact with fingers marked with color,and the user must stare at the fixed screen to operate.However,the mobile MR experimental platform allows experimenters to wear MR glasses and observe freely,and it supports natural gesture interaction and voice interaction,giving a more friendly user experience.Kano theory provides theoretical guidance for the research of the mobile MR experimental platform.In this thesis,we evaluate the camera capture and multi-camera tracking function,texture identification function,natural gesture interaction and voice interaction of the mobile MR system.Kano model is used to quantitatively evaluate the weight of each demand indicators,thereby determining the development priority.For the user study,the desktop fixed multi-camera MR platform was used as the control group.Many pedagogy-related volunteers participated in our experiment.The analysis results show that the mobile MR experimental platform has better interactive experience and visual enjoyment than other platforms.