Implementation Of Augmented Reality Standbox And Research On Terfain Reconstruction Technology

In recent years,as a compelling emerging technology,Augmented Reality(AR)has been gradually applied to the field of education.The dynamic interactive experience education brought by AR enhanced the interaction and participation of education,and played a role in combining education with recreation.In 2014,with the fund of National Science Foundation(NSF),University of California-Davis(UCD)developed an Augmented Reality Sandbox(AR Sandbox)to develop the science education of earth and watershed.The AR Sandbox is a real-time AR interaction system.People can use the real sand to build three-dimensional(3D)terrain in the sandbox.The system uses the Microsoft Kinect to read the height data of this 3D terrain in real time,and passes the data to the computer.The computer processes this data to generate terrain information such as elevation color maps,contour lines and simulated water streams.The projector projects these terrain information onto the real sand,to teach students the related geography and hydrological concepts,such as how to read the topographical map,the meaning of contour lines and the knowledge of watershed.Currently,the AR Sandbox is only used for educational purposes in some interactive experience exhibition areas in the Europe and the United States' science and technology museums.Based on the augmented reality technology,this paper builds the AR sandbox system,and uses the Microsoft Kinect in the sandbox to carry the three-dimensional reconstruction of the sand topography,so that pave the way for the relevant developable military applications,such as sand table deduction,global path planning,military situation analysis and visual battlefield command.This paper 's innovation point is focusing on the real sandbox scene and proposing a three-dimensional reconstruction method using Kinect.This 3D reconstruction method can automatically cut off the edge of the sandbox and reconstruct the sand topography accurately in Matlab.This paper carries out the research from the following aspects:(1)Analyze the application status of augmented reality technology in the field of education,interactive display and military field,and the research status of 3D terrain reconstruction technology under the classification of reconstruction tools and contact situation,and lay the foundation for the research of augmented reality system and terrain reconstruction technology.(2)Analyze augmented reality technology and deep sensing tools,lay the theoretical and application foundation for the realization of augmented reality system and terrain reconstruction technology.(3)Based on the goal of the AR sandbox system,design the hardware architecture,analyze the software processing process,give the calibration method of the system,explain the principle of the system function,show the current distribution of the system,and carry the system user experience evaluation.(4)According to the basic requirements of 3D reconstruction and the special requirements of sand terrain reconstruction,propose a Kinect three-dimensional reconstruction process,which is different from Kinect Fusion algorithm,and analyze the key algorithms in 3D reconstruction,carry the three-dimensional terrain reconstruction using the depth sensor tool Microsoft Kinect in the sandbox.(5)Carry out the experimental verification and analysis for the AR Sandbox and terrain reconstruction,and prove the AR sandbox system and the three-dimensional reconstruction algorithm are correct.