Motion Reconstruction Technology For Collaborative Plotting Of Augmented Reality Electronic Sand Table

In the military field,sand tables are widely used in situational deductions and operational discussions.With the rapid development of computer technology,in order to meet the diversified,intelligent and personalized needs in the process of interaction on sand table,the electronic sand table came into being.Through the electronic sand table,the seminars are able to plot and interact collaboratively on the battlefield,greatly improving the efficiency of the seminar.However,the existing electronic sand table is mainly presented based on the touch screen or two-dimensional projection.In the process of co-plotting,there are some problems such as inconvenient communication by the seminars,unintuitive display,and unnatural interaction.In order to solve the problems existing in the traditional electronic sand table collaborative plotting,this paper designs an electronic sand table collaborative plotting system based on augmented reality.The main research contents and innovations of this paper include:(1)An electronic sand table system based on augmented reality is studied and implemented.The system includes scene modeling,plotting function module,multi-person collaboration module,natural interaction module and motion reconstruction module.Through these modules,the common military sand table discussion function is realized.The test results show that the system can meet the basic functional requirements in the sand table discussion.(2)A collaborative plotting technology for augmented reality electronic sand table is studied and implemented.This technology allows the system to share the electronic sand table through scene sharing technology and control the plotting process through multi-channel natural interaction technology.Users plot on the electronic sand table by natural interaction,and the plotting results will be synchronized to other users in real time.Concurrent control and conflict resolution strategies are designed to solve the multi-concurrency and conflict problems in the process of collaborative plotting.The test results show that the results of any user's natural interaction plotting will be restored and displayed in other users' scenes in real time.(3)In order to realize multi-person collaborative plotting,a multi-person motion reconstruction technology for collaborative plotting is proposed.The technology is divided into two parts,one is multi-user detection and tracking algorithm for collaborative plotting,the other is human 3D motion reconstruction algorithm based on improved ResNet network.Firstly,multi-user detection based on YOLOv2 and multi-user tracking based on Unscented Kalman filter are carried out.Then each user is inputted into the improved ResNet network for threedimensional pose estimation,and human motion redirection is carried out by combining kinematics and space-time constraints to drive the motion of the virtual avatar.The experimental results show that the algorithm can effectively reconstruct common actions in collaborative plotting,and can support multiple people.This paper studies and implements an augmented reality electronic sand table system,and studies and implements multi-person collaborative plotting and motion reconstruction technology according to the requirement of collaborative plotting in application.These technologies can broaden the application scenarios of augmented reality electronic sand table,enhance the practicability and intuition of electronic sand table interaction,and improve the efficiency and immersion of collaborative plotting process.