Real Time 3D Reconstruction For Mobile Terminal

The real-time 3D reconstruction is a very popular research field.It scans the scene with a camera and automatically generate an accurate 3D model.This algorithm has a wide research prospect in the fields of augmented reality games,robot indoor navigation,AR furniture display,etc.The existing research can only use the sparse point cloud to construct the mesh,and the model is not able to represent the accurate 3D information of the scene,so it is difficult to apply.Therefore,it is necessary to study a more accurate real-time 3D reconstruction algorithm.Based on ARCore,this project realizes the real-time 3D reconstruction algorithm on the mobile end.The mobile phone's camera is used to scan the scene,and ARCore tracks the image sequence and outputs the key frame with pose,then the incremental dense reconstruction algorithm generates the 3D point cloud of the scene and the two-thread programming strategy is used to generate the 3D model of the scene in real time.Firstly,semi dense matching algorithm is used to expand seed points and then seed points are constrained and sorted.The information of the neighborhood patchs is used to optimize the initial value when generating new patchs,so as to make the generated point cloud more smooth.Finally,in order to reduce the time complexity of point cloud diffusion,the multi-resolution adaptive diffusion strategy is used to accelerate the algorithm.Then the PMVS algorithm is improved to incremental dense reconstruction algorithm,and the optimization strategy is proposed to solves the problem of slow reconstruction caused by the increase of images.In the end,a new strategy is proposed to generate 3D model in real time.One thread constructs a global mesh to ensure the integrity of the model,the other thread constructs a local mesh to ensure the real-time generation of the model.Then the original mesh is simplified and the wrong patches in the model is deleted by the mesh clean algorithm.In this paper,the validity of real-time 3D reconstruction algorithm is verified by experiments,and the 3D model of scene with high accuracy can be generated in real time by using visible camera on the mobile end.