Research On Plant Reconstruction Method Based On Depth Map Repair

Plant modeling has been widely used in agricultural guidance,virtual landscape,protection of ancient and famous trees,etc.And how to reconstruct plant's 3D models quickly and cheaply is an urgent problem in the field of computer vision.3D reconstruction based on depth map is a common method for plant modeling.However,due to the complexity of plant environment,repeated texture,thinner branches,and insufficient robustness of current stereo matching algorithms,it is usually difficult to generate accurate and complete depth map,which leads to the incomplete plant model obtained by depth map fusion.In order to solve this problem,a plant reconstruction algorithm based on depth map repair is proposed,and the multi-view stereo algorithm is improved by multi-level view selection method.Meanwhile,a depth map repair algorithm based on super-pixel is proposed to repair the holes and noise in the generated plant depth map.Experiments show that the plant dense point cloud calculated by the proposed method is more dense and the final reconstructed plant model is more complete.The main work of this paper is as follows:(1)In this paper,the multi-view stereo algorithm is improved by multi-level view selection to enhance the robustness of stereo matching process.The algorithm selects the matching views at image level and pixel level,which makes the neighborhood matching set more satisfy the image matching consistency requirement,reduces the hole and noise of the depth map,and improves the quality of depth map.(2)This paper focuses on the repair of plant depth map.And a depth map repair algorithm based on super-pixels is proposed to improve the ability of hole repair near the edge of the object.In the process of repairing,the algorithm dynamically adjusts the window size of the filter according to the super-pixel information,which makes the depth map after repairing more accurate and complete,and makes up for the disadvantage of the poor quality of the depth map calculated by the depth map generation algorithm.(3)Based on the analysis of the advantages and disadvantages of the plant 3D reconstruction method based on depth map generation,this paper proposes a plant reconstruction method based on depth map repair.And a series of comparative experiments are designed and carried out,and the effect of each step in the reconstruction process are shown.Meanwhile,this paper analyzes the experimental results,and proves the feasibility and validity of the algorithm through subjective and objective evaluation.