Shape Driven Procedural Plant Modeling

Plants play an important role in both real and digital scenes.With the development of computer graphics technology,3D plant models have been widely applied in areas such as video games,films,city planning and landscape design.However,due to the complexity of geometry,it's still challenging to efficiently model high quality plants Rule-based and data-driven plant modeling methods usually suffer from the problems like complex parameter adjustment,high expertise requirement and little user interven-tion.Although existing 2D sketch-based approaches support the user to design plant models interactively,they cannot guarantee to generate plausible depth valuesThis paper successfully bring the deep learning and virtual reality technology into the plant modeling area.We present three kinds of shape driven plant modeling methods,by which the users only focus on the overall shape of the target plant while the full detailed plant structure is automatically synthesized using procedural modeling algorithm.Our main contributions are as follows:1.We present a 2D shape driven plant modeling method,which combines the strengths of both deep learning and procedural modeling technology.The key to address the problem of inferring plausible 3D depth is to recover 3D shape information using a deep neural network learned from a set of synthetic plant models.we first employ a cGAN network that takes 2D sketches of the silhouette and main branching structure of the tree,and predicts two depth images one for tree silhouette and one for the trunk skeleton.These depth images are then used to derive the 3D branching structure and the overall shape of the tree for a procedural model that generates the branches,twigs,and leaves within the obtained growth space(3D silhouette).Moreover,we extent the method for reconstructing 3D plant models from a single image2.We present a 3D skeleton driven plant modeling method which explores the application of virtual reality technology in plant modeling.It's possible to directly control the plant skeleton by using 3D gestures and immersive VR devices.Our system allows the user to freely sketch the 3D plant skeleton and manipulate any part of the plant.The immersive 3D interaction overcomes the tedious operation during modeling plants with traditional software.What's more,advanced tools such as brush are provided to specify the growth trend of skeleton for creating a mass of branches3.We present a 3D silhouette driven plant modeling method which integrates mid-air finger 3D sketching in VR and automatic branch populating,and offers an ease-of-use and efficient immersive mid-air sketching interface for plant modeling and editing.The user just needs to sketch a few 3D strokes in mid-air to define the envelope of foliage and main trunks.The full 3D plant models are then generated automatically based on these shapes.The main advantage of the method is to give full play to the user's creativity and imagination.Additionally,the user can also modify the shape of plant model by freely deforming the lobes and strokesThe experimental results demonstrate that our shape driven plant modeling ap-proaches enable the user to design artistic plant models effectively and efficiently.