Interative Scene Research For Text To Scene

Designing 3D scenes is an extremely creative task.It requires professionals to complete scenes with complex 3D software,and it is difficult for non-professionals to operate 3D scenes.The aim of the text-to-scene conversion is to allow users to use natural language to create 3D scenes,without spending too much time learning 3D design knowledge and complex creative process.Based on the existing research,this thesis proposes the study of generation of interactive scene,which aims to make users design 3D scenes by natural language.Interactive scene is one of the main contents of scene visualization in text-to-scene conversion.The main research contains the action semantics of interactive text,extraction of interactive information,elements of interactive scene,reconstruction of interactive scene,etc.However,it is still lack of systematic basis theory and effective solution about these problems.Facing all this,firstly,based on the existing natural language processing technologies,this thesis studies the semantics of interactive texts from three dimensions: lexical,syntactic and semantic.Establishing a basic interactive verb words set by analyzing the interactive text,and expand it by using a data-driven method.Secondly,combined with the research of human-computer interaction,the method of extraction of text information based on interactive instructions is proposed.Through the analysis of the grammatical structure and semantic dependence of the sentence,the corresponding method of text information processing is established to convert the interactive text into an interactive instruction sequence.Then,this thesis studies the elements and their attributes of 3D scene from the 3D scene,the structure of the scene information description is used to map the text information to the scene information by analyzing the interactive of each element.And then,Considering the changes of scene elements caused by different interaction operations,the operations that result in the changes of scene layout is organized by using binary tree structure organization method,and the method of corresponding reconstruction derivation method is established.Finally,generating the interactive scene,and the simple interactive texts are taken as examples to verify the method and the technical route.The experimental results show that the method proposed in this thesis can transform the interactive text into action instructions,and modify the existing scene according to the action instructions,thus achieving the target of using text description to interact with the scene.It proves the feasibility and effectiveness of the proposed method and technical route.The results prove the validity and feasibility of the method and technology route proposed in this thesis.