Research On Graphical Programming Platform For AR Works Creation

Augmented Reality(AR)technology has been widely used in many industries.With the expansion of application fields of AR technology,AR works have a high demand in the aspects of simple creation,rapid creation and convenience.However,for designers and end users without programming technology,they lack tools for the rapid creation and development of AR works,so it is difficult to design their AR works in an efficient and intuitive way.Therefore,in view of this problem,this paper studies and implements a graphic programming creation platform for AR works creation,which supports the rapid design of AR works without the need of technical knowledge of AR development,so that designers can create AR works efficiently and conveniently.The main research work of this thesis is as follows:(1)Summarize the advantages and disadvantages of conventional AR development process,build a new AR creation process model,and formulate the corresponding terminology specification.Firstly,this paper deeply investigated the current situation of AR rapid creation platform at home and abroad,and summarized the conventional AR work development process into four steps,namely,"AR material modeling,development environment construction,programming development and work release".The difficult,complicated and cumbersome process steps were modularized and encapsulated.Using graphical programming technology,establish the platform AR work creation process model and sort out the relevant terminology specification.(2)A concept of AR work elements and realize its visual expression method was proposed.The common AR editing object attributes are divided into virtual model,3D registration method and model animation.Finally,a unified AR work element set is produced,which serves as the basis of AR design of the platform.To solve the dynamic loading problem of the virtual model,the SDK interface of the native FBX,OBJ and other model files is used to read the data,and the coordinate consistency of the imported model is accomplished by the coordinate adjustment algorithm based on the AABB bounding box.A 3D animation design method based on motion sequence is proposed and realized.The 3D registration method is connected to the ARFounadtion development kit,and two registration methods based on logo graph and plane detection are realized.(3)A graphical programming technology based AR works element editing method was proposed.Using graphical programming design train of thought,first define the graphical programming module,variables,operation and statements in the related parameters in the design work of AR elements to programmable object,using graphical approach to all modules are visualized as simple splicing block,spli cing rule definition graphics module,translation,interpretation rules.The logic and algorithm construction between the elements of AR works can be realized in the process of jigsaw,drag and drop,filling,etc.(4)Design and implement the AR interaction method was used in this platform.Including front-end design and button interaction method based on event trigger;Six kinds of AR screen gestures are designed and implemented based on the data changes of screen contacts,which are used for virtual model editing and AR works browsing on mobile terminals.Based on monocular RGB image and convolutional neural network algorithm,the recognition of three static gestures is designed and completed,which enriches AR interaction mode.(5)A graphical programming platform software for the creation of mobile augmented reality works was developed.Based on Unity3 D engine and using mobile terminal as publishing platform,five modules including file parser,AR editor,AR debugger and AR browser are designed and implemented.Comparison of case results shows that the platform is convenient and friendly to a certain degree.