The Study On Construction And Query Of Mobile Application Modelling Language Based On Sketch

With the continuous development of Mobile Internet,mobile applications with excellent UI design are more likely to stand out,so UI-driven research has received extensive attention.There are already mature platforms in the industry that provide the dragging ability for visual components to help users finish their UI design.However,these modeling approaches tend to be heavyweight,which means users need to learn enough prior knowledge and pay attention to many details when modeling.Obviously,these complex modeling tools are unsuitable for preliminary UI designers who only care about what the components do.Therefore,this paper considers using sketch to complete the UI drawing of mobile applications on paper,and proposes two sketch recognition algorithms to realize the persistent storage of the model.In addition,except for the simplification of modeling method,if the newly designed models are connected with some existing models,the cost of subsequent development of numerous applications can be saved,that is,the application of model query in such aspects as software reuse.However,the rapid growth of mobile application data makes query more challenging.Most of the existing query methods use semantic similarity to retrieve a single UI,which ignore the visual information in a UI and the jump relationship between each UI.In order to solve these problems,this paper further proposes a multiUI dynamic jump model query method based on a sketch,which enables users to query similar applications or their local functions more quickly and flexibly.Based on the above analysis,this paper proposes a Sketch Modelling Language and two corresponding recognition tools.Besides,a lightweight query method of sketch model is provided.This paper includes the following two parts:1.This paper proposes a Sketch Modelling Language(SKML)through bottom-up statistics of existing applications,and designs the corresponding user-friendly lan-guage style.Users can draw mobile applications according to the SKML language style with only a pen and paper.After two sketch recognition algorithms are pro-posed,this paper defines a persistent storage method for sketches,including the information of a single sketch UI and the run-time jump information between dif-ferent sketch UI.Through the statistical analysis and user research,this paper shows the effectiveness of SKML and the high accuracy of the sketch recognition.2.This paper proposes a multi-UI sketch dynamic model query method(Model Search).Based on a mobile application asset repository(App Repo),considering that single sketch UI similarity calculation is easily affected by sketch instability,this paper implements a T-step iterative updating method,which can make use of the multi-UI run-time information in the sketch and the basic similarity calculation of UI to realize the more accurate real model mapping of the sketch model in App Repo.Model Search calculates the similarity between the sketch model and the real model to get the application models with high similarity compared with the sketch,which is the query result.The evaluation experiments of Model Search show its effectiveness and usability.