Research And Implementation Of Automatic Code Generation Based On Operator

As companies increase the informatization construction,software development has grown in size and complexity and the majority of software developers still use the traditional manual coding method,longer cycle and a large number of repeated work,the result often leads to project delay and cost overruns plan,code automatic generation technology research and implementation as a way to solve the problem of the importance of gradually highlight.Research of this thesis is guided by the MDA model-driven architecture methodology,which takes model as the core and is driven by model mapping.By analyzing the running process of Spark ecology and Spark computing platform,the execution code is decomposed into multi-step operators,the combination of operators is converted into data flow calculation through task scheduling based on operators,so as to realize the automatic code generation technology based on operators.The main contents of the study include:(1)Application architecture design of automatic code generation technology based on operator,including technical support and service interface design.To define the internal structure of operator which includes input stream and output stream,to realize the encapsulation of operator code.(2)To use Graphviz Dot language to define the instantiation of operators in a graphical visual way and define the DP(Data Process)file to record graph data.(3)To implement the task chain scheduling algorithm and data flow computing service based on the graph data.In the task scheduling engine,innovate the logic contour algorithm,realize the optimal path choreography of DAG and execute the code based on the sequence of operators in the task chain.The application examples automatically generated by the code verify the feasibility of this technology in article by comparing with the expected results.Developers only need to convert the business logic into operators without having to care about task scheduling and data calculation engines.In addition,graphical visualization tools simplify the operator examples process,compared to manually writing code,automatic code generation technology is much simpler and faster.