Research On The Integration Of Heterogeneous Data Based On JSON

With big data,Internet plus the era,more and more areas using Internet technology to complete daily work.At the same time,it also produces a huge amount of data information,how to effectively realize the sharing of massive data,and some problems in the current data integration program,we need to solve.With the lightweight data interchange format,JSON technology widely used in Web,and JSON as data exchange format,fast transmission,simple structure and so on,it plays an important role in data integration scheme.First of all,heterogeneous data and related knowledge are deeply studied in this paper.This paper summarizes the causes of heterogeneous data and the main problems faced in heterogeneous data integration at present,[1].There are some problems in heterogeneous data,such as the heterogeneity of syntax and the heterogeneity of semantic in heterogeneous data,so it is necessary to find a solution.On this basis,we study the federal database method,data warehouse method and mediation model method respectively.The three main types of data integration research on contrasted,and put forward a scheme of integrating new data from.Secondly,to study and learn the latest data integration technologies,middleware technology can achieve transparent access to the data in the data integration scheme,through the introduction of middleware technology to simplify the query request,the data integration system scalability and query[2].JSON lightweight data as data integration data exchange,simplifies data query,improve query efficiency.Ontology can accurately describe domain knowledge.Data integration is domain oriented,and the description of Ontology through JSON-LD eliminates the problem of semantic heterogeneity in data integration.JSON Schema in JOSN technology describes data source and solves the problem of syntax heterogeneity effectively.On the basis of traditional data integration scheme,combining with middleware technology,JSON related technology and Ontology related technology,an improved heterogeneous data integration solution is proposed.In the proposed query processor module,the query optimizer and the selective replicator are added to improve query efficiency.Finally,combining with the field of geographic information system,a complete design scheme is proposed and implemented.The feasibility of this method is verified.The example shows that the heterogeneous data integration middleware based on JSON can realize the sharing of heterogeneous data resources and solve the heterogeneous data problems.