Research On Data Exchange Technology Based On Datasets

In the life cycle of data, the relevant data with a subject is often as a data collection,starts from the source data, is exchanged, stored, audited, and used in different business links.The current data exchange technology mainly focus on the integration of the heterogeneousdata, and ignores the organization and management in the data collection of the data exchangeprocess, such as revoking the unqualified data, and tracking the data exchange process, etc,the importance of the data in the data exchange is ignored. At the same time, the dataexchange file usually just contains the data itself, lacks the data structure information in theheterogeneous system, and we are not sure of the data structure, so there are a lot ofdifficulties in the data integration.To the above problems, this paper puts forward a method of the data exchange modelbased on dataset, with the datasets as unit, and describing the exchange data structure,tracking the exchange process. The main research contents are as follows:1. This article introduces the research on the data exchange technology based on datasets.The dataset brings into the process of the data exchange, with the unification regulation of thedescription. The semi-structured data, the structured data and the unstructured data putforward the definition and representation based on datasets, meet the consistency and integrityof the dataset in the whole life cycle of the data exchange. At the same time, this article putsforward the operation of the datasets custom made, the expansion, the cancellation, thecombined, thus, realizes the datasets management in the whole data exchange life cycle.2. This article introduces a meta model to describe the datasets. According to thedefinition of the datasets, this article designs the datasets meta model, describes the basiccontent of meta model, such as the name, the conditions, the data type, the quality constraintcondition, ensures the integrity and consistency of the datasets, realizes the data exchangeprocess based on datasets.3. This article designs the mapping rules based on XML. The relationship of the datasetsand the mapping files is described, and meets the integrity between the source and targetdatabase, according to the source model and the target model of the data collection such as thedata table, data item, this article gives the data mapping rule between source model and thetarget model, according to the description of the rules, to realize the data exchange. On thisbasis, this article achieves the data exchange service platform.At last, summarize this topic research, the article develops the data exchange systembased on datasets, and uses in the "oil field development base material exchange management system", this system uses in the daqing oil field, verifies the feasibility and effectiveness ofthe data exchange based on datasets.