Reserch On Data Sharing Model Based On Hadoop Architecture

With the development of informatization, the independent work mode of regionalmaterial system have already can’t satisfy the needs of regional material sharing anddispatching each other. IDC digital universe research sponsored by EMC, pointed outthat the global amount of data to double every two years, in《To extract value fromchaos》. In2011, the amount of data that created and copied was to1.8ZB. Theinformation society has entered the era of big data. How to deal with big data andimprove its application value is one of the research hot spot in computer field.Traditional ways of data sharing couldn’t satisfy the needs of large amount storageand compute. Now a new data share method need to be engendered.Data share is made to operate the data that stored in other systems by differentcomputers and users, and these computers or users could compute and analysis thosedataset. It reported common problem of many software systems and current situationof development of Hadoop in this paper. Also the theory of distributed database andparallel computing and Hadoop technology ware studied. Then key technologies wareanalysised.We researched the architecture and theory and defects of traditional data sharemodels-middleware data share model, data warehouse data share model and P2P datashare model. In order to resolve defects of traditional data share model, HBase datashare model is put forward, based on data warehouse data share model. We alsoanalyzed the advantages of HBase data share model by number of study method,compared to traditional data share models. At the end, so as to prove the feasibility ofHBase data share model, the HBase data share model is used in material dispatchersystem. During the process of realizing material dispatcher system, functionalrequirements ware presented by function analysis method, then carried on the detaileddesign and produced main function modules. During the process of realizing materialdispatcher system, the problems of material coding disaccord and data join withHBase database are solved.In recent years, our country is reconstructing material management anddispatcher system. It is convenient to comprehensive dispatch and entire monitoringof materials with material management and dispatcher system. Under the situation ofreconstructing material management and dispatcher system, it is of great significanceto realize the material dataset sharing, increase the material dispatching coordinationin different region, satisfy the requirement with large data volume sustain increase andprocessing, improve reliability of system, using HBase data sharing method that putforward in this paper.