The Research And Implement Of Big Data Solution For Enterprise Based On Hbase

In recent years, the data growth has showed a rapid increasing trend in manyfields such asscientific research (biology, astronomy, etc.), computer simulation,bank securities and medicalstatistics. At same time, the data models of enterprisesstored has presented diversing, includingunstructured, semi-structured. Managingand analyzing these various types of data is also a bigchallenge to the enterprises.Based on the above requirements, the paper has referred to manytechnologiesrelated to big data nowadays, summarized the system architectures ofsomeenterprises which owned huge amounts of data. Coming of the era of big data, look at themin the individual economy, the research in the field of enterprise value and charm of the data,data is the value for the enterprise. Big data driven innovations will incorporate new enterpriseapplication system architecture. But now the technology is still in its infancy, and there is no aset of relatively complete, general enterprise big data solutions, many companies have started toface the great challenge of mass data storage and analysis. To solve above problems, the Internetcompany and IT companies, this paper puts forward the calculation model and solution, theanalysis of the deficiencies and the actual demand of the enterprise, designed a set of corporatedata analysis module based on Hbase solution, give full play to the storage efficiency andscalability of the distributed database, using the Hibernate framework, construct a set of datastorage solution and data analysis scheme based on Hbase, and unified the development interface,reduces the learning cost of developers. And provides an incremental data synchronization tool,which is a blend of enterprise business service module and data analysis module. Accordinglythe more general to solve the enterprise facing the huge amounts of data storage and analysis ofpressure.By analyzing the commonness anddifferences, learning from the ideas of datapersistence and middleware, the paperdesigned and implemented a big data solution forenterprise based on Hbase. Firstly,for the lack of interface support of Hbase storaging data, weused Hibernate OGMframework to develop a persistence driver for Hbase, which made theapplicationcomply with the features of object-oriented. Secondly, for the lack of queryfunctions of Hbase, the paper integrated the Hbase and Hive and made the Hive QLapplied to Hbase,which enables the developers take full advantage of the resourceprovided by the systemarchitecture. Thirdly, the paper designed a datasynchronization tool for incremental data to makedata analysis module apply toenterprise business module much better. The users can set up thetable and time forsynchronizing data. Finally, the paper demonstrated the performanceandeffectiveness of the solution designed by the author through a test program on apracticalsystem of a medical information platform.The Hbase system is added on the data analysismodule eventually and solvesthe challenges without much cost, without affecting enterprisebusiness logic,...