Design And Implementation Of Civil Data Administration System Based On Hbase And MemcacheQ

The study of Civil data administration system based on Hbase&MemcachedQtechnology.Modernize Civil work by information is an important mission of Civil work in new period.But problems come forth continuously with data dispersal under internet age, i.e. search andanalyse data is very difficult due to data be stored in different computers. Facing the hugeamount data age, the investigation focus on data combination, calculation, statistics andabstraction is imperative. The study of Civil data administration system based on Hbase&MemcachedQ technology is aim at construct a efficient and economical Civil datamanagement system by a distributed&extended data frame, data input&out throughcoincident date entrance.The data of Civil work is huge and complex, so data management always puzzle theworkers. This paper will construct Civil data management system by followed technology：1. Message array MemcacheQ.Message array will establish a coincident data entrance to insert data into Hbase in order. Itcan lighten pressure of data delivery. MemcacheQ is buffer level to solve interface programby file dispersed loading, the process is that MemcacheQ is as temporary saving vehicle in amass of data array to save data in message array, realize non-obstruct and real-time datastorage by Linux Shell program. Store data into dispersed Hbase data base and ensure the datasafety and integrity.2. Hbase.As a permanent distributed data base, Hbase can save data by divided stack. Each stackdistinct type and format to meet different data variation. HStore storage is the core of HBase,it comprise by two components: one is MemStore and another is StoreFiles. MemStore isSorted Memory Buffer.Ensure high efficiency data storage by internal memory store. Data form multi-node storagethrough graded combination and copy, to realize multi-node storage and to ensure HBase I/Ohigh efficiency. 3. Virtualbox.Virtualbox can divide server to N pieces virtualboxes, different virtualbox load differenttasks and data pressure, realize data subsection and subitem. The distributed technologycombine with Oracle virtualbox make N physical hardware to run under basic Linux security.To run Virtualbox on Linux, to carry out page terminal management by PHP on Virtualbox.Itcan carry out Cpu and internal memory distribution autonomously according to operation andphysical hardware, construct a flexible virtualbox management frame.4. Memcache.Memcache as buffer memory data center of interface application visit level, it has characterof high efficient and easy operate. It store user ID, data input, helpness on line, so makeinterface visit faster.The paper investigation is aim at decrease huge data maintenance time and cost, to providebetter mass of data management, to reach the demand of data stastics and analyse. Focus onthe complex application of Civil work, the paper establish primary Civil data managementsystem basing on dispersed internet structure. The system has high combine pressure andmulti-data support capability during application, and ensure sharing function in manyorganizations. During the application, the system will optimize continuously, we will solvethe coming problem by technology optimization to make the system more and more perfect.