In Energy Data Storage System Based On The Hadoop Multilevel Index Table Dht Algorithm Research

In the21st century, energy has become a serious impact on people’s productionand life. For example: Sustained shortage of electricity, coal resources and the price ofnatural gas continues to increase with the expansion of demand. At the same time, theconsumption and development of electric power, natural gas, coal resources and so onproduced a great amount of data. If we ability to store and manage these data, it willprovide us with an effective way for energy saving and high efficiency. The traditionalrelational database SQLSERVER, MYSQL, ORACLE, although at present still canbarely meet the storage needs, but the need for a large capacity storage space andextension are all bottleneck. In addition, low query efficiency is very obvious when thetraditional relation database in the face of massive data conditions.There is an urgent need for us to solve the massive data storage and data searchproblem. A very suitable scheme for the condition is the cloud storage technology. Atthe same time, how to efficiently and accurately find the needed data page referred to akey problem.This thesis first introduces the current background and the significance of thesearching algorithm based on cloud storage, then in detail introduced the relatedtechnology and noun. According to the energy characteristics of the data and hbase, wedesign a Hadoop and Hbase based distributed cloud storage architecture to manageenergy storage and data. We achieved in Hbase database query, and then optimized theexisting data model, then design a Multi level index table DHT algorithm(*DHT).And realize the algorithm simulation through the Map Reduce programming model. Theresults of simulation prove that compared with the traditional data search method andthe existing search algorithms, the*DHT algorithm in cloud storage distributedenvironment has a higher performance.The success of Hadoop based energy data storage system and multi level indextable DHT (*DHT) algorithm has important significance. Hadoop and Hbase systemcan install in ordinary computer cluster. When the number of computer reaches a certaindegree it becomes a cloud storage platform. The system has a very high feasibility, which means that the research in the future has highly realistic meaning and practicalvalue.