Font Size: a A A

Research And Implementation Of Load Balancing Strategy Based On Distributed Database HBase

Posted on:2019-02-01Degree:MasterType:Thesis
Country:ChinaCandidate:W XinFull Text:PDF
GTID:2428330593950502Subject:Engineering
Abstract/Summary:PDF Full Text Request
With the rapid development of network technology,many multimedia projects require a large amount of computer data storage and reading.If such a large amount of data is only on a single computer and processing is performed within a specified period of time,it is impossible to complete it.In order to solve these problems and meet the needs of network technology development,a distributed database was proposed.At the same time,HBase's load balancing problem has begun to appear during the development of the distributed database HBase.In the HBase distributed database environment,due to the differences in the performance of the distributed database nodes,the amount of stored data,and the number of database access requests,the load on each node is often very unbalanced.Therefore,through certain load balancing measures,the load of each node in the distributed database is adjusted to achieve an almost even distribution and the performance of the distributed database is improved.The load balancing technology can distribute requests to nodes with low load according to the current working state of the distributed database and load information of nodes,and can periodically adjust the nodes in the distributed cluster through load migration.The load tries to make the load of all nodes in the distributed database roughly equal.Based on the research of HBase original load balancing algorithm and some load balancing algorithms in distributed database,this paper proposes an improved load balancing algorithm based on hotspot access.The improved algorithm is mainly aimed at the problem of hotspot access load not solved in the original algorithm.When a distributed database has a load problem due to hotspot access,if there is no corresponding measure to deal with the solution,it will have a serious impact on the distributed database.The purpose of improving the algorithm is also to solve this problem of the original algorithm,thereby improving the performance and security of the distributed database with hot spot access load problems.This dissertation focuses on the problem of load balancing under different conditions of distributed database nodes.When the performance of each node in the distributed database is not the same,load balancing will be more difficult to achieve.Because the load balancing strategy is implemented by analyzing the data of each node in the distributed database and performing analysis and calculation,new considerations need to be introduced to solve the problem if the node performance is not the same.The percentage of this factor is introduced in the improved algorithm of this paper to deal with related issues,so as to improve the performance and security of the distributed database with load balancing problems due to different node performance.In the final part of this paper,the improved load balancing algorithm based on hotspot access and the improved load balancing algorithm under different node performances are validated through extensive experiments.The experimental results show that the proposed algorithms are effecitive and the performace is improved.
Keywords/Search Tags:HBase, load balancing, hotspot access, distributed database
PDF Full Text Request
Related items