The Design And Implementation Of Cloud Storage Management System Based On Hadoop

Wit h t he rapid develop ment o f Inter net techno logy and t he popular izat ion of vario us network tools,more and more infor mat ion is starting to speed up the Internet exponent ia lly.However,these huge amo unts of data will br ing more and more proble ms,such as difficult y of data manage me nt,high cost of data storage,low reliability,difficulty in index and so on.As a result,more and more people and enterprises began to think about solving ma ny proble ms of storage mana ge ment.The establis hment of c loud storage service ma nage ment syste m has become the key to solve t he proble m of mass ive data ma nage ment a nd storage and the index of t hese data.The HDFS cloud storage mana geme nt syste m based on the as the research object,I ana lyze t he deve lopme nt of t he current clo ud co mput ing and c loud storage and the research status o f the do mestic a nd fore ign,I focus on t his top ic by t he clo ud storage system,Hadoop clo ud comp ut ingp lat form,map/reduce mecha nis m,HDFS file mana ge ment syste m,index related techno logies and so on,for this sche me provides theoretical basis.Then,co mbined with t he c loud storage system whic h is suitab le for t he environme nt,I am put ing forward the solut ion of a clo ud storage syste m and the design and imp le mentat ion o f cloud storage system based on the distr ibuted file system(HDFS),comp lets ing the overa ll architecture des ign of file storage mana ge ment subsyste m and file storage manage me nt subsyste m design,through web rea lizat io n of the file addit ions and delet ions to c hange search operation,and put ing forward a small file in HDFS processing strategy and the design of the database.Fina lly,I am designing a mass file retr ie val syste m based on c loud storage,build ing t he clo ud storage p latfor m struct ure and mass file retrie va l subsyste m fra mework,through the key sub module design retr ieva l subsyste m applicatio n design and implementation.Based on HDFS cloud storage mana ge ment s ystem meet t he enterpr ise users and the mass ive amount of data for effic ient storage needs,solve the problem of mass ive data storage,provide the user and enterpr ise some applicat ion service of high efficiency,high reliabilit y,which has certain practical value and application value.