Font Size: a A A

Research On The Collaboration Of Hadoop Data Platform And Data Warehouse

Posted on:2017-05-29Degree:MasterType:Thesis
Country:ChinaCandidate:S Y WangFull Text:PDF
GTID:2308330488950506Subject:Physical Electronics
Abstract/Summary:PDF Full Text Request
The overheated housing market has led to the property glut, reducing the number of unsold houses has become the solution to the current economic problems. Building up a big data platform shared data related to population,real estate,land,bank and trading,then mass data are analyzed, government departments will make decisions on the basis of these analyses, and the real estate companies can use these analyses to develop marketing strategies, planning new projects,as a consequence,the goal cleaning the property glut will come true.Hadoop big data platform can storage structured data,unstructured data,and semi-structured data at low cost, and own powerful data processing capacities,as a consequence,Hadoop big data platform is the best choice for the information platform of real estate. Gathering the various types of data related to real estate, and achieving data transfer will contribute to build up a data warehouse.Data mining and analysis technology of data warehouse are good means of making decision and planning projects.In this thesis,first of all,the technical framework and advantages of Hadoop big data platform have been analysed, which based on the introduction of cloud computing;in the second,the information platform has been bulit up according to the needs of real estate,and using Sqoop to design and implement data transfer between Hadoop big data platform and database according to the requirements of data transfer; in the end, the experimental results of data transfer have been showed.
Keywords/Search Tags:Cloud computing, Hadoop, Data transfer, Data warehouse
PDF Full Text Request
Related items