Real Estate Transaction Big Data Analysis Application System Based On Hadoop

In the field of housing and urban construction,with the wide application of various information technologies in this industry,the vast data output of the primary implication relates to information about different dimensions of the industry development,and has shown the characteristics of big data,the traditional information processing technology has been unable to adapt to the needs of urgent change of data storage structure and data processing mode.Meanwhile,Hadoop as an open source of big data storage and computing framework,has become synonymous with the era of big data,has been widely recognized and applied in all walks of life.However,the current big data analysis of real estate transactions mainly stay in the theoretical study,the industry application based on Hadoop is also not complete owning to the lack of data dimension and data volume,which is difficult to give the industry a comprehensive decision support.Full thesis carries on research of real estate transaction data analysis and application which based on CDH--the open source Hadoop distribution version,describes the deployment of big data cluster test platform,analysis?design and implementation of the real estate big data report system and real estate big data analysis and visualization system,forming "one platform and two systems" framework.First of all,this thesis studies the basic theory of big data and the frame theory of system development.In the aspect of basic theory of big data,this thesis studies the angle of data analysis and the main components of Hadoop ecosystem,and selects Kylin as the multidimensional data analysis engine.In the aspect of system development framework,the architecture of B/S and C/S is compared and analyzed,the Web Forms architecture based on ASP.NET and the SSM architecture based on Java are analyzed.Then,according to the framework of "one platform and two systems",this thesis deploys a big data test platform based on CDH and Kylin,and optimizes the configuration of the basic environment.This thesis describes the analysis,design and implementation of real estate big data report system and real estate big data analysis and visualization system.Finally,combined with the actual test data,test and demonstration of the "one platform and two systems" has been given.Through the test and demonstration of the systems,the systems meet the requirements of the initial design,and achieve the goal of the system design.