Real Estate Data Analysis System Based On Elasticresearch

As China's information society enters the advanced stage of development,the generation speed of Chinese Internet data in the era of big data is getting faster and more decentralized.With the rapid development of China's real estate market and Internet construction along with the social economy,the traditional real estate data analysis method has obviously felt inadequate.So a various real estate companies and sales websites have been being springing up everywhere,such as 58.com and ganji.com.The real estate data analysis technology oriented to big data analysis has comeinto being.It can not only effectively process massive resources,but also can transform them into structured data for analysis,However,as far as domestic researches on real estate big data are concerned,they are more theoretically grasped and interpreted,lackingresearches and practice on the system in this field,sothere is an urgent need for further landing.This thesis mainly does the following work:(1)The ELK Real Estate Big Data System Platform is built,and the ElasticSearch node cluster is used to implement the indexing of the whole network data in an easy-to-understand "Inverted Index" manner.Compared with the traditional data retrieval tools,the power of ELK is more achieve efficient,stable,and fast retrieval;use Logstash's custom plug-in to configure the specification data format and configure field filtering;through Kibana,the retrieved data can be displayed in a simple,beautiful and multivariate visual interface,so that the changes and trends of real estate analysis data can be seen at a glance.(2)In this thesis,machine learning Xgboost algorithm is used to extract the important influencing factors of real estate prices.The system is tested by Russian Housing Market data set,which includes not only solid factors such as house type,floor,decoration,location,orientation,environment,but also dynamic factors such as data from Russian macroeconomic and financial sectors.(3)To Add security enhancement modules and provide external protection for real estate big data systems,mainly the functions of data encryption,legal authority and extension of cluster are configurated to ensure the entire system operate normally and continuously.