Design And Implementation Of Micro-Blog Data Analysis System

Micro-blog, referred to as Weibo, as an Internet technology based application, and its continued growth in the number of users, showing explosive growth trend. Micro-blog users through proactively "publish" and "forward" message, make the message get maximum dissemination effect in a very short time. The rapid development of micro-blog, resulting in a large number of micro blog related data, and great value hidden in these data, but the micro-blog data acquisition and data analysis technologies are still not perfect, since the micro-blog data cannot be effectively acquired and analyzed, and the analysis result display methods are relatively simple. Firstly, this paper analyzes micro-blog and its characteristics, focusing on analyzing the characteristics of Sina Micro-blog platform; Secondly, this paper carries on the research of micro-blog data acquisition method, design a micro-blog crawler for Sina Micro-blog platform which based on simulate login; Finally, this paper researches the micro-blog data analysis and result display methods, designs effective data analysis methods for micro-blog, and intuitive, beautiful, interactive display mode of the analysis results. The specific work is as follows:1) Study on the concept, characteristics and main application of micro-blog. As the research focus of this paper, the characteristics of Sina Micro-blog are analyzed.2) Study on the micro-blog data acquisition method. Micro-blog API based data acquisition method and the limit of this method is introduced. At the same time, web crawler and its methods are introduced.3) Design the data acquisition system for Sina Micro-blog, including requirements analysis, database design, and micro-blog crawler design. Micro-blog crawler design includes simulate login, webpage data extraction and acquisition methods of different types of micro-blog data.4) Design micro-blog data analysis system, including requirements analysis, database design, and data analysis methods design. The data analysis methods designed in this paper include micro-blog message keyword extraction, micro-blog message spread analysis, micro-blog audience analysis and critical forwarder found, and micro-blog spam user detection methods.5) Design the micro-blog data analysis platform based on B/S architecture, this platform uses the combination of HTML5and JSP technology, and the results of data analysis are displayed in the form of web pages.The micro-blog data analysis system designed in this paper can efficiently acquire micro-blog data, analyze the micro-blog message data, and the analysis results are displayed in beautiful and novel ways on the micro-blog data analysis and display platform, which has better user interactivity.