Large-Scale Weibo Data Forwarding Relationship Extraction And Event Merge Technology Research And Implementation

Microblogging,i.e.,known as weibo,is a kind of relying on Internet technology applications,in recent years,the user scale expanded year by year,expand the range is very obvious.Users according to individual be fond of active use of weibo "release" or "forward" information,can be in a very short time pass information to many people,spread effect is very significant.Weibo is in rapid development phase,then formed a lot of data related to weibo,some of such data contains a considerable value,however,the present for weibo data acquisition,analysis,and the analysis results show the technology still has many disadvantages,can't timely and efficiently to weibo required for data acquisition and analysis,not only that,the data analysis result and there is only one of the few several kinds of display.Do simple based on weibo and its features are first introduced in this paper,then some of the major characteristics of sina weibo platform is introduced,then the analysis of the main access methods in weibo data,finally discussed in weibo common analysis method on the basis of the data,the results show there is a corresponding research,research weibo data in the design work of the commonly used analysis methods,and then designed the analysis results show more intuitive,more beautiful,more interactive ideal display.This paper involves the relevant work is as follows:First,the introduction of the concept of microblogging,the main characteristics and weibo in the network public opinion spread rapidly,the impact on the society.Weibo forward relations as the focus of this article research,aimed at the characteristics of weibo are analyzed.Second,analyze the microblogging application to the relevant technical data acquisition.Study related weibo data collected through weibo API interface related methods.Analysis method of web crawler,spiders crawling process is given.On the microblog information analysis,information mining,information merging,extraction algorithm,this paper discusses the information dimension.Third,set up a weibo message data analysis system for the overall process.Including the system user management module in functional requirements analysis,trend of transmission module,the propagation path module,data analysis module and thumb up module.Database analysis and design,planning the microblog information and system user permissions.Fourth,weibo message data analysis system is designed and implemented features include: user tracking module,target user retrieval module,weibo propagation analysis module,weibo hot tracking module,information crawler module,personal Settings module six function modules.Each function module and module contains several words,weibo user tracking module includes charts,data analysis,results exported,ranking and week and month ranking list module,data analysis module including weibo fans rate,microblogging forwarding rate,average click-through rates and the number of total thumb up module.Fifth,the microblog data acquisition system,the microblogging crawler is the key.Based on sina weibo modulus according to obtain as an example,introduces the steps,and then analyzes the web data extraction operation involves the main method,and then based on weibo data specific types of targeted access method is given,and the main effective access targeted users' personal information,the design of the target user tracking module,target user retrieval module design,weibo forward propagation analysis.Sixth,in the client with pattern chart patterns show merge data.Design B/S structure of weibo data analysis and display platform,the application of it technology at the same time,also the organic combination of the technology of JSW,through a web form to show people intuitively data analysis results.In this paper,the development of the microblogging data analysis system,can be ideal for weibo data acquisition,can also be effective analysis of the data,and the final result by displaying platform with intuitive,beautiful and novel ways to show people.Platform has ideal user interactivity.