Realization Of Blog Information Collection And The Calculation Of Support Degree Of Hot Topic

With the rapid development of Web2.0, the network is no longer just a counselingchannel, people are more willing to participate in the interaction of the network. As theparticipation of people has been greatly increased, many new network communicationsystems are constantly emerging, one of the most prominent type is blog. Users can quicklythrough it to post their own views, timely and effectively communicate with others. However,with the characteristics of high openness and low threshold, blog is becoming the main way toproduce and propagate information. Because of this, it also causes more and more attention ofmany institutions to the research of discovering hot topics and analyzing the support degreesin this field.In this paper, after some investigations and research of web crawler, it uses the existingclustering algorithms to cluster the climbed blog information to form topics, and thendiscovers the hot topic and calculates the support degree of it. The main research contents inthis paper are as follows:1、Blog information collection: This paper, according to the web site having classificationstructure organization of its information, by building the blog category structure tree, changesthe complex figure shape category structure into tree category structure in the website, itmakes blog web page classification containing in the process of grab.2、Blog comments collection: This paper uses a new method to evade the JavaScriptsemantic mechanism, to simulation Http request service and to send custom Http requestpackets. It realizes the grab of blog comments information based on AJAX.3、Discover blog hot topic: Topic recognition is the foundation to discover hot topics. Inthe basis of the topic has been formed, it extracts the sorting characteristics of blog topicaccording to the inherent attribute of blog. At last, it calculates the heat value of each topic bycalculation formula of hot topic, and then discovers the hot topics among them.4、Analyze support degree of blog topic: This paper, for the topics with higher hot degrees,uses a method to analyze support degree of a topic, which by calculating the emotions of allcomments. The support degree of a hot topic can let people know the current social hot topic. as well as the main attitude of most people look at it.