Network News Hot-Topic Detection And Discovery Based On Cloud Platform

With the arrival of the information age, the growth of news and information on the Internet is rapid. Facing bulky news and reports, it is becoming increasingly difficult for people to grasp social dynamic information and present hot topics from the Internet to learn about nowaday public opinions. The technology of detection and excavation of hot news on the Internet offers a good solution to this problem which serves to focus on the most concerned social news in the extensive coverage information on the Internet.It gives users a convenient means to learn about the most-focused issues of society.The purpose of my work is to detect and grasp the hot news from redundant information on the Internet. The major achievements of my work are as the. followings:1Approach to online news data. Access to the data source is the first step of my work.Data acquisition, in other words the extraction of news and events information serves as the groundwork for my later study.2After news data acquisition, modeling of news documents is the key point of this study. The study.based on vector space model (VSM) and the topic model (LDA) to accomplish document modeling.3The modeling of news in my study achieved classified documents corresponding to their specific fields. The regular distribution of news documents make public focus on a hot topic in various fields as quickly as possible. With the methods mentioned in the context, the public can detect and found a hot topic in the news document information.4The traditional approaches to massive data on the Internet have become increasingly inappropriate. With Hadoop, the open source cloud platform accessing news document data and MapReduce, a parallel computation method achieving the detection of focused topics, the study has obvious advantage over the traditional ones.5In order to evaluate the outcomes of classification of news as well as detection of hot topics, the study makes use of the Sohu CS news and Sogou TDT news to get an access to a comparatively precise result.