BBS Hot Topic Detection And Monitoring System

The rapid development of Internet is a helpful tool for popularizing BBS. At present, BBS has become a popular communication tool. Through the BBS, user could lanch a new topic or reply to existing topics to express ideas of topics. To some extent, BBS is a mirror of real society. The real-time data on BBS can be collected which provides certain data base for the research of the BBS hot topic detection. In this paper, hot topic detection and monitoring function are based on real-time data of BBS.Based on the analysis of the domestic and international development and status of Intenet hot topic detect researeh, this issue deeply analyze how to design an effective architecture of the BBS hot topic detection and monitoring system and what is the proper system process in this thesis.The main content of this paper are as follows.(1) BBS data crawling. Data crawling is the base of this system. This paper utilizes the crawler principle and forum features, post a BBS data gathering strategy, and use this method gathering the BBS with high efficiency.(2) BBS data preprocessing Through data crawling, system can get unstructured data, it is need to preprocess this data and change it into structured data. This module includes two main steps, data extracting and feature words selecting.(3) BBS hot topic detection. Topic detection is a key step in hot topic detection. This pages use Single-Pass clustering algorithm to detect topic. Then the hotness of topics is scored according to topic information including the number of the posts, the number of valuable posts, the replys and the views.(4) BBS hot topic monitoring. Auto-learning-based incremental classifying algorithm INN is studied to implement BBS topic monitoring...