Design And Implementation Of Telecom Internet Public Opinion Monitoring System

With the internet developing rapidly in the world, the network media has become the following media after broadcast, newspaper and TV. Especially the appearance and popularization of intelligent mobile phone and internet have affected every aspect of our daily life. People are used to getting information of anything happened around them through the internet and expressing their views on a variety of events or the government policy and so on. The internet has become the main carrier to reflect public opinion. Our country has a plenty of Internet users, however, the internet has got the characteristics of openness and freedom, in addition, our country hasn’t got an effective control method, which resulted that the net events happened frequently in these years and the events offer develops into a considerable scale, many superstars, enterprises and even government officials are involved in which are having negative effects on social stability.In order to keep abreast of industry trends, topics of social concern, especially hot topic in the telecommunications industry, ChinaTelecom developed telecom internet public opinion monitoring system, this article introduces the key technology to implement the internet public opinion monitoring system, and gives the demand analysis^the overall design plan、the detailed design and implementation process.This article firstly introduces the significant、the domestic and foreign development status and the key technologies that should be used in the process of developing this system, including the web crawler technology and open source Nutch search engine framework, the analysis of the clustering algorithm Chinese segmentation and classification in data mining technology, introduces the characteristics of TF-IDF which is a simple and effective extraction algorithm, to lay a solid theoretical basis for the development job of this system. Then, this article analyzes related demands of a efficient and practical internet public opinion monitoring system, including the system feasibility, system functional requirements and non-functional requirements, and uses the user case diagram and required user case to analyze the users’ activity. According to the above requirements, this article gives the general design plan of the internet public opinion monitoring system,presents that a mature and feasible internet public opinion monitoring system should have public opinion collection, public opinion, public opinion analysis pretreatment, public opinion retrieval, early warning of public opinion, public opinion and system management modules in the aspect of the network structure, software structure, function module, data model and interface.Finally, according to the design plan, this article gives the detailed design and implementation of the main modules of the system, including the public opinion public opinion gathering module, pretreatment module content extraction, automatic segmentation, extraction of keywords, automatic abstract function, public opinion analysis, tracking module hot sensitive information reminding function of the detailed design and implementation process, and gives the corresponding system photos.