Design And Implementation Of Internet Public Opinion Monitoring And Analysis System

The traditional information dissemination mechanisms and channels inthe gradually give way to the Internet technology, especially in theWeb2.0after a period of time, various news websites, Post Bar, micro-blog,forum has been recognized and widely used in the public, also theexpression of the people to become the main channel of some event views,aspirations and emotions and many other feedback, and how the monitoringapplication of the computer technology fast, accurate, comprehensive,efficient and analysis of public opinion information this channel, is thehot issue in many institutions, experts and scholars to devote to.This paper first analysis the public opinion monitoring based ondomestic and foreign development process, system construction experience,research results summary, combined with the current domestic publicopinion monitoring solution and the system demand, compilation andoptimization, the requirement of system requirements, includinginformation collection and pretreatment, detection and analysis of thedemand of public opinion demand, the application display and managementdemand, business management needs, system security and performancerequirements of content.Secondly, the paper web crawler, topic detection, text extraction,text clustering technology based on the characteristic of means, givesthe overall framework of public opinion monitoring and analysis systemand design ideas from the public opinion data characteristics, collectionmethods, transmission and storage mechanism, function, and from theinfrastructure platform, information collection, preprocessing,processing, monitoring and analysis of Web application of the five point of view expounded the function module design, system at the same time,the article also gives the realization of the basic framework and systemdeployment approach.Finally, this paper gives the system including the public opinioninformation acquisition, preprocessing module for the process design,functional design, and presents the implementation scheme of calculationfunction; technology algorithm, text clustering and segmentationalgorithm, open source application JAVA class based on TF-IDF vector, thepublic opinion analysis module of the topic detection and tracking, publicopinion hotspot topic identification, screening, sensitive topicgeneration module gives a detailed process, module function design andImplementation plan; from the perspective of public opinion show, systemconfiguration, information retrieval, safety management gives thefunction design and content of Web application implementation.