Research And Implementation Of Network Public Opinion Monitoring And Analysis System Based On Text Mining

The Internet has become the people's ideological and cultural information of the distribution center,is becoming a popular tool of public opinion.In recent years,the influence of the network public opinion is more and more big,the attention of the people is also more and more high.In order to effectively monitor the network public opinion hotspot information,reasonable to carry out the work of network public opinion guidance,avoid the spread of bad situation,urgent need to improve the ability of Internet public opinion monitoring and management and technical means.Firstly in this paper to the domestic and foreign public opinion monitoring system and its application to the process of development and construction experience,the research results summarized based on,combined with current solutions and solutions,organize and optimize the main demand of public opinion system,system requirements are obtained,including data acquisition and pre processing needs,public opinion monitoring and analyzing the demand and application show the demand and management,business management requirements,system security and performance requirements.Secondly,the web crawler,text extraction,Chinese word segmentation and semantic analysis and text clustering techniques based on,from the characteristics of public opinion data,data acquisition,data transmission and storage mechanism,function realization characteristics are the public opinion monitoring and analysis system of the whole structure and the design idea,and from the infrastructure platform,data acquisition,data pre processing,a monitoring and analysis processing,web application of the five angles expounds the function module of the system design scheme,at the same time,the article also gives the system of business process analysis and optimization,deployment architecture and the way of realization.Finally,based on the above analysis,based on the requirements of planning and design,combined with the author's practical experience,and the implementation scheme,the detailed design process is given including: public opinion on data acquisition,preprocessing module of process design,functional design,and gives the realization of the program function;vector space model and TF-IDF Chinese algorithm,segmentation and DOM pruning algorithm,text clustering algorithm based on Single Pass,on the topic of public opinion analysis module,monitoring and tracking public opinion hot screening,sensitive topic recognition module providesdetailed procedure,function design and realization scheme;from the perspective of public opinion,system configuration,information retrieval and security management based on MVC the architecture gives the function design and Realization of Web application content.The application of the system improves the ability of the government to control the network public opinion,it can timely eliminate the government and the public's network information,and maintain the social stability.