Research And Application Of Internet Public Opinion System Based On Topical Crawler

The network public opinion has the characteristics of short fermentation time,fast spreading speed and wide spreading range.After the occurrence of online public opinions,due to the failure of relevant departments to find out the public opinions in time and to miss the best opportunity for disposal,network public opinions were fermented and spread,forming a storm of network public opinions,causing the public to question and complain,which seriously affected the credibility and overall image of the government.In this respect,local governments need to use advanced Internet search technology to carry out round-the-clock monitoring on news media,websites,clients,blogs,Weibo,WeChat public accounts,forums,and posting bars,and find local public opinion information and data for the first time,analyzing the data,research and early warning,compiling public opinion analysis report,assist to cooperate with the relevant units to respond in the first time,to achieve effective guidance and scientific disposal of network public opinion.Therefore,this paper studies and designs a network public opinion system.This paper analyzes the concept of public opinion and network public opinion in detail,the source,characteristics and negative effects of the collection,defines the types and keywords of the network public opinions collected by local governments in detail,and defines the contents of network public opinions collected by local governments.This paper makes a brief analysis of the implementation process of the network public opinion system and the key technologies used,and studies the structure of the General Purpose Web Crawler and the Topic-focused Crawler in detail.This paper believes that the development of an network public opinion system based on the Topic-focused Crawler can collect the network public opinion concerned by local governments,reduce the interference of non-public opinion information,and meet the current local government's demand for network public opinion management.In this paper,the design and implementation of the network public opinion system is studied in combination with the network public opinion disposal work.By participating in the development and deployment of the network public opinion system,combined with the data and documents of the entire process of project establishment,design,and implementation,the requirements analysis,system function design,system function realization,and system testing of the network public opinion system were completed,and the system was finally deployed.The network public opinion system has realized the functions of network public opinion collection,public opinion monitoring,early warning push,public opinion disposal and public opinion early warning.The successful operation of the system has improved the efficiency of network public opinion monitoring,analysis,disposal,and statistics in the district,and can provide inspiration and reference for other local governments to develop similar network public opinion systems.