Network Public Opinion Monitoring System For Agriculture Products Based On Big Data

With the rapid development of the Internet,the convenient service of the network and the enhancement of people's awareness of participation,the network has become the front of public opinion,and various social problems have been magnified quietly under the development of the network public opinion.The performance of Internet public opinion is spread through Internet news comments,self media,search engines,forums and other information channels.When Internet hot events continue to rise,Internet public opinion risk occurs frequently.For example,the development of agricultural products is related to people's life and health.The safety problems of agricultural products are easy to be misunderstood and misread under the network public opinion,which will affect the industrial development,cause people's panic,and cause economic losses to the industry.The network public opinion of agricultural product safety has an increasing impact on the society.In order to correctly guide the direction of network public opinion of agricultural products,make the agricultural sector from passive public opinion to active,timely prevent the spread of negative public opinion,reduce the negative impact of public opinion hot events,and improve the monitoring ability of network public opinion of agricultural products is particularly important.The research builds the online public opinion monitoring system of agricultural products based on the big data technology,develops the online crawler real-time collection,processing and analysis data,hot topic discovery and tracking,public opinion polarity numerical calculation and visual data display on the basis of the big data platform,and uses the big data technology to improve the processing speed under the big data volume.The purpose of this study is to strengthen the supervision of public opinion of agricultural products network security and provide effective basis for the decision-making of relevant departments.Firstly,it introduces the research background and current situation of online public opinion monitoring,analyzes the demand and key technologies of agricultural products online public opinion monitoring system.To collect information,scrapy collects relevant information of agricultural products from the Internet as analysis data,searches and uses Solr search server,analyzes and collects data with text processing algorithm,and realizes topic identification,tracking and emotional polarity calculation of public opinion.In order to solve the bottleneck of traditional single computer operation and storage,the Hadoop distributed platform and spark memory computing framework are adopted to realize distributed storage and efficient data analysis and processing by integrating multiple devices.The system is divided into five modules: information collection,information processing,information analysis,public opinion management and system management.The related algorithm is improved.The realization process of each module and the required development environment are described.The test of the system can complete the required analysis tasks in time.