Font Size: a A A

A Study Of Food Safety Data Acquisition And Information Processing Based On Online Media

Posted on:2021-03-25Degree:MasterType:Thesis
Country:ChinaCandidate:Y J KangFull Text:PDF
GTID:2381330611980478Subject:Control science and engineering
Abstract/Summary:PDF Full Text Request
Food safety,as an important social issue related to the national economy and people's livelihood,has always been a research hotspot.With the development of information technology,the application of relevant techniques in the field of food safety has become a new research trend.Internet media,as a public data source,which contains a wealth of information.Using corresponding technical means to collect food safety data from internet media and process them with information processing technology to discover its intrinsic value will help to solve food safety problems and promote social stability.This paper is studying on the data acquisition and information processing means of food safety text data.Firstly,the content of food safety data from the online media were analyzed,and the evaluation criteria was formulated to select the specific subjects of study and collection sources.Secondly a data acquisition system based on the Scrapy framework was proposed,and the construction and implementation methods of this system is described in detail.Then the system is used to obtain food safety text data from selected collection sources,including food safety news,food inspection notices,food safety criminal adjudication instruments.Thirdly,information processing methods for food safety data are introduced,including text pre-processing methods,text filtering methods based on BERT keyword embedding,named entity extraction methods based on BiLSTM-CRF,information extraction methods based on regular expressions and summary extraction methods based on Text Rank.Finally,the collected food safety data were structured using the above information processing methods and visualized using ECharts as tool,and three visualizations were built: the Food Safety News Word Cloud Map,the Food-Additive Relationship Map,and the Food Safety Violation Map.
Keywords/Search Tags:Food safety, data acquisition, information processing, BiLSTM-CRF, BERT
PDF Full Text Request
Related items