Research On Key Technique Of Public Opinion For Civil Aviation Based On Nutch

The rapid development of Internet has brought a series of questions on network monitoring.In addition to traditional network security technology issues, Internet content security has more and more attracted people's attention, the monitoring of public opinion on the Internet is generated in this context. Public opinion is the social and political attitudes held by people which caused by the occurrence, development and change of social events in a certain social space.Public opinion on the Internet is for people to express themselves through the network. Research of public opinion has important practical significance and practical value which is important for government and enterprise to understand people's real social view and make the right decision in time.In this paper, Nutch was used as the basic research tool, several key techniques of the monitoring system of public opinion for civil aviation is in-depth study and exploration.Architecture of monitoring system of public opinion for civil aviation is studied and constructed.System's key techniques are collected and extracted. For Chinese information processing, an internet new word identification method for real network environment was proposed based on immune genetic algorithm. For the problem of hot topic detection, the paper used Nutch as the basic web collection tool, and then proposed a hot topic detection method for civil aviation based on civil aviation thesaurus and single-pass algorithm. For analysis of public opinion, an orientation analysis method for reviews on web pages of hot topic was proposed which used How Net as the basic semantic dictionary. All methods are tested, the results showed that the proposed algorithms can solve the problem of new words identification, hot topic detection and orientation analysis of web reviews in real network environment, and can also provide theoretical and technical support to the monitor system of public opinion for civil aviation.