Design And Implementation Of Shandong Academy Of Sciences Public Opinion System

Today, technology develops very fast, and we have already stepped into an age ofinternet, the internet is familiar to people, so more and more people come to the internet tosearch people or things that they are interested in, and they always leave their opinions aboutthings on the internet. Because of this, the online public opinion has become a new form ofthe social opinion. So it will be an essential and important task to design an informationsystem as a tool to master even to control the online public opinions. To solve this problem,the opinion system designed by Shandong science academy can grab valuable informationfrom the internet and handle them, it will try to avoid the passive aspect and extend theirown space of development and make the department to know their condition better.Here are the main work made in this paper: built the system of Shandong academy andexplained the theory that use Nutch to grab data，the technology of information collection,preprocess of text information.(1) Explain the meaning and the background of the research about online public opinion,introduced the important meanings that public online opinion brings to the development ofsociety, and the necessity to Implementation a public online system, and finally analyzedpresent situation about the research work on public online opinion.(2) Study Nutch capture technology of network mining data research,and how webcrawler works.(3) Implementing structures of system framework: Firstly, building of the operatingenvironment is to file Nutch that is compiled into the Cygwin emulationenvironment;secondly,the source code will introduced into the Eclipse-based developmentenvironment and compileit,and configure its file.(4) Public opinion data processing: analysis of the structure of the web page, and grabingand purifing data information, chinese word Segmentation，text pretreatment.Finally, analying the public opinion of Shandong Academy of Sciences is to determinethe overall system architecture of the overall system, and to achieve public opinion systems.The whole system will analyze the information content obtained.he key elements of the system is purifing of the web data, Chinese Word Segmentation, text clustering and so on.