Research And Implementation Of Vertical Search Engine Oriented On Policy Information

People uesd to search the useful information from the network and the Internet search service is necessary for people's daily life and work with the leap development of the information age and the popularity of Internet technology.Baidu,Google,YAHOO,Bing and other search engines are the main way to find information on the Internet,the time we locate the useful information is greatly shortened by using the general search engine,but for searching topic specific demand,the normal search engines return the result of disorderly and scattered.The vertical search engine is designed to provide user with related specific topics services and information for the needs of users.In order to develop policies that benefit the community and serve the public,policymakers should not only look for needs of the community,but also need to look at the current documents to provide the basis for the development of new policies.Therefore,the policy oriented vertical search engine can meet the needs of policy makers.This paper takes China's social field's official website of government departments as the experimental data.Based on the in-depth study on the key technology of vertical search engine and user's need,this paper completes a policy oriented information vertical search engine.In this paper,the theoretical basis and research process of policy information vertical search engine are described in detail.Firstly,this paper introduces the key technology to complete the vertical search engine,such as the theme crawler,web information extraction technology,similarity comparison,full-text retrieval technology;then based on the open source web crawler framework WebMagic and aimed at a kind of website set,the special parser is designed;This paper also put forward the growth tree model of policy based on semantic similarity;Finally,this paper describes the implementation of the policy information vertical search engine and the system testing.