The Research And Implement Of Agricultural Prices Subject Search Engine

With the rapid development of the Internet,in the face of huge messy network of information,people get information from it becomes more and more difficult,and the emergence of search engines for people to get information from the Internet to open a new window.Search engine is based on a certain algorithm to obtain information from the Internet computer program,It to deal with the information,provided to the user query use.The vastness of the data on the Internet,messy,users want to find out what they want the information is very difficult,and the search engine is like the night lighthouse,for the user direction.The subject search engine is a search engine for a specific domain,a branch of a generic search engine,it is the integration of certain types of pages on the Internet,extracting the information needed in the field and returning the information to the user's system as a result page.The topic search engine can provide users with a better experience in specific industries,and has a strong professional,low cost,targeted and so on.Agricultural search engine is a topic search engine,is the national agricultural information development is an important part,but the use of existing agricultural search engine to search for agricultural prices,a lot of the result is the information of agricultural trade information,although the provision of a convenient trading platform,but not suitable for agricultural producers to analyze the market.In view of this situation,This paper draws on the latest research results of domestic and foreign scholars on the theme search engine,and studied the agriculture-related search engine,and designs the theme search engine for the price of agricultural products.The main work of this paper is as follows:(1)Studied the function of the agricultural-related search engine and found that using the existing agricultural search engine to search for the price of agricultural products,the return result is more agricultural trade information,not easy for agricultural workers to obtain information from,Therefore,this paper presents the agricultural product price theme search engine,to facilitate agricultural workers more quickly access to agricultural prices related information.(2)This paper analyzes the research results of agricultural search engine in recent years,and studies the key technologies and algorithms of subject search engine,and according to the page's parent page,brother pages and page description information to prejudgment the subject relevance of the page,and uses the theme relevance algorithm to improve the crawler crawling strategy.(3)Using HttpClient and htmlparser tailor-made for the system a comprehensive,well-structured theme of the network crawler,network crawler use this topic relevance of the predict algorithm to determine whether to download the page to improve the crawler crawl efficiency.(4)Using the agricultural price sample to get a SVM classifier,SVM classifier support vector SV as a training sample of KNN classifier,construct a KNN classifier based on support vector,and effectively classify the captured pages.(5)In order to make the system faster response to the user's query request,the system introduced a cache system,the use of a one-level cache structure,use the dynamic and static buffers to store user queries and search logs,with minimal memory at the expense of greatly reducing the pressure on the system,but also significantly improve the system's response speed.(6)Testing the agricultural product price search engine search performance and retrieval performance,the results show that the system has a strong crawling efficiency,and can effectively deny the page that is not related to the topic of the page.