Research On Professional Search Engine Based On Agent And Application In Pipeline Information Retrieval

With the rapid development of internet, people acquired abundant information. Search Engine becomes the effective tool to get the information quickly and exactly, it's used widely, and it becomes the hotspot in the research and development of internet. However, results which general Search Engine returned contain many of irrelevant information, it's far from people's professional requirements, which causes huge obstacle in the information acquirement. People's requirements toward efficient, professional, intelligent information search increase progressively, Professional Search Engine provide effective ways to solve the problem.Based on the related technologies'research of Agent, Information Acquisition, Topic Filter, Information Classification and Information Retrieval and so on, this paper analysed system's architecture conscientiously, divided the system hierarchy, and designed the system framework of Professional Search Engine based on Agent, this framework is the foreshadowing to fulfill people's information retrieval require.Firstly, this paper gave the overview of Professional Search Engine's background and research.Then, this paper researched the crucial technologies of Professional Search Engine based on Agent: this paper introduced a combination search strategy based on comprehensive evaluation for the problem of Professional Search Engine's search strategy, and it predicted the hyperlink's topic value with the Oil and Gas Pipeline by combineing the web page and link's information; There are many application systems with limits of authority required login in the Oil and Gas Pipeline's intranet, aimed at resolveing the above problem, this paper designed a method which can implement auto login, and this method supposed cookies authentication and windows domain authentication; Based on the anlysis of Bayesian and Naive Bayes classification algorithm, this paper proposed a text classification model and algorithm based on Agent-NB, this model's classify effects is enhanced obviously. At last, this paper designed and realizes Professional Search Engine based on Agent, which was applied in the Oil and Gas Pipeline's Information Retrieval.