The Design And Implementation Of Wood Vertical Search Engine

Abundant Internet information resources bring enormous benefits and convenience for our work and life; these also bring a great deal of redundant information. When we use general Search Engine, we often encounter this problem; in order to search some basic professional knowledge, we had to spend a lot of time to find the knowledge in many websites. At the same time, the Vertical Search Engine will solve this problem. This dissertation focused on the design of focused crawler and topical dictionary in Vertical Search, designed and accomplished a Wood Vertical Search Engine.This paper first introduced the history, present situation and problems of Search Engine, and the advantages, present situation of Vertical Search Engine. With Knowledge in the construction and process of Vertical Search Engine, we analyzed their key technologies, focused the design of focused crawler with Shark algorithm and topical dictionary. Secondly, we designed a wood topical dictionary which based on wood professional books and experts’recommendations. This dictionary will provide support for word split, relevance judgment and index. Then, we designed and accomplished a Wood Vertical Search Engine, provided the diagram of system Construction. In the process of building the system, we used these technologies, such as, customizing and extending the Web crawler Heritrix, indexing with Lucene to provide a fast and comprehensive full-text indexing.Finally, we have done some test for the system by comparing with Google and Baidu. Much experience of Wood Vertical Search Engine researching and developing was summed up and the system foreground was indicated.