Research And Implementation Of Web Crawler On Vertical Search Engine

The vertical search engine is a new search service, aimed to solve the problems oftoo-massive data, low search accuracy and profundity in common search engine. Thispaper investigated a great deal of domestic and international documents, and deeplyresearched as well as the principle and critical technique of vertical search engine onsystem structure, working principle, search strategy, duplicated links deletion and pageupdating algorithms. The paper focuses on the search strategy and topic algorithm. Onthe bases of improving the duplicated links deletion algorithms and page updatingstrategy, this paper overall design an electronic commerce vertical search engine, designand implementation of a focused crawler of the search engine. Experimental results showthat the system is efficiency, has better collection of the pages related to the topic, hasachieved the anticipated target. The system has good practical value and applicationprospect.