The Study And Implementation Of Search Engine

Through deep study of search engine's core technology, such as Web crawling index building level system index searching, this paper designs and implements a new search engine. It implements Web crawling through distributed technology, and builds index database through accidence analyzing Chinese characters separating unuseful words deleting etyma extracting index words selecting and lexicon. The level system uses new model of Web accessing and level computation to build Web level system so that the requirement for computer resources is greatly reduced. The use of cache technology improves user accessing efficiency. Open system architecture makes the search engine become reliable and flexible platform.Based on the analysis of lots of excellent page sorting arithmetics, this paper designs new Web level system. Through the new system, the search engine can implement larger scale Web covering and faster index updating, and provides better searching service.The search engine builds on cluster system, so it can build cosmically index system and provide support of high speed user accessing. Its architecture is open, so all kinds of new technologies can use it as platform to implement flexible integrating. Its configurations and rules are dictionary so that search engine can implement flexible expansion and flex.