Based On Nutch Search System

Along with the development of Internet technology, information on Web increases rapidly.It becomes ever more difficult for Web surfers to retrieve useful information among the gigantic amount of Web information.The thriving of research on Web Search Engine in various research institutes meets the need of solving this critical problem.Search engine is asystem collecing and collating the Web information resource,and then supplying the inquiry.Actually it mainly searches for Web information automatically and classify,index and store them info inex warehouse so the the information can be submit to user by meas of inquiry.From 1994 on,to satisfy the increasing demands for web information search,a Web Search Engine has evolved through three stages:Centralized Search,Distributed Search,Intelligent Search.Nowadays,It is mainly focused on automation search,smartclassification,and intelligent analysis.In the future,the research areas will expand to such extent as multimedia search,specialized search,and interlanguage search for the fulfillment of Web surfers various requirements.This paper firstly introduces the thory,framework,structure and workflow of a search engine. Secondly,it does in-depth research and analysis on crawler,indexer,searcher of a search engine.Then,it discusses framework and workflow of Google search engine,and expatiates data structure of Google search engine.Thirdly,it makes in-depth discussion about Chinese segmentation technology and page sorting arithmetics.Lastly,it introduces a lucene-based full-content search engine software Nutch,and it makes out a Web search engine system using Nutch,and adds Chinese segmentation module,and improves the search engine Engine's accrurace resorting to an advanced ordering algorithm.