Web Search Engine Principle And Implementation

In this paper, a more detailed introduction of the Internet search engine's development history, theory and technology. Start with the perspective of workflow explained the mechanism for implementing a web search engine, which is summarized as pretreatment and web services. It can be devided as spider, distributed file system, indexing and ranking rules. Further more, I put forward my own opinion of ranking algorithm improvement. Meanwhile, I explained the search engine architecture design principles and a comparative analysis of other possible design options. Because of strict logical ratiocination and abundant experimental data, it's fit for variety of readers. It is a good reference for Information Retrieval and Data Mining research and web search engine development.