Font Size: a A A

Research On Search Strategy And Algorithm Of Network Search Engine

Posted on:2019-06-15Degree:MasterType:Thesis
Country:ChinaCandidate:H T ShiFull Text:PDF
GTID:2438330545495573Subject:Software engineering
Abstract/Summary:PDF Full Text Request
The search engine makes the people more effective to gain network resources,It plays a key role in our life network.At the same time,the distribution of Internet traffic will also have a great effect on the Internet ecosystem.This article gives a detailed introduction to the history and role of the search engine,and the reptiles strategy and sort strategy.Makes the analysis of the algorithm:a parallel idea is proposed,which combines the breadth first search and the scoring sorting strategy.makes the analysis of the company's search engine.The theme of this paper mainly studied the Context Graph crawling algorithm,and has made the improvement on the basis of the algorithm:1.On the major search engines and algorithm is introduced in detail,and analyzes the theme the theme of the Web crawler to crawl strategy,analysis and comparison the topic Web crawler to crawl strategy in common use.2.Based on the Context Graph crawling algorithm is improved,and the theme of the improvement based on the feature selection method of word and improved formula of TF-IDF and join the TF-IDF formula adjustment of word category weights,is used to improve the quality of feature selection and evaluation.3.The demo system of the theme crawler is designed,and the improved algorithm is analyzed and compared by experiments.The results show that the improved algorithm can improve the performance of the topic crawler.And a lot of code is modified,through the final analysis of the experimental data,proved to improve the efficiency of climbing.
Keywords/Search Tags:pairing, sorting strategy, product search engine, focused crawler
PDF Full Text Request
Related items