Ajax Data Search Engine Clawer Research And Design

In recent years,Web2.0 technology has been widely used, new technologies to improve the browsing habits of the people but also to other related technologies pose significant challenges, the search engine is one of them. Facing page contains lots of dynamic data, traditional search engine has been unable to realize crawl function. Various states and events of Ajax applications, can be user to see, but not by the search engines to crawl.For the challenges faced by search engines, we give the corresponding solution: Analysis and constructing Ajax application state model, On this basis, design and implement the core algorithm on Ajax crawl, achieved through the establishment of hot cache model optimization algorithm, based on the characteristics of Ajax dynamic page web weights proposed algorithm for evaluating AjaxRank, Last through the test of instance verified the quality of search results of Ajax search engine, and estimated the performance indicators of search engine.The important significance of this thesis is:Aiming at application principle of Ajax dynamic data have a thorough and detail analysis, on this basis, we design and implement can crawl Ajax dynamic data search engine, for dynamic data crawl further research provides a meaning and theoretical basis.