Design And Implementation Of An Distributed Advertising Search Engine

With the rapid development of the Internet advertising industry, targeted advertising as a new network advertising model is also developing very quickly. This kind of advertising is very attractive because it’s accurate, timely and efficient. Targeted advertising is a kind of advertising which is delivered on web pages with the page content or user behavior related. Targeted advertising can be divided into content targeted advertising and behavioral targeting advertising according to the different target. According to the traditional flat media and TV media, the profuse interact function of Internet give us more space to improve the Advertise business. The multimedia interact and state keep ability of Internet terminal make the smart advertise deliver possible.Targeted advertising is based on vertical search engine. Vertical search engine is an industry professional search engine, which is broken down and extended search engine, It provides valuable information and services for a specific field, a specific group of people or a particular need. Vertical ads search engine is professional search engine for bid advertising industry, it takes structured ads information as search content and provide the user of query goods with related ads information. Vertical search engines and universal web search engines are very different, The biggest difference is that the vertical search engine extracts key words in structural way in which web content was transformed into well-organized structured data. Web page search based on each single page, while vertical search engine based on structural data. It store the structural data to database for further processing, such as removing redundancy, classification, etc. word segmentation and index at last for end-user’s search needs.Advertising search engine usually faced with the huge amounts of data, engine library normally stored hundreds of millions of advertising information. The index query and update efficiency will be reduced gradually when the index and the search load reach to a certain extent. The pressure of the server increase gradually and the utilization of the whole search engine get lower and lower. With the difficulties caused by massive data storage, designing a good distributed vertical search engine will be a key factor for the future development of the vertical search engine.How to push to the user the most relevant ads, and how to resolve hundreds of millions of ads every day is the focus of this paper, In this paper, a variety of ways were taken to present to the user their favorite ads, such as text matching, long-term and short-term user behavior analysis, related recommendations, integration mode, etc. The problem of large scale real-time under the concurrent request processing was solved through the multi-node distributed computing system, the needs of massive data summary statistics was solved through the multi-level data processing framework, A service architecture was realized which can be extended in the case of data and access volume increased.