Design And Implementation Of Pangu Shopping Search Engine

Commodity-oriented shopping search engine is an accurate and quick updatingvertical search engines, shopping engine basing on Lucene technology providesintelligent and personalized shopping search function. The shopping search want tomeet the vast number of consumers shopping information needs, So Pangu Companyestablished commodity search team.Pangu commodity search team used the concepts and techniques of popularvertical search. The team crawled domestic Internet product information, usingfull-text search tool Lucene, and designed and implemented with commodity-orientedvertical specialization search engine. This paper mainly research work is:(1) Study the implementation technologies of the system and analyse the sameand different points of the search engines and vertical search engines. Understand thetechnology based Lucene code and Lucene full-text search.(2) Determine the basic functions and objectives of the system. They areeffective search function of the product information, real-time indexing capabilities ofthe system, search performance feedback function.(3) Analyse mainstream technology of vertical search, research vertical searchsystem architecture ideas in presentation layer, logic layer, data layer, discusses thefunction of the system design.(4) Complete web crawler design. Page collection of vertical search engine isdifferent from the common search engine, papers designed web crawler in accordancewith the characteristics of vertical search.(5) Achieve four modules of vertical search engine. They are crawl module forshopping information, processing module of shopping information engine, standardlibrary modules for shopping information engine and commodity analysis module.According to achieving Pangu search shopping engine, it is possible thatcommodity-oriented vertical search solutions can be implemented. The work thatgrabbing a number of data sources, feedback into the system based on the user’s smartrecommendation, real-time indexing technology and new words and hot wordstechnology is highlights. Studying information engine design not only has importanttheoretical significance, but also valued in the development of vertical shopping. I believe that the contents of this article can contribute to the development of intelligentand personalized shopping information engine.