Research And Implementation Of Vertical Search Engine For Digital Products Based On Android

The rapid development of information technology brings a lot of fun to our life, however, the increase in the amount of information brings a lot of difficulty to query the information we need, the situation did not relax until the emergence of search engines. General search engines return the query results to user with no distinction, users need to find the results they want from a variety of results after a large number of artificial selection.As an advanced form of search engines, vertical search engines bring the obvious advantage of query. Accurate query and clear classification allows users to find what they need conveniently, increases user stickiness and promote them is not a problem.Since the beginning of new century, the intelligent mobile terminal spread rapidly,3G,WLAN and other wireless communication technology have also been a good application, which marked the mobile Internet is getting closer to our lives, booming mobile application development is going to follow.Android system accounts for a large proportion of the mobile application development market currently, favored by the majority of mobile application developers.Mobile client search engine is able to play a role in real-time search and reducing shopping costs. People hope to obtain richer information from Internet anywhere and anytime, a mobile terminal intelligent search system can meet the needs of users at this time.In this paper, based on the laptop and mobile phone products repository by studying the characteristics of the vertical search engine, designs and implements a digital products vertical search engine system:including the expansion and improvement of the open source web crawler Heritrix,optimize and solve the problems existing in the process of web scraping;using HTMLParser technology to parse the web pages which are crawled down by crawler into structured text and for storage; Lucene technology is applied to build index for structured text, at the same time professional thesaurus is also built and realizes the retrieval module; adopting J2EE three-tier architecture, using Spring and DWR technology, develops a user interface. Based on this search system, digital products search for Android client is integrated into the content of this research by formulating and implementing communication interface between Android client and server. It can meet the needs of users better. Finally through the system test, mobile digital products vertical search engine is feasible and can improve the efficiency and accuracy of the query.The innovation points of this article and system are:to build this system, using related algorithms and strategies to realize topic web crawler module,to make query results more accurate and the sort results more in line with user expectations;implement the vertical search function for the portal website in Android system.