The Research On Technology Of Deep Web Source Discovery And Semantic Annotation

With the rapid development of Internet technology, Web databases have became prevalent on the Web. Based on user's request, Web databases display their contents in the form of HTML pages dynamically. The whole information embedded in these pages called as Deep Web can not be acquired by traditional search engines. Recently, the research results show that Deep Web contains a great amount of information which is highly relevant to market demand. Therefore Deep Web served as a research emphasis has been paid more and more attention.This paper firstly describes the research framework of Deep Web, then focuses on technology of Deep Web source discovery and Deep Web semantic annotation. In addition, we propose relevant algorithm and model. Finally, a vertical search prototype system for book domain is presented and accomplished. The main works of this paper include:(1) Introduce the basis framework of Deep Web research, then summarize the problem of Deep Web database classification and Web data extraction.(2) Analyze the working principle of traditional search engine and propose a new approach of Deep Web source discovery based on search engine.(3) Propose a novel approach of Deep Web semantic annotation according to the inspiration from foreign related work.(4) Accomplish a vertical search prototype system for book domain and analyze the application of the technology mentioned before.This paper also designs experiments to implement the algorithms and technology mentioned. Experimental results validate that our solution is effective.