Research On Internet Information Collection And Processing Technology

Information's collection and processing is an important part in a country's life. With the development of competition in all fields, countries all over the world have paid more attention to the research on information.At the same time, the development of computer and communication technologies brings forward the unforeseeable challenge and opportunity to the information field. The information agencies of each country highly emphasize Internet as one of the most important information sources. But there are too many difficulties in collecting information on the Internet because of its distributed and heterogeneous characters. Search engine can solve these problems to some extent, but new problems appear, such as "information overload". After obtaining abundant information, how to process and analysis them with the help of advanced computer technologies and discover valuable information among them is still an urgent problem to be solved.In this paper, we will probe into above problems. Main works in this paper are introduced as follows:1. Probe into the techniques of web information retrieval and search engine, and develop an initiative subject search engine system called Information Assistant, which is quite different from the working mode of other search engines, and can solve the problem of collecting special information from the Internet.2. Study on the problem of users' expressing their interests and propose a new user interests and document relevance model, which is validated by our experiments.3. Work over the techniques of information retrieval and service, and develop a prototype system of information management, which provides automatic classification, clustering and management service by using the user interests and document relevance model.4. Investigate some techniques of KDD, and their importance in the information analysis, and validate this idea by developing a system called Information Analysis and Representation System.