Analysis And Study On News Data Of Web Information

As internet's rapidly developing, search engines of increasing web information have been an important tool which guide people use the web. Among these engines, the vertical search engines, which are more vocational and including profession, proficiency and deepness, are more and more popular. Nowadays, the vertical search engines have involved many industries such as real estate, job application, commerce, medical treatment, public traffic etc. The vertical search engines on foreign exchange news doesn't have a mature technique, however, there will be huge demands on it. The people concerning foreign exchange business are increasing. On the base of this, this paper designed a news analysis engine system on foreign exchange news, which makes use of the vertical search engines' technique. This system will assist users master the foreign exchange information more expediently.This system got information from domestic and international foreign exchange news website, using the "Heritrix" as crawler tool, collected and filtrate these information across customizing Heritrix's tools. Analyzing the web page, the system can transform the text formatting to text character using filtration arithmetic. And then, the system sorts this information by filtrating high-frequency vocabulary and empty word, and keeps morpheme compounding applicable to be indexical. Using the Lucene tools and combined of inverted index, the system takes the document key words as index, achieves a interface for users to search and provides service for search requests. If the server receives searching information from Data Type, the system will perform the search among news search class and send the key part to users across the founded TCP link.Tested by experimentations, the foreign exchange news analysis engine designed in this paper can satisfy users' structural search. Above all, this system has great application value and foreground.