Web Text Mining Technology And Its Implementation

It's a real challenge for us to make Internet easier to use. The information in Internet is in short of organization, and full of a mass of pages, and on the other side, people want to obtain the information quickly and accurately. With the flood of information on the Web,Web mining is a new research issue which draws great interest from many communities.Currently,there is no agreement about Web mining yet. It needs more discussion among scientists in order to define what it is exactly. Meanwhile, the development of Web mining system will promote its research in turn.This paper discusses the principle of Web mining, and focus on Web text mining architecture and technique. The paper includes following contents:Discusses the Building of Web text mining system in detail, including the data model of web, the architecture and function of Web text mining system;1.Discusses the design philosophy and primary implementation of data acquisition based on wocld wide web, and presents our implication, the function of system;2.At first, summarizes the key techniques used to do clustering/classification in different fields such as statistics, machine learning, pattern recognition, etc. Then presents a new classification algorithm based on theorem of Information granularity?3.introduces the distillation of text character in text clustering ,presents an iteration procedure to obtain the weight of riles and words.