The Research And Implementation Of Web Text Mining

It's a real challenge for us to make Internet easier to use. The information in Internet is in short of organization, and full of a mass of pages, and on the other side, people want to obtain the information quickly and accurately. The technique of data mining ,which includes association rules analyzing, clustering, classification based on artificial intelligence(AI), seemed as good approaches to solve such problems. So that the conception of web mining turned out. This thesis aims to discuss the web text mining techniques with the background of data mining.At first, the significance of web text mining was given. The application of wed text mining will bring us good organization of search results and quick retrieval procedure.Then the base knowledge data mining such as the conception , development history, application fields and some applied methods etc. was simply introduced. Also Web mining definition was presented . It is pointed out that the web mining will be the future direction of data mining. In term of utilizing different data , the web mining were classified as three parts ,which were web content mining , web structure mining and web usage mining .The web text mining belong to the web content mining .After introducing web mining terms , the thesis played emphases on discussing web text mining .The key techniques used in wed text mining including association rules analyzing, clustering, classification were expounded in detail . At same time web text frame was designed and some functional modules ,for example automatically down web pages module and automatically classification module , were completed. These prototype shows good performance in the experiment.At last the summarization of the thesis was proposed and the future work suggestions were given.