Basic Theory Of Chinese Text Mining And Its Applications

Text mining has an extensive application prospect. Compared with Western Linguistictext, Chinese text has its own uniqueness. Given that reason, this paper selectsChinese text as its study object. First of all, the background and development of textmining are reviewed, and then presents its conception, procedures, and especially thefeature extraction, dimensionality reduction and Classification Algorithm. Packages ofChinese text mining in R and CHQ’S text multi-classified system are introduced, andapply this system to classify documents.This paper focuses on using widely used open source tools to build your ownChinese text mining system. According to the flow of Chinese text mining, itdescribes the exploration of the system. To segment words with the LTP system,transform unstructured textual data to the structured data using StringTOWordVectorof Weka, finally with LibSVM train Chinese text classification model and use it topredict.