Font Size: a A A

Application Research Of Multiple Pattern Matching Text Processing In Uyghur

Posted on:2015-04-12Degree:MasterType:Thesis
Country:ChinaCandidate:L Y E D W T YiFull Text:PDF
GTID:2348330518483787Subject:Electrical theory and new technology
Abstract/Summary:
Uyghur pattern matching and pattern matching with other languages the same usefulness as many aspects such as Uighur language search engine,Uyghur text message filtering,monitoring Uyghur websites,Uyghur translator the Uyghur pattern Matching Technology to become one crucial aspect.Although some improved algorithms and techniques can be achieved this problem,but failed to making appropriate treatment consider from the language characteristic and writing for Uyghur pattern matching algorithm.The need for research Uyghur pattern matching algorithm proposed an efficient and fast suitable Uyghur pattern matching algorithm.In this paper,considering the characteristics of Uighur text to improve the existing multi pattern matching algorithm,pattern matching algorithm for text feature matching was improved,according to the characteristics of language from right to left direction comparison character and movement pattern.Improved matching algorithm is not particularly efficient and more time consuming,because the Uyghur 32 letters have 120 kinds of forms compose separate,initial,medial,final,matching must be in the form of patterns and text match exactly match the form alphabet.The improved algorithm according to the exact matching method is the matching number more decline in matching efficiency.This paper considers the impact of improved multi-pattern matching algorithms of low efficiency factor matching,we propose a new multi-pattern matching algorithm Uighur(Uyghur Bohum patterns Match Algorithm).The algorithm analyzes the law of the word syllable by Bohum-sani function and Bohum-xekli functions,the two functions were obtained in the form of a combination of the number of syllables and syllables.If the number of syllables and words in text mode any number of syllables of a word is not equal to skip this word directly compare the next word,if found with any pattern equal to the number of syllables syllable combinations further comparison,the results of two function values are equal match successful output mode.Algorithm uses a word for the comparison method to jump unit length,this method avoids jumping more numerous letters form part of the number of comparisons,the test results can be found in the proposed algorithm is better than the efficiency of the algorithm improved multi-pattern matching.In order to provide better Uighur pattern matching processing platform,to build a multi-pattern matching algorithm based Uyghur text filtering system.Requirements subject of the project and the establishment of a new " bad keyword library" to establish libraries aspects related to pornography,drugs,fraud and other users can use the "bad keyword Library" Library Filter text provides green text resources.
Keywords/Search Tags:Uyghur text processing, Word Boundary, Syllable Partition, Syllable Structure, Pattern Matching
Related items