The Research About The Contention Based Network Information Real Time Analysis

Because the information exchange in Internet is more and more frequent, many negative effects have also appeared. For example, the spread of the text about violence, blind faith , eroticism and the other unlawful information , the disclosure of the secret information, the intrusion hiding in web or email and so on. All of these questions have become our focus. Because the questions are all the intrusions based on the content, the traditional firewalls have no effect on them. In order to ensure the safety of the network, there is an urgent requirement to research the content filtering technology of the network information.According to this requirement, this paper has researched the key technologies of the network information real tune analyzing, such as the multi keywords real time searching technology, Chinese word segmentation, and the content identification and classifying of the Chinese text. The contention based network information real time analysis (NIRTA) method in this paper can analyze and process the transportation data of the network in real time, and identify the unlawful information.First, the method of multi keywords searching is put forward in this paper. The method is based on the tree structure, and is used for the real time keywords searching of the network communication data. Next, the paper summarizes the principles to get the main parts of the Chinese sentences according to the Chinese syntax rules, and analyzes the realization and error-correction mechanisms to identity the contention of the basic sentences. On the bases of the principles and the mechanisms above, this paper brings forward the method to identity the contention of the network information in real time, and also shows a series of functions for the realization of the method.The elementary tests prove that the methods in this paper can find the unlawful information of the network in real time. And the tests to the example texts also prove that if the number of the keywords (key sentences) in anexample text is 5 or above, the right rate of the whole text's contention judging will be 80% or above.