Research On The Method Of Traffic Anomaly Detection Based On Hadoop Platform

Traffic anomaly is significant changes in the network traffic rules.The short of congestion in the network,distributed denial of service attacks,a wide range of local events or network routing anomalies can cause network anomalies.These network anomalies brought very bad experience to operators and users,and traffic anomaly detection is very important at this time.The data have exploded with the rapid development of the Internet and the network traffic anomalies also increased.In the face of such situation,the traditional traffic anomaly detection has great limitations on the large amount of data.Hadoop has the advantages of high efficiency,high fault tolerance,high scalability and high reliability in the processing of massive data.Therefore,combining traffic anomaly detection and Hadoop can better detection of the large amount of data traffic anomalies.In this paper,through analyzing the characteristic of network anomaly traffic detection after put forward an improved analysis method based on the traffic characteristics of packet data.Applying this method analyze the traffic characteristics of the anomaly changes,wo can get the following conclusion:The normal data traffic will have a certain stability in the small time interval,and the data tarffic anomaly will make it part of the distribution of the traffic characteristics have a significant change,it will make it produce instability.By this difference,we can judge the traffic anomaly.In the whole process,By using Hadoop's HDFS distributed file system to store data files and using MapReduce computing model achieve the based on traffic anomaly detection algorithm.This calculation model simplifies the calculation steps and enhances the real-time performance of anomaly detection.In this paper,using the algorithm proposed design the detection system to detect anomaly traffic,and then through the simulation experiment to test and analyze results with the expected implementation results,Finally,it is verified that the method is feasible and effective.