Design Of Distributed Intrusion Detection System Based On Big Data Technology

With the continuous innovation and improvement of software and hardware,Internet technologies and other relative technologies continue to evolve,the speed of computer development continues to accelerate.Accordingly,the amount of data that computers handle has increased exponentially.For identifying intrusion behaviors,study the method of identifying the signature of massive data flowing into the local host quickly needs further research.Intrusion detection is one of core technologies of protecting host devices'security.The goal of intrusion detection is distinguishing intrusion features from data flowing into host device to identify intrusion behavior.However,with the rapid growth of data volume,the efficiency of pattern recognition is always not high.Combining the automatic data feature recognition ability of data mining technologies and the distributed computing abilities of Big Data technologies to improve the ability of intrusion detection of dealing with mass data is of high practical value.Based on the research of Big data technology,data mining technology and intrusion detection technology,for taking advantages of the distributed processing capability of Big Data technology(based on Hadoop platform)and data mining technology,one of the important algorithm of data mining,the BP neural network algorithm is distributed improved based on Hadoop platform.In addition,in order to apply the distributed improved BP neural network algorithm,the intrusion detection points of the intrusion detection system is designed and deployed.The distributed computing BP neural network algorithm proposed in this paper candistributed process data based on Big Data technology,further more,recognizes the signature of massive data,eventually identify intrusion behaviors.The main innovative work of this article is as follows:(1)On the basis of study of neural network algorithm,BP neural network's training process is being designed distributed,then according to the results of distributed training part,summarize the final neural network.(2)Through the research of Big Data technology,the distributed improved neural network algorithm is deployed and implemented on the Hadoop platform.(3)Through the study of the theory and methods of intrusion detection,the intrusion detection points using distributed improved neural network identifying the signature of the massive data and intrusion features to identify intrusion behavior are designed.