Research And Implementation Of Storage And Retrieval Mechanism Of Network Traffic Based On Hadoop

Network traffic data is very important in network management,network security,network analysis and so on.However,with the development of the Internet,the progress of science and technology,network flow either in quantity or in kind or in speed have undergone tremendous changes,to store and manage the network traffic data of the proposed huge challenges.It is very important for the development of network management and network analysis to study the storage management technology of network traffic data.This paper to address the network traffic data in stable storage and fast retrieval for the purpose,to Hadoop as basic platform,in-depth study on the backbone network traffic acquisition and in Hadoop network traffic data storage retrieval mechanism,the final design and Realization Based on Hadoop network traffic data storage management system.First of all,this paper,on the basis of the background,significance and current situation of the research,introduces some key technologies in detail,including DPI,Hadoop,Hbase and so on.Secondly,according to the purpose of the topic and the use of network traffic data,the paper analyzes the function and performance requirements of the network traffic data storage management system based on Hadoop.Again,on the basis of the former technology research and system requirements analysis,the overall framework of the system is given,then to network traffic acquisition module,data storage module,data retrieval module,the detailed design of the system and the user interactive module and the realization of the process are introduced.Finally,two aspects of function and performance of the system are tested,and the results show that the system is able to achieve the desired results,and achieve the goal of the project.