Design And Implementation Of Ipv4-Ipv6 Data Analysis System

With the development of today's society,computer network technology has been more and more widely used,at the same time,people's requirements for network performance and security are also higher and higher,so network management personnel to network reasonable planning,network security management has become more and more important.Nowadays,there is a mixed use of IPv4 technology and IPv6 technology in the Internet.The use of the two technologies not only expands the network scale,but also increases the complexity of network traffic data.Therefore,it is necessary to carry out traffic data analysis in the IPv4 &IPv6 network environment on this basis.Through the analysis of traffic data,managers can timely grasp the network situation,discover the development trend of new applications in the network,and guide the research of network communication protocol,network equipment development and network planning etc.Based on the network traffic collection of the Hadoop big data platform and the company's business needs as the background,this article researches and develops the IPv4 & IPv6 data analysis system in combination with data storage and data analysis technology.It mainly completes the following aspects:(1)This paper first proposes a terminal recognition algorithm TRF based on UA recognition and random forest.Through the classification of handheld devices and non-handheld devices,the network terminal devices are classified and displayed.Experiments show that TRF algorithm can effectively improve the classification accuracy and the performance of the classifier.(2)Secondly,the data analysis system based on Hadoop big data platform is constructed.Through the transformation of Bro collection framework and algorithm improvement,the data flow of IPv4 & IPv6 is collected and preprocessed.In order to make the data storage conform to the diversity and complexity of the system,a variety of storage methods are designed to store the data,and the data flow after storage is analyzed,which provides more convenience for the system display for accurate and clear network information.(3)Finally,the pie chart,bar chart and line chart are used to visualize the network information after the system analysis,which is convenient for system users to intuitively understand the network traffic data.At the same time,in order to ensure the reliability and correctness of the system,functional and non-functional tests are carried out on the system.This paper successfully completes the collection,analysis and display of IPv4 and IPv6 traffic data according to the original plan.By using this system,on the one hand,it can effectively reduce the cost and workload of network management for technical personnel,and improve work efficiency;on the other hand,it can make users understand and master the network status more comprehensively and objectively;furthermore,it will lay a solid foundation for improving the level of network defense in the future.