Design And Implementation Of Data Collection Subsystem Of Network Monitoring And Management System

With the rapid development of the Internet, network users amount increases greatly, the scale of the network also expands so unceasingly that network structure becomes more and more complex and diverse. As an important part of network system, network management system is of great significance to monitor and control all kinds of network equipments, guarantee that the network runs reliably with less network fault and higher operation efficiency.To accomplish network management functions, the most basic work of the network monitoring and management system is the network data collection and analyzation. Through the analysis of network data, It is possible to statistically analysis the network working status and effectively identify of the network incidents.This paper introduced the design and implementation of the data collection subsystem of the network monitoring and management system. As part of the network monitoring and management system, data collection subsystem complete acquisition work of various network data to provide the data support for the upper analysis module to work efficiently. The paper discussed the design solutions of the SNMP state, network packets, NetFlow and Syslog message these three type of data acquisition subsystem.The SNMP state collection module make use of the SNMP protocol to visit the management information database of the network equipment。It based on the open sourced SNMP++It uses the state grading access way to periodically read state information, according to the update frequency and sensitive reuirements of the network devices state.At the same time, It monitors the network device interior trap event.It provides the real-time state data to monitor the network.Network packet colletion module adopted distributed network data acquisition solution to complete network packets collection. It deploys multiple data colletcion nodes in the edge of the network which controlled remotely by a centralized control node. The data collection node use NDIS driver programming of Windows kernel technology to collect and store the netwrok packets rate up to 60 MB/s under the network rate of 30MB/s which can provide a complete data basis for for accurate positioning network fault.NetFlow and SysLog information collection module implements function of network flow and log information collection by remotely telnet to the network devices. And It enable the user to know clearly about the network switch work condition and the current network flow state.Through the analyzation of the log and flow information, make it clear for the user to know clearly about the network switch work condition and the current network flow state.