Design And Implementation Of Traffic Monitoring System On Telecom Data Network

The rapid development of Internet promotes the process of information technology and lays the information infrastructure of the New Economic Times. Internet is changing the way we live, play, work and study. The network will determine the way we live in the future. The quality of network directly affects every aspect of our social and economic life, so network management emerges.Performance monitoring is one of the most important parts of network management system. By monitoring performance, we can get the key values of network parameters, and alerts will be sent to inform system administrator when the values exceed threshold. According to the performance data, the work state of network can be understood, and its behavior regulations can be found out. It can also provide ways and solutions to design network architecture, check out and resolve network problems.Traffic monitoring is a fundamental function of network performance monitoring, and the network load balance can be reflected by monitoring the kinds of traffic information. Resource load balance can be showed and potential choke point can be found by monitoring the utilization of network devices. It is well known, resources will be wasted in devices with very low utilization, and system performance may decline with very high utilization. By monitoring availability of network element, stability and dependability of network can be denoted. The end-to-end performance, which is the communication performance between a device and one another, can represent the quality of network service.In telecom data network, the network management becomes more and more difficult than before because of the increasing scale, complexity and the expanding application business. As the increasing scale of Jilin TieTong, the devices managed by network monitoring system designed by us are notably different from each other,involving router and switch which mainly come from Cisco, Huawei, Nortel and so on. Among them, the system needs to handle and manage lots of data. At the same time, it provides a better GUI for user to use.Currently, network traffic measurement techniques varied, each with their own strengths and weaknesses. In this paper, we research and analysis the theory and methods of network traffic measurement, present a more detailed analysis and comparison of several popular network traffic measurement tools. As reference to the "Jilin TieTong Telecom Data Network Traffic Monitoring System" project, we propose a solution of data traffic collection and storage, the design of the software and the implementation of the system.In this system, according to the current situation of data network and requirements for data traffic collection and present, we put forward 2 kinds of network traffic measurement methods based on NetFlow and MRTG. The data network of JilinTieTong Telecom has configured the routers of Cisco 12000. The data collection by end-to-end will not increase the additional cost of the network. But only the main stream of routers and high-power switches support the Flow function so far. The devices such as DSLAM, BAS can not support the Flow export function. In the other hand, we consider that NetFlow can not capture the real-time data packets, so the traffic statistics based on NetFlow is not real-time. Then, we decided to use NetFlow integrated with MRTG. The integration of the 2 technologies can reflect the run-time state of network well on both macrocosmic and microcosmic facet.Current flow-export versions of NetFlow are version1, version5, version7, version8 and version9. The most common used of them is version 5. As the rapid development of Internet, the IPv4 protocol being used as IP standardization is facing the address shortage problem. The development of current Internet is restricted a lot. IPv6 comes forth and it will become the soul of next generation network. Under this situation the version 9 of NetFlow supports IPv6. As the implementation of this system, we have considered about the future Internet development, so the system supports the version 9 of NetFlow. It will run on the IPv6 network environment as well as IPv4.MRTG is a tool to monitor the traffic load on network-links and the resource of host machine. It is the open source code based on the protocol SNMP. It can get the traffic information by sending the SNMP requests to the objects being monitored. According to the traffic information, MRTG generates traffic graphs in the PNG format. And it will generate HTML pages containing PNG images which provide a live visual representation for user. In this system, we use MRTG to monitor about ten of key network equipments on the data network of Jilin TieTong. We can help the network administrators to find out the exception through visual representation of these equipments traffic information images.For management the history data, performance monitor needs to storage mass data. So when we design the strategy of storage and management about the mass data, we choose the database management as the higher priority and the file system storage method as lower because of our considering the efficiency and performance. The data storage by file system is mainly the configure information which does not need to modified through GUI, such as the startup configures of data collection, parameter configures. Database is mainly used to storage data collection traffic information and writes the data to hour table, day table, month table and year table by time. Through this method to manage data, we can assure the data integrity efficiently and won't cause the sharp increase of data.Finally, this paper sets forth the design and implement of this monitor system, including the system function, architecture, deployment and modules. And I give the general opinions about this system. It takes the policy of"collection by distribute, management by integration"and makes sure the data integrality and correct. The whole system takes N layers architecture, implements the distribute disposal of the application. It differentiates with layer GUI, business logical, data permanent storage, original data collection. Each layer communicates with the uniform interface, upper layer should only call the service provided by the lower layer and needn't care about how the service is implemented.It has 3 advantages comparing with other monitor systems:1. Use freely available software MRTG and lower cost NetFlow to do traffic collection, and it is pure software implementation, convenient, need not high price hardware probe and reduces the cost.2. It supports NetFlow version1,version5,version7,version8,version9 can use at both IPv4 and IPv6 environment as well as IPv4 mixed with IPv6.3. Integrate NetFlow with MRTG, use each of their advantages, reflects the run-time state of network on both macrocosmic and microcosmic facet.The system has been used by Jilin TieTong Telecom Network. The running results have proved the monitor system gets the good effect. Network administrator can manage the network conveniently and effectively. It proves our design and implementation are available and effective.