Net Element Information Collecting System For Provincial Level Network Operators

The telecom operator's network structure is complex,and consists of Wireless network specialty,Switching network specialty,data network specialty and transmission network specialty.The original classification method according to specialties does not apply to the growing network.Integrated Network Operating System that base on e-Tom was put forward for change the network from decentralized management,data silos to centralized management,shareable data,dynamic extension data acquisition range,shielding the difference between equipment manufacturers.Collection layer in three tier architecture integrated network operating system faces some problem beacuse of centralized collection method.How to keep load balancing in cluster of collector in the case of large amount of data collection and frequently shutdown collectors.Theses are how to ensure data quality in the case of huge data quantity,how to suppress alarm storm with the huge network full of flash,how to install new network equipment fast and flexible with the growing network.And all these problems above need to be solved.This paper with the integrated network operating system project as the background after analysed Integrated Network Operating System architecture,load balancing algorithm and application integration interface,design and implementation a net element information collection system of Operator to solve the problem above.The system include scheduling of collection task function,alarm storm processing function,collection adapter that can plug in dynamically.Meet the needs of non-stoping when data source accessing,alarm storm can be suppressed when data collecting and load in cluster can be balanced when data processing.Test and application show that first NEICS could access new data source by adapter without stopping.Second NEICS could change to the alarm storm mode when alarm storm happened and could compress the amount of alarm effectively.Finally,when collection task increased or the amount of collectors changed,the difference of load on collectors no more than 15 percent.The main points of this paper are as follows:(1)Collection machine clusters are needed for centralized collection method of Operator.This paper improved the RoundRobin and ConsistentHash algorithms,signs the collection machine by weight hierarchy according to its load and calculates probability of assigning tasks betweent collection machine clusters belong to different weight hierarchy.Application shows that the scheduling of collection task function base on the new load balancing algorithm can avoid downtime and so on effectively.A collection machine clusters consist of three collection machine can process 10 gigabyte of collection task in one hour.(2)To solve the problem of alarm storm in the process of collecting data,this paper put forward a alarm frequency compression model and a associated compression model to filter alarm and reduce the number of the same and related alarms.Application shows that the alarm storm processing function can suppress alarm storm effectively.The average number of alerts per hour is only 300.(3)To solve the problem of installing new net element quickly and flexibly,this paper design and implementation the net element data collection adapter that can plug in.Realized the adapter that meet interface specification can access to the platform framework and use standard format information comunicate with the platform framework by defined standard interface between adapter and platform framework.Application shows the adapter can work effectively.New net element can be managed by the acquisition system with out acquisition system downtime and 18 kinds of net element has been already managed by the acquisition system.(4)All the adapters can work properly,the amount of alarm can be compressed by 76.3 percent during the alarm strom and the load on the collectors can be balanced was verified through the methods that registering 5 adapter continuously and distributing collection task,simulating alarm storm for 1 hour,stop and start more than 2 collectors at the same time when NEICS is running.