Design And Implementation Of Network Resource Management System Based On SparkStreaming

With the progress of science & technology and broadband service,optical bit broadband and set-top box terminals have came into thousands of families.Network equipment terminals have many problems when providing fast network services.For example,network suddenly break off,video-on-deman caton,unable to surf the internet,etc.because the network links are extremely complex and constantly changing in the real environment,it is very difficult to monitor the running state of the equipment on the link,It can not accurately locate the problem just rely on the existing alarm monitoring methods,In order to clearly monitor the network link situation of the optical network end to the end device,accurately locate the fault problem,shorten the troubleshooting time of maintenance personnel,improve user satisfaction.From the point of view of technology application,this thesis puts forward a complete solution based on the network resource management system of SparkStreaming,in order to reasonably plan the real-time computing platform of massive data.This thesis first introduces the background of broadband development and the significance of the research,and then,put forward the design scheme of network resource management system based on SparkStreaming according to the experience of constructing real-time big data processing platform at home and abroad,Design and implementthe calculation rule loading module,message processing module,broadband service computing module and network resource topology module through the analysis of the business requirements,In order to quickly display the current network link,this thesis design the relationship between the upper and lower level of the device terminal rely on the Redis memory database to.Finally,in order to ensure the system can be stable and efficient operated,docomprehensive test to the system design module including function test,performance test.Since the system is put into practice on line,the external support system of Sichuan telecom network resource management system includes user health files,electronic operation and maintenance,comprehensive analysis,10000 processing and other online applications.More than 200 services have been registered and opened through the ability open platform.