Design And Implementaion Of Node Management Sub-System In The Network Real-Time Analysis System

With a rapid growth of network speed and network data traffic, the requirement of real-time network data analysis is rising. The deficiency of single host’s processing performance contributed to the rapid development of distributed real-time data processing system, effective management of nodes in such distributed systems has become a more and more important research field.Based on the study of nodes management in distributed systems, goals of node management sub-system in the network real-time analysis system are proposed:the management is for "peer architecture of no-central-node" cluster, the network real-time analysis system supports scalable nodes cluster, node management sub-system supports system’s scalability, the function of node management can handle the situation that some nodes in the cluster are broken down, when some of the processing nodes do not work because of self-failure, other nodes can take over the work of failure node.This paper firstly introduces the real-time network analysis system, which is developed based on distributed flow-calculation model, which is focusing on the overall architecture related to nodes management, and then I describe the detailed needs of nodes management in real-time network analysis system. The needs include effective nodes management and monitoring status of data-adapter nodes and data-analysis nodes, and also includes load balancing between data-analysis nodes. To be specific, node management can be divided into five parts:1) management of nodes’configurations,2) basic functions include adding data-analysis nodes, deleting data-analysis nodes, modifying data-analysis nodes, inquiry of data-analysis nodes,3) keep-alive mechanism,4) fault management of failure nodes,5) load balancing mechanism. And then detailed designs of architecture are proposed based on the needs. After finishing realization of the above functions, I conduct a comprehensive functional test and performance test of nodes management sub-system in the network real-time analysis system. The test verify the advantages of functionality and performance of nodes management sub-system in the network real-time analysis system implemented in this paper. Finally, the paper provides suggestions and future research directions about the nodes management sub-system in the network real-time analysis system in the paper.