The Design And Implementation Of INAS Node Management And Communication Modules

Nowadays the industry is paying more attention to systems based on distributed stream computing, which have been used in enterprise products and played an important role. INAS is a network analysis system based on stream computing, but the previous solution of node management and communication has some defects. For example, the previous solution used update-event as a tool for node management, as other pre-defined event types for transmission which made the system functions and platform couple together, leading to poor scalability and any function change and extension to the system would bring the risk of poor reliability. Aiming at remedying the defects this paper presents a solution on INAS node management and communication modules.For the existing defects, this paper proposes a solution of using ZooKeeper service to assist nodes to be dynamically managed and using uniform event as the unit of communication between system nodes. This way the reliability of dynamic node management is enhanced, and the decoupling of platform-level module and application-level logic improves the scalability of the system. Besides supporting nodes dynamic adding and exiting and information real-time update, this solution of quick response to all the changes can ensure the reliability. Simplified and unified event communication solution changes the design of the previous redundant one, so that the solution can support the custom extension of application functions.In order to implement the design above, this paper divides the core of system into the node management module and the communication module. The node management module covers all the process of a node's work and the connection with ZooKeeper service. The communication module is designed based on the new uniform event solution,implementing event transceiver and processing as well as the interface to the scripts. The coordinated operation between the two modules ensures a good implementation of the design and the reliability of the system.The solution described in this paper has the following features. First,it designs and implements a new node dynamic update and management solution so that the node communication of the system can be ensured.Additionally, the uniform event solution enhances the scalability of the system functions. The above two points make the solution of this paper higher technical and practical value.