Simulation And Implementation Of Kafka Distributed Message System Based On NS3

As data has penetrated into most areas of our life, the rapid development of the technology of data mining led to more frequently use of data. Distribute d messaging system, which shares data on message basis, become the core tec hnology of data processing gradually. With the extreme growing of information recently, the traditional system which focus on small account of data, cannot meet our demands for data processing. A high-throughput distributed messaging system with the function of real-time consumption become necessary.This paper investigates the theory of distributed information system named Kafka which has currently exists, summarizes its characteristics and design strat egy, through the analysis of function requirement and the abstract design, then model with the network simulate tool NS3, then design the actual system depl oyment simulation function and the scene, finally run the simulation system, a nd analyse the result.The main achievements of this paper as follows, summarize the theory of t he distributed information system Kafka through design and implementation of the simulation system, realize some functions such as create Kafka users in the actual distributed network system, transmission storage and consumption of inf ormations, automatic load balancing function of node and so on,provides a tool in the simulation environment for teaching and research in the future. Moreov er, I also have been more in-depth study and practise on the network simulatio n technology and computer programming technology.In the whole study of the issue, I served the following work:investigate a nd summarize the related theory, write and classifies documents,learn network s imulation technology, analyse the functional requirements of Kafka,then model a nd implement the simulation system by coding. Finally, test the simulation pro gram and analyse the result, which reflect on Kafka distributed messaging syst ems intuitively.