Research On The Data Transfer Optimization Technologies Of Distributed System Based On Message Queue

With the development of network technology and the release of various kinds of software product,people's life is more and more associated with the Internet.With the rapid increase of the number of users,the requirement of the server also has increased dramatically.For this reasons,distributed system began to play an important role with the network technology.At the same time,distributed system brings many problems and challenges.Operating systems,programming languages,databases,and other differences to the communication between distributed systems has brought a lot of trouble.Message-oriented middleware can shield the differences between the network and operating system platform,realize easy and reliable transmission of data between distributed applications.Message-oriented middleware is widely used in the distributed system.This paper introduces a widely used and powerful message-oriented middleware which is named RabbitMQ.We research and optimize the data distribution technology and data collection which are based on message-oriented middleware RabbitMQ.We will study and optimize the data distributed technology which is based on RabbitMQ and put forward a distribution business model of configuration information in use of RabbitMQ.We analysize and optimize the Topic routing algorithm used in the model.The original routing algorithm use the binding keys to form a tree.The optimized algorithm will increase the binding relationship,reduce routing key when message routing in the tree which is formed by the matching pattern.In this paper,We through contrast experiment proves that the optimized routing algorithm reduce the number of matching when route a message,shortens the time of message routing and speed up the distribution of configuration information.In this paper,the data collection technique which is based on RabbitMQ will be studied and optimized.We put forward a business model which is used in log collection.We analysize and aptimize the internal message processing steps in this model.The generation sides and collection sides of log are more of a relationship.So we can increase internal queue processing processes to improve the processing performance of the RabbitMQ.In this paper,we through contrast experiment proves that the optimized message process can support morelog generation sides and have higher processing performance.