Design And Implementation Of Message Queue In Cloud Encryption System

With the arrival of 5g era,network transmission has become more rapid and extensive,all walks of life have entered the stage of Internet transformation and upgrading.Compared with the previous era of big data and mobile Internet,there are more and more traffic and data in various areas of the Internet of things,such as smart home,unmanned vehicle and so on.As a middleware product,message queue can be well used to solve the problem of message transmission and forwarding between various terminals,and also support the message exchange between various processes within the system,which is widely used in system design.For our cloud encryption system scenario,we designed a message queue product that supports high-performance network I / O and can write and read files quickly.Based on the Java non blocking I / O framework Netty,we designed our own message transmission protocol,and support efficient encoding and decoding at the consumer,broker,producer side,as well as asynchronous data transmission.It not only improves the performance of the single machine,but also is more efficient than the Java Native Ni O in development.At the same time,for the broker side,we designed a cluster synchronization mode,which supports dynamic load balancing strategy,and can solve the problem of unbalanced traffic distribution in the process of system operation.In addition,in terms of message persistence,we adopt a unique message index mode,combined with the MMAP interface of the operating system and the related characteristics of pagecache,which can support the fast write and read of files above TB.Through the later performance test,the message queue designed by us has a significant improvement compared with Active MQ in the single machine.