The Design And Implementation Of Delay Queue System DelayQue

With the rapid development of company’s business, the complexity of our business is growing rapidly. The requirement of breaking down some tasks and running them asynchronously occurs. On the one hand, with the help of this requirement, we could make the complex process asynchronously to increase processing speed of the system. On the other hand, we could decouple the complex system and reduce the coupling of different moudles. In other words, a powerful delay queue is necessary at this time.Nowadays, there are many open source realizations of message queue, but most of them don’t support the feature of delay. And due to the languages and frameworks of some open source delay queue uses, it’s inconvenient for us to expand in the future. Since of these reasons, we have to develop the delay queue by ourselves. The delay queue this paper describes is based on Java, and technique like NIO network framework Netty and Key/Value storage Redis are used. And the delay queue is able to satisfy our business teams’requirements of ensuring the complete functions, stabilization, reliability and easy to expand.This paper introduces the requirement analysis and module design of our delay queue in detail, and emphasis the realization of network communication module, task operation module and data storage module which I’m responsiblefor in detail. The network communication module based on Netty which supports these two communication protocols, TCP and HTTP, and we also defined our data communication format. Through good interface oriented programming style, the scalability of our system is promoted. The data storage module based on Reids provides a storage mechanism which is efficient and easy to expand.Our delay queue is released and running on fine now. And it’s used widely on many business lines. It does well in breaking dwon complex task asychronized and decoupling complex business logic. At the same time, our delay queue helps to reduce the development work of business technology team and improve their efficiency.