Design And Implementation Of Billing Aggreagation System Based On Message Queue

Suning Financial System has payment,loan,investment wealth management,stored value card,insurance and other businesses.In order to analyze users financial behavior and obtain order data,it is necessary to aggregate management of users orders under different business systems.The Sun ing financial system is also based on a microservice architecture,and each business system is also independently developed and deployed.Calls between microservices are implemented through tw o communication methods,HTTP calls and RPC,but there are many problems with these two com munication methods,such as high concurrency,which is easy to cause congestion,and the couplin g between various systems is too high The problem.With the development of business scale,these two communication methods also seriously affect the stability and scalability of the entire system.To solve the above problems,we have developed a billing service system(Bill Aggreagation Sy stem,BAS)based on Message Queue technology to implement the aggregate management service of billing details of various business systems.BAS is based on Kafka with high availability and hi gh throughput characteristics as message middleware.It uses asynchronous message services to i mprove the stability and reliability of communication between microservices and reduce the coupl ing between services.In addition,Kafka proposes a solution to map virtual topics for the problem of reduced message processing efficiency when the number of topics increases.This thesis mainly introduces the design and implementation of the billing service system.BAS can be divided into four functional modules: billing service access management,bill production m anagement,bill subscription management,and bill push failure compensation management.The bi lling service access management module is responsible for handling the connection between the e xternal service system and the BAS system,including managing the information of the external se rvice system connected to the BAS,and managing the creation and subscription of virtual topics c orresponding to the external service system.The bill production management module is responsibl e for persisting the bill data.This module encapsulates the operation logic of the Kafka message production part.The bill subscription management module is responsible for pushing the bill to th e corresponding subscription system,and also monitoring the bill consumption process.The bill push failure compensation module provides processing operations after message push failure,suports message re-push function,and improves the availability of the BAS system.After the system development is completed,the various functions are tested.After testing,all functions have reached the design requirements,performance and stability have also reached expectations,and have met the requirements of various indicators of the online production environment.At present,BAS has been deployed in Suning Financial Microservice Architecture,which greatly improves the efficiency of collecting billing data of various business systems,can more accurateely push customized services according to user behavior,and improves user experience.