The Research And Implementation Of Transaction Log Collection System For Bank

With the growth of bank business, customer information and transaction log data of bank has continued to increase. It is important for the development of the bank to collect the data quickly and manage or analyze effectively. Therefore, for such needs, this paper designs and implements bank transaction log information data collection system(DCS) to provide support for the development and operation of bank data platform.By studying bank data platform and data sources features, this paper proposes an improved method of collecting the data source to resolve the existing data sources method inadequate in time and performance. The improved method can achieve fast and efficient data collection, reduce data transfer time, improve server performance, main parts list as following:(1) It proposes total design proposal of bank transaction log data collection system, which resolves the low efficiency, time-consuming problems of existing data collection methods and improves the whole efficiency and timeliness of data transmission.(2) It proposes master-slaves model based on multi-process and 10 multiplexing, which improves concurrency and stability of bank transaction log data collection system. And It proposes the load balancing method among multiple slaves, which can evenly distribute requests among multiple slaves work processes to improve server performance.(3) According to classical thinking of producers and consumers, It designs the data buffer queue, which resolves the synchronization and rate inconsistences of producer-consumer, and prevents data pipe rupture at the same time resolves the problem of data loss.(4) It implements a function of smooth upgrade the DCS and configuration dynamic loading using Linux signal mechanism, so as to achieve the DCS 7* 24 hours of uninterrupted working,.It proposes the configuration file dynamically adjustment by analyzing the configuration dynamically to adjust the parameters of the system so as to improve the flexibility of the system.(5) Based on the above research, It designs and implements prototype of bank transaction log data collection system, And it proposes the test program based on the highway toll way, finally verifies the proposed technical solutions which can meet the bank data platform nees in time and performance by performance test through test environment.