The Research And Application Of Distributed Memory Caching Technology In Data Processing Platform

With the rapid development of network technology, large amounts of data and high concurrency has become an important issue facing the major internet company,well-designed cache can reduce the pressure on the network server as well as reduce application response time, distributed memory caching technology is a hot topic in this area. Distributed memory caching techniques have been successful in Amazon,GitHub,Sina and other well-known companies. Currently, Memcached and Redis technology is widely used in this area.This paper does a deep research and analysis on distributed memory caching technology and Redis which is one of the most popular techniques. Using consistent hashing algorithm, design and implement cache module of the payment gateway data processing platform base on Redis, then use it into the transport communication layer of the payment gateway system to meet the performance requirements of the system.This paper firstly discusses the features and research status of distributed caching technology,then discusses the research significance and content. Introduce payment gateway data processing platform and analyze its functional requirements, focusing on the needs of the payment gateway communication transport layer. After that, the physical structure of the payment gateway platform and design are described, focusing on the design of the payment gateway communication transport layer and the application of cache in this layer. Hash algorithm evaluation criteria is given as well as the distributed strategy------consistent hashing algorithm, then discuss and design the implementation method of the algorithm in distributed cache module as well as give a detailed discussion of its implementation. Design and implement the payment gateway communication transport layer based on the distributed cache system, then detail discussion of its functional modules and business modules is given, after that, describe the design and implementation of the cache object. Realize the distributed technology by using Jedis which is the terminal of Redis, design and implement the payment gateway communication transport layer based on caching technology. Make a testing of the system function and performance. Prove that the system meets the actual business needs and promotes system performance.