Design And Implementation Of An Scalable&General Anti-spam Information Processing Platform

User Generate Content(UGC)products due to its spontaneous content and extensive subscriber inevitably become the victim of porn,politically sensitive and fraud advertising.This is not only destroying the user experience,but also seriously eroding the social stability and people's health.Although companies began to build their own solutions,cause of fragmented works,restriction of cost and technology,it costs expensive but accomplish less.The market and society urgently need a more professional and excellent anti-spam solution.This platform facing to UGC products,using advanced agile development pattern,a variety of third party open source technology and middleware designed and implemented anti-spam processing platform.The main contents and results are outlined below:1.To analyze and design the platform function requirements,and scalability,generality and platform based performance requirements.2.Design the artificial audit,offline and online machine audit functions,and distributed anti-spam processing platform based on Http protocol software architecture and platform network interface.3.The design has realized the identify spam recognition technology business process based on keyword matching,high frequency behavior rules,the "hot-swappable"ability of component design,and the Agglomerative Clustering by Minimizing Local Margins algorithm.4.Testing.According to access the "YueHui App" to test the platform's function.Then access 20 UGC products and using Screen Anytime to do some platform performance test.According to access the keyword matching and high-frequency behavior rule to do some capability and generality testing.The result shows favorable and the response speed are under 220ms.Anti-spam platform design and implementation of this article follows the SO A,asynchronous thought,and the test shows that this platform completely achieve the requirements,it's a general,scalability and platform anti-spam solution.