Design And Implementation Of Internet Content Risk Management Platform

The Internet era is inseparable from content risk management.At present,in the wake of continuous development of communication network technology,the daily transactions and content generated in the Internet are explosive growth.Internet regulatory policies are constantly improving,and the era of content security is coming.Content censoring is an important responsibility for internet enterprises to control users’ abnormal actions and content risk leakage,which requires a lot of experience accumulation and almost becomes the biggest challenge faced by start-ups.In order to unify the requirements for risk management of each business line in the enterprise,it is necessary to build a unified risk management platform based on the concept of middle platform,laying a solid foundation for the enterprise content risk management system.Firstly,the thesis introduces the main problems facing the risk management of internet enterprises,gives an overall description of the subject tasks,and conducts technical research and demand research respectively.Then the technology and requirement analysis process used in the development of the platform are introduced,and the system is divided into three subsystems according to the business:basic service,action risk management and content moderation.In the overall design stage,the interaction between each instance and component is explained in detail through the system network structure.Through software architecture,the division of different services in platform architecture is introduced.Abstract requirements based on E-R diagram and design the underlying storage structure;The interface and external interface design are described briefly.In the stage of detailed design and implementation of the system,the specific functions of the subsystem are designed through sequence diagrams,and the front-end and back-end of the project are developed in Vue.js and Go programming language.Finally,the platform is tested using different means to ensure that the system can meet functional and non-functional requirements and meet the launch criteria.In the risk management platform,a simple expression engine is used to control user action.The handling of machine audit policy results is implemented using Gengine rules engine.The platform as a whole adopts a hybrid architecture of monomone and micro-service,and uses Nginx open source components and Proxy self-developed gateway as the interface layer respectively.The Proxy bottom layer ensures high performance real-time configuration synchronization based on ETCD.Asynchronous calls and delayed tasks between microservices are implemented based on Kafka and Redis respectively.MySQL is used as the main implementation of the storage layer of business data.Business logs and system logs are stored in Elasticsearch.In the end,all services are deployed on cloud servers in the form of container images,and a complete service ecosystem is built with open source components such as monitoring Prometheus and distributed link tracking Jaeger.Internet enterprise internal complex diverse lines of business,the author of thesis puts forward a standardized content risk management architecture based on the concept of middle platform.The platform construction is completed by the Go concurrency related technologies combining expression and rule engine.The risk management platform has good generality and configurability,easy to different roles within companies to understand and use.The external interface of platform is highly available,which can meet the requirements for content risk management of different forms and sources.