Design And Implementation Of A Data Report System For Short Video Platform Advertising Business

With the development of Internet advertising,advertisement marketing has become an important method for Internet companies,and research on advertising data analysis and processing has also attracted widespread attention.Based on the advertising business data of the short video platform,this thesis designs and implements a data reporting system for visual analysis.Compared to traditional websites,data of short video platform advertisement is greater,content is richer,and processing timeliness is higher.How to store it and calculate it in real time to obtain key indicators is the focus of this thesis.Traditional databases cannot effectively store and process large historical data,and big data platforms such as Hive and Spark cannot perform real-time data query and analysis.Based on this background,the system uses a high-performance columnar database Click House as the report storage engine to provide the system with underlying data storage and query ability.The main function of the system is the display of data reports.According to the specific business needs,the system provides users with data functions such as multi-dimensional data retrieval,theme reports,and custom reports,as well as basic functions such as permission control and data download,so that users can enjoy exclusive themes.The report service can flexibly and freely configure report display conditions and indicators to meet the needs of self-service query.In addition,permission control can ensure the security of system functions and data,and data download is convenient for users to summarize and archive data.In order to improve report performance,the system has made the following optimizations: the first is to use Elasticsearch search engine to pre-store and filter fields to speed up the fetching process in the face of multi-field matching and filtering query scenarios;the second is to design a time-slice-based summary indicator caching scheme,combined with minimum cost caching The replacement strategy realizes quick query of aggregated indicators;the third is to create dimension and time series materialized views to store report pre-aggregated data,and to design and implement a view routing strategy based on the "greedy" idea to reduce the overall response time of the report.After program design,function implementation and system testing,the system runs stably and provides users with convenient and efficient real-time data query and analysis services.