Design And Implementation Of The Multidimensional Data Analysis System Based On Big Data

In the past decade,the combination of Industry and Internet is in the general growing trend.As many industries becoming Internet based,the number of users has increased sharply,accompanied by the explosive growth of data volume.It is becoming more and more difficult for enterprises to analyze user data.Firstly,the data storage capacity in a single day has reached the PB level;Secondly,the analysis time is longer and longer;Thirdly,there are various data sources,and the efficiency of cross data analysis is extremely low.Therefore,solving the above three problems is the goal of multi-dimensional analysis system.At present,many domestic Internet companies have implemented the BI system based on data warehouse and big data platform,which has solved some problems,but there are still some problems in real-time.In view of the above situation,this thesis designs and implements a multi-dimensional data analysis system based on big data.Users can access the data source,and then carry out ETL(Extract-Transform-Load)operation on the data source to get the final analysis.Then,personalized Kanban can be configured for the data source,and the function of topic classification and authority control can be provided for the Kanban.This thesis will use the use case diagram and flow chart obtained by Visio and other tools to analyze the requirements of the system,and then design the overall system architecture,functional modules and database design,and give the corresponding design charts.According to the above requirements analysis and system design,we use Hadoop,hive and other big data platform tools,OLAP(On-Line Analysis Processing)tool Druid,and Spring Boot,Vue and other frameworks to realize a multi-dimensional data analysis system based on big data,and use microservices to ensure the availability of services.After a complete system test,the whole system can run well,and each function module can be used normally.The whole process from development to display multi-dimensional data analysis Kanban is completed.The platform simplifies the process of multi-dimensional data analysis,improves the development efficiency,provides good chart display,gives the data analysts expect in a short time,and provides strong data support for enterprise decision-making and business operation.