Research And Application Of Data Visualization Technology Based On Hadoop

This topic mainly studies the problem of commercial data visualization in multi database environment, and all the business data are stored in different database servers. Due to the multi database environment in the visualization of the whole platform data, statistical analysis was done separately for each business database server, then on statistical results are combined, the data analysis stage efficiency is low. Therefore, in the course of the study, we first integrate the dispersed data into the data warehouse, and then we can display the data in the data warehouse.Firstly, through the research on the integration method of the dispersed data, the Hadoop technology is used to integrate the distributed data. The Hadoop ecosystem provides a hive tool can be used for multidimensional data analysis, sqoop tool can realize the data transmission between the relational database and Hadoop. Research in the use of Hive technology to build data warehouse, through the Sqoop technology data from distributed database server is loaded into Hive data warehouse, complete visualization of data preparation.Secondly, the technology and method of industry data visualization are studied, and the characteristics of commercial data and data presentation format are analyzed in detail. Design and implementation of the SVG (Vector Graphics Scalable) map visualization algorithm, visualization data can be carried out with the number of dimensions of custom configuration, making the results more rich and intuitive visualization.Then, according to the practical application, from the perspective of sales analysis, commodity analysis, customer shopping preferences, enterprise ranking and so on, the use of HQL statement on the integration of business data for statistical analysis. Through application scenarios on the map, satellite imagery, association graph visualization technology, method of the drawing and data expression way and mode of interaction research, combined with statistical analysis results data storage characteristics, construct a visualization data model.Finally, combined with the actual project, use visual controls echarts and based on SVG map visualization algorithms of visualization data model display, the realization of the map for the business data analysis, character image, the chord diagram visualization. Validation of the application of Hadoop technology and visual controls to achieve business data visualization technology roadmap.