Customized Design And Implementation Of A Provincial Industrial Data Information Platform

This article was written on the background of the actual information construction project of the author's work unit.The author's unit mainly divides the industrial development of the province.It is main functional unit in industrial field.In order to facilitate the follow-up introduction,the author unit calls a provincial department.As the administrative department of industrial economic function of the province,the business involves a wide business range,complicated and complicated business data,and the repeated collection of the same data in various departments is common.The internal management system has no unified planning,so that a large number of data cannot be used scientifically,and it has increased the burden to the enterprises and cannot improve the administrative efficiency of its own.The existing application platform architecture of the Department is obsolete.Although the data is large,it does not have the ability of data exchange and analysis.It is very expensive to reorganize the system through the unified software,which is the same as redevelopment.In order to deal with this problem,the overall design of the industrial data information platform is carried out from the perspective of business use,and the overall design function of the platform is realized through the method of large data.The researcher's work is as follows:(1)based on the overall architecture design of government cloud platformIn order to adapt to the trend of the centralized development of the business application platform of the government affairs department,the platform relies on the technical rules of IaaS and PaaS,which is based on the government information and chemical cloud service platform,including data collection,data storage,data analysis and display,and data resource portal four levels,and the construction of data and system functions of each part within the framework is accurate.It is consistent with the government information construction plan,providing guarantee for the long-term and continuous operation of the platform.(2)design of industrial data exchange acquisition platform based on ETL and other tools.When the platform is designed to integrate the internal system of the Department to run data,the data of statistics departments and the Internet and other reliable sources are concentrated to the unified platform.The WebService adapters are developed by using ETL and other tools to establish a complete set of three party channel data collection and analysis platform to avoid their own data acquisition.The problem of time and inaccuracy can also maximize data availability.(3)design of industrial data storage computing platform based on distributed storage applications.This module is the core things of this system.It can implement distributed file storage technology,adopt distributed computing framework and use cluster resources to implement distributed and parallel execution of computing tasks.It has distributed data collection components and supports data collection from a variety of sources such as relational database system,file system and log.The distributed data can be collected,aggregated and transmitted by structured data.Relational data can be transmitted from RDBMS to HDFS/Hive through the JDBC interface.(4)the design of industrial data analysis and display system based on BI software.The industrial data analysis and display system uses BI system software,data mining tools,etc.to visualize the data results,support the statistical analysis of the special data in various departments,and effectively use the data resources to avoid the construction of repeated investment.By monitoring and analyzing the data of industrial economic operation in the province,the development judgeing,the prediction and earlier warning,information release and information guidance ability are promoted,and the potential application value behind the industrial economic data is excavated through data analysis.Through this platform,the provincial department has preliminarily realized the integration of data within the Department and the relevant departments.It can put the overall situation and the partial analysis results into a centralized display,and can export the data freely,have the preliminary analysis ability,improve the use efficiency of the internal data in the Department,and provide accuracy for the leaders who incloud all levels in decision-making.High efficient data support for enterprises the production and management to make reference,to provide effective protection for the industry development,enhance the the government departments level of decision-making,meantime service enterprises,the objective of the original design of the platform.