Font Size: a A A

Research On Data Warehouse And Visualization System Of Provincial Road Network Based On ETL

Posted on:2021-12-25Degree:MasterType:Thesis
Country:ChinaCandidate:Y FangFull Text:PDF
GTID:2492306470484374Subject:Traffic and Transportation Engineering
Abstract/Summary:
With the rapid development of social economy and road transportation industry,more and more complex problems were gradually generated in the field of provincial road.The existing storage equipment in most departments of the road sector in Shaanxi was not sufficient enough to support the concurrency of millions of data.The interaction was not satisfying due to the different data and information structures among various traffic departments.Moreover,some information isolated islands were came into being.The way of processing massive road data efficiently is an important issue for provincial road information construction.In this thesis,a method of ETL-based construction and visualization of provincial road network data warehouse was presented,and data visualization was realized.The main contents are described as follows:(1)Through the collation and analysis of provincial road data,this thesis summarizes the reasons for the formation of multi-source isomerism.According to the characteristics of multi-source and heterogeneous data,a road network data warehouse model was established,and the STG layer and ODS layer fields were designed in detail.(2)The whole process of data extraction,cleaning,storing and providing of provincial road data warehouse was designed and implemented.By means of establishing temporary tables and publisher-subscriber communication models,the extraction module of the data warehouse was optimized and tested.The results showed that the optimized system is capable of realizing the extraction of massive provincial road network data in a short time and improve the extraction efficiency.(3)Using the designed road network data model as the core,the ETL technology of the data warehouse was applied to extract and load multi-source heterogeneous data from various provincial road departments,and finally presented the processed data by visualization method and then completes the whole process of the data processing.The test results showed that the data visualization link is able to perform the functions of reporting query,query subject and query electronic map.Using ETL-based provincial road network data warehouse and visualization technology,the integration of multi-source heterogeneous data of Shaanxi road is realized.It is of great significance in reducing information isolated islands and data integration cycles,as well as expanding the application level of provincial road information visualization.
Keywords/Search Tags:Provincial road, multi-source heterogeneous, data warehouse, ETL, data model, visualization
Related items