Maintenance Of Shanghai Actual Population Database Based On Data Warehouse Technology

As an international metropolis,Shanghai is becoming more and more mobile with the development of reform and opening up,and it is difficult to accurately and timely update the information of the actual people into the database of the actual population.As a result,there is a large deviation between the actual population data registered in the actual population database and the actual situation,which has a great impact on the decision of handling urgent events such as security governance and epidemic control.The problem of inaccurate data in the actual population database is manifested by the existence of a large number of people who are in Shanghai but whose information has not been registered in the actual population database（hereinafter referred to as missing registration）and people who have left Shanghai but whose information has not been cancelled from the actual population database（hereinafter referred to as not cancelled）.With the advent of the era of big data,people will leave clues in massive data when they carry out various social activities,such as the data generated by common community perception,mobile phone signaling,takeaway,express delivery,etc.Massive data on personnel behavior and life provide certain support for the analysis of uncancelled and unregistered personnel.This paper uses a large number of people’s behavior and life data,with the help of data warehouse technology,to do some exploratory research on maintaining the actual population data in Shanghai.The specific research work carried out in this paper is as follows:（1）Based on the continuously updated population data and the existing actual population database,a suspicious population data warehouse is constructed to update the city’s actual population database in time.First,analyze the various population data obtained by the public security,and understand the characteristics of the data in each data source and the data acquisition cycle;Then build a data warehouse of suspected uncancelled and suspected unregistered topics;Finally,use Kettle to perform ETL processing on the acquired data,and load the suspicious personnel data（suspected uncancelled or unregistered）from various data sources into the data warehouse by comparing with the registered data in the actual population database.（2）Combined with the characteristics of data generated by various types of personnel in the actual population and the characteristics of various data sources,the investigation logic of uncancelled personnel and unregistered personnel is described in detail,including the data fusion analysis plan.Through the analysis of the data in the data warehouse,the information of highsuspected uncancelled personnel and high-suspected unregistered personnel information are finally identified,which can be used to update the actual population database in Shanghai in time.To a certain extent,this solves the problem of untimely and inaccurate data updates in the city’s actual population database.（3）This paper uses Spring Cloud,Quartz,Echarts,vue.js and other related technologies to design and implement the maintenance system platform of Shanghai real population database based on micro-service architecture.The system is based on the implementation of the suspicious population data warehouse,realizing the real-time monitoring of data,automatic scheduling of tasks and statistical analysis of data and other functions,to a certain extent,to provide support for public security departments on the maintenance and use of the actual population database.