Urban Road Traffic Flow Data Cleaning Technology And System Implementation

In the city’s intelligence and information technology,data is the basis of information,data quality is the basic conditions for effective analysis and mining of data;However,due to the detection of aging equipment,transmission line fault detection,environment and equipment debugging and improper use and other reasons,the dynamic traffic data collected by the detector has all kinds of quality problems,if the use of these quality problems of the traffic data directly,traffic managers may make the wrong decision;Therefore,in order to ensure the city road traffic flow data quality problem of decision making in traffic management,data cleaning is necessary for the detector collected traffic flow data quality,to ensure the effectiveness of traffic decision-making,in order to ease the traffic congestion problem,timely and effective handing of traffic incidents,which makes the whole city road network traffic running smoothly.Therefore,traffic flow data cleaning technology and its application research not only has theoretical value,but also has practical significance.In order to improve the city road traffic flow data quality for the purpose of the traffic flow data from the microwave detector of data cleaning method by time and space,the design and implementation of traffic flow data cleaning system,so as to solve the emerging city road traffic flow data in abnormal data and missing data.The main work and achievements of this paper are as follows:1.Based on the analysis of urban road traffic flow data,the data problems in traffic flow data are divided into abnormal data and missing data;2.Using the traffic flow theory,threshold theory,put forward the abnormal data identification and repair model;Lack of sources were analyzed at the same time,the missing data recognition model,using time series method and space method,is proposed to repair the missing data model;3.Using the data of urban road traffic flow in Nanchang,the model of anomaly data recognition and repair and missing data recognition and repair model are tested and analyzed,and the advantages and disadvantages of various methods are compared,which provides reference for the selection of methods;4.According to the actual demand,the design and implementation of city road traffic flow data cleaning system,finally,the function of the whole system is tested,and the test results were analyzed.The results show that the function of normal operation,cleaning results under certain conditions,with high efficiency,meet the development requirements.