Design And Implementation Of Data Analysis System For Public Security

To handle the enormous challenges of public security incidents our public security disposal strategy needs to change from "react after incident" to "prevent before event".Therefore,the security sector need to strengthen the comprehensive utilization of data resources,automated in-depth data analysis and information mining to improve the timeliness of information,and prevent sudden security incidents.By constructing the data analysis system for public safety,this thesis provides the means of monitoring and warning for information mining and addresses the problems faced by security sector.Based on the research of active site-oriented data acquisition,graph data compression,analysis and visualization,this thesis designs and implements an data analysis system with active data acquisition and automatic data analysis,achieve the detection of people of interest,specific groups,abnormal behavior and security incidents.The main work is as follows:Achieve site-oriented data acquisition.This thesis analyzes the technology of data acquisition in the field of public safety,researches the data acquisition method based on browser simulation and browser manipulation,implements authentication with password and PKI certificate,data acquiring and parsing,parallel acceleration,distributed acceleration and other acceleration strategies,and data deduplication with LRU cache or direct mapped cache,to achieve accurate and efficient data acquiring,and provide the basis of data sources for information mining applications.Research on data analysis,design an algorithm for implicit relation discovering and prove its correctness.Research on data comparison speedup technology based on Bloom filter or Cuckoo filter,implementing timely detection of people of interest.Discover human relations implied by activities via statistic methods.Constructing the human relations and activity diagram from multi-source heterogeneous data.Research on graph data compression.visualization,enabling security sector to observe and analyze the result intuitively,provides monitoring and warning means.Design and implement of the data analysis system.With the integration of siteoriented data acquisition,data analysis and graph visualization technology,an data analysis system is designed and developed to acquire and analyze data automatically.Personnel and activity records are analyzed and monitored,and people of interest,specific groups,abnormal behavior,and security incident are detected.