Design And Implementation Of The Bayonet Data Integration Platform

As the rapid development of the police information construction, especially with the Skynet project being the key direction for construction, according to the unified arrangement of Ministry of Public Security, each sector in the police department will successively establish a unified command management center in which the public security, the traffic policeman, the airport and the highway are interconnected. Growing demand on control has triggered a dramatic increase in data through the bayonet, in particular the high speed concurrent in the highway and the public security bayonet has resulted in a huge pressure on existing data storage systems. Since accesses of different regions are built by different factories, the access data do not have a unified field description. There lacks a unified planning and technical coordination among them, thus failing to effectively achieve interconnection, interworking and resource sharing of the internet. However, the existing established distributed storage system is mostly general-purpose, and could not well perform the relatively centralized storage by region and by time, which cannot quite satisfy the practical requirement during investigation.In order to solve the puzzlements facing the application of public security access data, this paper designs the access data integration platform to meet the practical demands of public security bureaus and achieve the data support for various service systems of public security bureaus. This paper mainly studies the above research issue through the following three steps:First, this paper introduces the research background and significance of this research. Based on the analysis of the research status both home and abroad and the service demands of public security organs, a demand analysis is conducted of the access data integration platform.Besides, proceeding from the specific demands of public security bureaus, this paper conducts a general design of the access data integration platform and puts forward the storage system structure in line with the characteristics of the access data.Following that, a detailed design is conducted in terms of the data pre-processing, data writing, data search function and system feasibility according to the demand analysis of the access data integration platform functions.In terms of data acquis and data pre-processing, acquis data synchronously by pump, the access data is first analyzed and the dynamic cleaning plug-in technique and XML language are conducted to solve the isomerism of the access data in the bottom layer. In the whole process of data written into the storage system, this paper conducts a detailed design of the key technique data-cashing mechanism strategies, multidimensional data construction, multicast route mechanism, whole master control node mechanism. The adoption of cache strategies ensures the effective connection between the data collection and data writing and storage system. It adopts the combination of multi-dimensional data segmentation strategy and multicast routine mechanisms to achieve the data segmentation, writing, and searching functions in this paper. Through grouping the data by region or by time, adjacent data is relatively centralized stored. In addition, during the data searching, the platform can find the next multicast source in the inter-layer multicast source according to the fast segmentation of the multi-dimensional field, therefore enhances the inter-layer searching speed. Whole master control node mechanism can avoid the single point of failure. In terms of system feasibility, this paper mainly studies the storage node testing, online backup, off-line backup and data recovery.The study result is initially verified in the project, and the operation of the whole system passes the functional and performance tests. It can be seen from the test result that the system performs well in stability and load capacity. Meanwhile, it is found by the tests that the storage system of the bayonet networked data integration platform possesses a higher availability, an easier expandability, and a wider prospect.In general,by achieving the bayonet data integration platform as designed in this paper, various police classifications may be provided with a data pool with high availability, and the public security management and the fight against crimes may be technically supported.