The Design And Implementation Of A HD Video Surveillance-oriented Stream Storage System

With the development of intelligent transportation technology, high-definition data storage and processing of massive amounts of video surveillance have become key issues. Given the way that thousands of high-bit-rate video streaming concurrently writes, disk I/O throughput is becoming a bottleneck. This then leads to serious energy consumption and disk abrasion.In order to solve these problems, considering the current research status and development trend of mass data storage in domestic and foreign, after analysising the characteristics of video surveillance data storage system architecture and integration of existing storage resource scheduling, this paper designs and implements a massive high-definition streaming video surveillance storage system SSTORE. And fully explained its internal distributed file system SFS which designed specifically for surveillance video stream data. The main innovation work are presented as the following:1. Design the Continuous Storage Model(CSM) on disk partition, which is an optimized data storage model, in order to adapt to surveillance video data storage’s sustained, stable, and p eriodicity characteristics.2. The system use asynchronous event-driven mechanism Epoll to deal with network IO requests which improves the efficiency of the network IO. It also designs a thread pool to deal with task schedule that asynchronous disk IO operations and network IO. These improve the efficiency of system concurrent processing capability.3. Design and implement a disk partition offline copy and scheduling mechanism based on CSM partition. It can increase the percentage of dormant disks which prolong the disk life and reduce energy costs of the system..4. Design a flexible data redundant mechanism by using the different IO speed of disk partitions. These data replication on different partition have different retention periods and this mechanism takes full advantage of the performance of the disk partition, while ensuring a reliable and available data.Through the performance testing and pressure testing and compared with other common surveillance video storage systems, the results show that SSTORE has a large advantage in the storage service performance to meet the storage needs of massive high-definition surveillance video streaming data.