Research Of Inland Waterway Intelligent Surveillance System Based On Computer Vision

Waterborne Intelligent Transportation System(WITS) is an inevitable trend in inland river shipping in the future. It has an important significance to raise transportation efficiency and protect transportation safety. The development of Computer vision technology provides new solution for WITS: use vision sensor to get video flow with wide range and enormous information, then use dynamic image understanding technology to analyze the video flow, could get the real time circumstance information of the traffic.In this paper, we use multi-sensor information fusion technology to get the information of traffic flow in inland waterway, do research on the wide-angle Camera device of nearby waterway and faraway waterway, use wide-angle Camera device to deal with monitoring the inland waterway, and use multi-target tracking algorithm to track the ships in the waterway in real time. And then we capture the license plates and the hull of the tracked ships with the help of the high Speed Dome Camera according to the mapping relation customized previously. The captured ship images are recognized to determine license plate number and the height of shipboard which is higher than the horizontal plane. Then use the license plate number to retrieve the basic data from database. At last, we use the basic data and the draught of the ship to compute the real loading tonnage of the ship.In this paper, we mainly discuss the key techniques such as digital image processing, pattern recognition and computer vision for WITS. The specific study on WITS is discussed from three levels: low level vision, middle level vision and high level vision. The chief work in low level vision is ship detection and segmenting, including techniques of image preprocessing, background modeling and updating, moving object detection and connected region labeling, the chief work in middle level vision includes multi-target tracking algorithm and traffic flow parameters detection, and the chief work in high level vision includes computation of the real loading tonnage of the ship and abnormal behavior detection.This paper develops a inland waterway intelligent Surveillance system based on the Java language and introduces the steps of modules in detail and experiments in different environment. The results showed that the system has strong real-time, high accuracy and fairly good robustness.