Large Area Array Combined Video Real-Time Stitching

With the development of science and technology,remote sensing technology has also developed rapidly.The video satellites including America's Skysat-1 and China's Jilin No.1 have opened up a new mode of satellite video remote sensing.With the development and application of video remote sensing,the large-area video sensors will inevitably become a main new type sensor in the field of remote sensing.The development of light-small large area array video sensors can be widely used in small aviation platforms such as unmanned aerial vehicles,unmanned airships,and mooring boats which can achieve dynamic remote sensing data acquisition in large-scale and highphase phases,especially for “stare” observations at specific targets.For instance,change detection of pollution source expansion,change detection of ice sheet ablation,dynamic integrated management of urban system,and dynamic monitoring disaster emergency and real-time evaluation,etc.,which are the basic experimental equipment for the acquisition of video remote sensing data,and the supplemental and ground verified device of spaceborne satellite video sensor.The main contents of this research include:1.Developed a small large area array and video sensor combination system.By the combination of four 5K×4K video cameras,the system realizes synchronous acquisition,storage and real-time seamless browsing display of 4-channel videos at 30 frames per second.The synchronous accuracy of 4-channel videos is greater than 1/44781 seconds,and the amount of data is up to 8T per hour.2.The single-camera and multi-camera calibrations are performed on the combined video camera through the calibration field of the 3D camera.The seamless stitching of the 4-channel video is realized according to the calibration relational model.The stitching video format is 10240×7168 pixels,and the field of view is 85/65°.3.The real-time browsing of large data volume video is realized by combining the method of thumbnail stitching and local clipping window stitching.The relations between thumbnail images and images in the local clipping window are calculated according to the calibration relations,and the seamless stitching browsing of 4-channel 720 P video images at 20 frames per second is realized with the help of GPU.Finally,the operation of the system verifies that the large area video sensor system can capture 5K×4K video for more than two hours at 30 frames per second,and realize seamless mosaic browsing of four 720 p video images at 20 frames per second.