A Design And Implementation Of Transfer System For Large-scale Remote Sensing Data

Remote sensing is one of the most important methods to obtain spatial information now. While the technology is advancing quickly, and the needs from different departments also increasing rapidly, the remote sensing system may have to deal with larger scale of data in shorter time. Grid computing technology is an effective means for resource sharing and problem solving. It can achieve cross-domain collaboration with computing resources and storage resources. The grid computing architecture can support large-scale data processing and transfer, and it is ideal for solving the problem the remote sensing system has incurred.In order to support large-scale transfer problem in the remote sensing system, we designed a transfer system called DartFTP based on the grid architecture. This article describes both the design and the implementation of this system, and we would talk about the key points in detail. Remote sensing data is often in large scale and with a special format, also the whole remote sensing system is constituted by several independent subsystems, which each often has its own workflow and specific way for data access. Our transfer system is well designed for these characteristics, and it also fully takes the way of interaction with original system into account. Based on this, our transfer system has the following features:multiple transmission protocol support, which provides a way to access different file servers in existing system; transferring with replicas, which means obtaining data from different replicas on different servers at the same time; QoS support, which means the system could provide a way to control the quality of service on different layers on the system.