Research On High Speed Data Transfer In WAN Storage

The development of Internet technology and network application caused the explosive growth of digital information and created a huge demand for vast storage. The research on network storage system is becoming a booming point in IT industry. The next generation of Internet put forward the new requirement of network storage which is massive in node and capacity, with high service quality, high reliability, convenient usability and excellent performance.The Intelligent Storage Service system USTOR, which makes the best use of the storage virtualization technique and intelligent storage management, by realizing the unified management of the storage resources distributed in wide area network, provides a logical view and reduces the management cost of the system.The data transfer system is an important module in USTOR, which infects the performance of USTOR greatly. In order to guarantee the high-performance and high-availability, it adopts several techniques, such as FTP, transfer middleware, mobile cache, three-side authentication, security transfer, data link multiplex, and so on. Based on FTP, transfer middleware realizes the file transfer efficiently. FTP and middleware which based on TCP application create an independent data connection for each file transmission, when the request is batches of small files, the establishment and release of data connection waste massive time, so the utilization ratio of network and server is very low. USTOR which design and realize data link multiplex can transfers batches of small files by only one data link. Compared with FTP and transfer middleware, it reduced the connection time and enhanced the transmission performance.The testing results of the storage system platform built in the lab shows that the client based on data link multiplex has some advantage over traditional transfer protocol FTP when transferring batches of small files and has achieved the anticipated effect.