Design And Implementation Of The WEB Proxy For Mass Storage System

With the development of network technology, the rapid growth of data and bandwidth in the Internet has brought new challenges to us. The storage system architecture evolve from DAS,SAN,NAS in the early days to object storage system today. The development of mass storage in the scalability, security, performance is meeting the demand for users. However, the traditional mass storage system still face difficulties in management, the complex of monitoring, the high operating costs and other issues for traditional users.As a new technology concept, the cloud storage is changing the use of traditional storage with broader implications. Cloud storage is not a technology but a change of business model. It provide users with the mass storage system in the form of a storage pool through virtualization technology, and block all the details to provide on-demand services.We can build a simple cloud-storage prototype system by design an access interface to provide transparent access to the mass storage system.In this paper, we designed and implemented a Web-based proxy server on distributed storage systems . The system is designed and developed by my own research group, it is based on an object-based large-scale distributed file system called BlueOcean. We design and develop the proxy server to provide web access to the BlueOcean. To improve system performance and practicality, we made a lot of optimization work, including: the use of a REST-style HTTP protocol as a cloud storage access interface protocol, making our system more compact and efficient; the use of an appropriate concurrent server programming model, providing not only high concurrent access, but also to achieve the isolation of data between different users; the use of memory segments and memory set management mechanism in order to reduce network data transfer when the memory copying, improving overall system performance; the use of the memory pool mechanisms to be responsible for allocating and freeing the memory; the use of buddy algorithm in order to reduce memory fragmentation and improve memory utilization and improve efficiency.Tests show that the design and implementation of this web proxy server can provide users with transparent access from web interface and efficient access to the back-end distributed system BlueOcean, having a high value of promotion .