Research And Implementation Of Key Technology In Content Aware Storage

With the continuous improvement of information technology, the data become more and more important to enterprises, in which storage technology plays an important role. However, developments in network technology and the rapid growth in volume of data need new storage technique to meet the existing network and the storage environment. A new object-based storage network architecture, which takes advantage of SAN and NAS, comes into focus of both the academe and the industrial community. Content aware storage (CAS) is a typical example of object-based storage, in addition to object-based advantage, which can make data compression and keep data integrity.This paper researches on the key technology in CAS , which includes the method of creation of object and ObjectID, the management of metadata, the management of storage space, the data compression technique and the write-only read-many (WORM) technique. Then we complete the system design of content aware storage network (CASN), and present a new security model and protocol. We also design and implement a new content aware storage device (CASD), which uses cryptographic hashing techniques to identify data by its content rather than its name. This method can provide "WORM" function, which can avoid destroying data accidentally or on purpose. It can remove repeat data, save storage space and network bandwidth. These characteristics make CASD have a broad prospect. The paper introduces the main application perspective of the content aware storage, and brings forward an application of the content-based storage in the distributed file system.Based on CASD, we build CASN prototype system. In order to make contrast test, we have built Intel OSDN system, NFS and iSCSI network storage system, and compared the performance between the CASN system and others respectively. The results make clear that the CASN system is superiority to the other network storage system.