Research And Implementation Of The Data Compression Algorithm For Wide Area Network

With the growing amount of data, the storage space that the data occupied has become increasingly bigger. It also brings a great challenge to the system storage capacity of many enterprises. In addition, the cost of the preservation of data, backup, recovery is also more bigger. As the number of data increases, the imbalance proportion of the growth of data and bandwidth causes pressure on WAN's data compression, the technique of it needs to be improved, and data de-duplication technology comes into being.This paper describes the detail of data compression, and then points out the basic principles and the premise of data compression. we obtain the main difference between two algorithms by the introduction of lossy and lossless compression. Through analysis of several algorithms of lossless compression, and their use occasions, and then describing the process of the algorithm and the ration of it, as well as the detailed description of the advantages and the disadvantages of several algorithms. This algorithm proposed to use four bytes to replace the repeated data block, according to the last 10 bit of fingerprint value, if the value is 0, then this is the cutoff point. On this basis, the paper achieves WAN data compression algorithm. The testing results show that the algorithm is effective and feasible on the identification of duplicate data and removement of small amounts of data.This paper achieved the data compression algorithm based on WAN, which is a high-performance algorithm. The algorithm provided favorable conditions for high-speed transmission of data in the case of insufficient bandwidth. It is meaningful and practical significance for improving the efficiency of data transmission.