Design And Implementation Of Lossless Compression Encoding For High-speed Data Acquisition And Storage

High-speed data acquisition and real-time storage technology is widely used in scientific research,industrial measurement,and military electronic information system.In the applications of radar signal acquisition and processing and high speed communication,it has a great demand on the bandwidth and capacity of high-speed data acquisition and storage system.With the development of large scale integrated circuit technology,the acquisition speed of the ADC is higher and higher,and high requirements for the back-end data storage system are proposed.Traditional storage methods and storage media cannot meet the requirements of high-speed mass storage.If it is able to carry out the real time lossless compression of the collected data,in this case,it can be possible to effectively reduce the amount of the data stored,making high-speed data stream can be real-time stored down,which is convenient for researchers' further analysis and processing.Based on a common compression algorithm and considering the application of high speed data acquisition and storage,the thesis improves the compression algorithm on the basis of LZW algorithm,the major improvement is to facilitate fast access to dictionary module.In terms of dictionary structure,the Hash function is used for fast access to the dictionary module,and largest time-consuming dictionary child module has been improved,the advantage of the hardware implementation is that it can be used to speed up the algorithm and achieve the purpose of real time compression of high speed data stream.Subsequently,based on the Verilog hardware description language,the thesis implement and optimize the compression algorithm,and use Xilinx Kintex7 FPGA to simulate,verify and test the algorithm.The measuring results of algorithm show that this algorithm realize the data throughput of 275.4 Mbps,and the compression ratio is from 20% to 50%,under 33 MHZ frequency system.So it is proved that this data compression method is practical and effective.Finally,the thesis summarizes the problems,and puts forward some shortcomings of the algorithm,and makes clear the direction of further research.