Design And Implement Of Data Compression Algorithm In Real-time Database

The real-time database technology includes two aspects: one is the real-time system and the other is database technology.Database saves a large number of real-time data generated by industry process,and forms the real time database.At present,no matter in the field of industrial production or in the Internet of things platform construction,real time database paid high attention because of high real-time and high throughput.However,because of real-time systems often produce a large number of data in a short period of time;the amount of data in real-time database to save is very great,make great difficulties for data storage,transmission,application.In order to solve this problem,the data process data compression technique is introduced into the real-time database,the purpose is to increase the capacity of database,and ensure the efficient use of data.1 In view of the problem that traditional loss data compression algorithm cannot be applied to the high accuracy real-time database,put forward the solutions that different types of data with different data compression algorithm,realized the high precision data compression,solve the contradiction between accuracy and database data storage capacity,has obtained good effect in the actual application process.2 Through the analysis of a large amount of historical data,the data in real-time databases are classified into three types,respectively is the numerical data,time data and code data,according to the time data and code data,because of its redundancy is very high,so using RLE algorithm to compress them,can achieve good effect,and for numerical data,which is divided into Boolean type data,percentage type data,and floating-point type data,for Boolean using bitwise storage way,for the percentage of type data using the LZW algorithm and LZ78 algorithm combined way,improves the compression efficiency,using the improved LZW algorithm for floating-point data processing,through the data preprocessing and setting model methods,to solve the problem of low compression rate of floating-point data.3 Make the application of data compression technology in real-time database as the center,for the purpose to achieve real-time lossless data compression,first,make discussed to the real-time database technology and data compression technology,and then analysis of the data compression algorithm process and principle which current popular used,discussing its advantages and disadvantages and the application scope,and then to make the existing data compression algorithm as foundation,through the classification and analysis of historical and real-time data,the design scheme that applied to real-time data compression algorithm are discussed in detail,finally realizes the compression algorithm by programming languages,and verified by testing the advantage that this algorithms compared to other compression algorithms in the compression ratio and time.The application of real-time database technology in the industrial field more and more widely,at present,it is hotspot for mining large data research,so it has realistic significance to research and application of data compression technology in real-time database,at the same time,improved to universal data compression algorithm according to the different characteristics of real-time data,has a theoretical research value certain.