Font Size: a A A

Research On Interactive Aggregate Query Method Of Multidimension Time Series Data

Posted on:2021-03-05Degree:MasterType:Thesis
Country:ChinaCandidate:J ShengFull Text:PDF
GTID:2428330611980614Subject:Computer technology
Abstract/Summary:PDF Full Text Request
At present,with the continuous development of the Internet of Things,multidimensional time series data is continuously generated.In order to improve query efficiency,optimize user query experience,realizing interactive aggregate query has become an urgent need to be solved.The traditional multidimensional time series data aggregation query work needs to wait for the execution of the query task,and there is a delay in obtaining the aggregate query results.In order to solve this problem,this paper proposes an interactive aggregation query method for multidimensional time series data.The main research contents are as follows:1.Aiming at the problem of the lag of massive multidimensional time series data aggregation query results,with the goal of realizing interactive aggregate query,an interactive aggregation query method for multidimensional time series data is proposed.This method takes into account the optimization of storage structure and query calculation,and designs a reasonable storage structure and an index structure to achieve the effect of interactive aggregation query.2.Aiming at the problem that the multidimensional time series data aggregation query disk IO overhead caused by the high dimensional characteristics of time series data,a query optimization method based on bitmap index is proposed.The techniques of index construction and compression in this index optimization method are introduced in detail,and the query based on bitmap index is designed.Experiments show that the speed of multidimensional time series data aggregation query is improved by bitmap index technology.3.For the problem of fast memory calculation but limited capacity,a query acceleration method based on memory tuning is proposed,including an optimal pre-aggregation task selection algorithm and an optimized memory replacement strategy.The optimal pre-aggregation task selection algorithm selects as many pre-aggregation tasks as possible to be placed in memory.The memory replacement strategy replaces hot data into memory and prevents data that is predicted to be coldfrom entering memory,improves memory hit ratio.Experiments show that this method can help to realize interactive aggregation query of multi-dimensional time series data.4.Based on the above research,a multidimensional time series data interactive aggregation query prototype system is realized.The experiment proves that the system can improve the efficiency of aggregate query of multidimensional time series data and achieve the effect of interactive aggregate query.
Keywords/Search Tags:multidimensional time series data, interactive aggregation query, lambda architecture, pre-aggregation
PDF Full Text Request
Related items