Research And Implementation Of Data Stream Management System Based On Synopsis

Many applications need to deal with and analyze the data stream, such as Deep Sea Platform Monitor System and Internet Flux Monitor System. Data Stream arrives in the form of flow, which is continuous, unbounded. Traditional data manage technology can not query and manage data stream, existed Data Stream Management System can deal with the data and support continuous query, but they only finish primary system and can not provide service to factual commercial system. This article studies data stream management technology on sensor networks under the Deep Sea Platform Monitor System background.This paper summarizes and analyzes several sampling methods of building synopsis data, and provides an adaptive weighted random sampling algorithm based on time sliding window: AWRS/BTSW algorithm.A weight is assigned to data item dynamically according to the change of data stream, and a key is assigned for each data item by compromising its weight and arrival time, then sample with the key. This algorithm solves the problems of uncertain deviation between the original data and the sample data and the expiration of data. Finally, this algorithm is applied to Deep Sea Platform Monitoring System. Compared with other sampling algorithms, this method can produce synopsis data quickly when the data is stable, and change the sampling method dynamically when the data changes rapidly to decrease relative errors.This paper analyzes and summarizes Data Stream Management System domestically and abroad. It also designs and achieves Data Stream Management System based on synopsis, and applies AWRS/BTSW algorithm to this system. Moreover, this paper expands continuous query language, and designs a new language called expand continuous query language (ECQL), which can support continuous query and history data query. This system can provide basic data service for Deep Sea Platform Monitoring System.This research not only solves data stream management problem in Deep Sea Platform Monitoring System, but it can apply to any sensor networks, which provides a basic data platform for data mining and data analysis.