Font Size: a A A

An Application-aware Storage System For Astronomical Observation Data On Dome A

Posted on:2019-07-08Degree:MasterType:Thesis
Country:ChinaCandidate:J M WangFull Text:PDF
GTID:2428330593451025Subject:Computer Science and Technology
Abstract/Summary:PDF Full Text Request
In recent years,with the rapid development of information technology and the emergence of the internet plus,various research areas of information and related data showed an unprecedented explosive growth model.As a result,the urgent need for large-scale data storage led to that the energy consumption of the storage system also showed a rapid growth trend,and more and more researchers began to focus on energysaving storage research topics.After a lot of related research,domestic and foreign scholars put forward a variety of energy-saving strategies and technologies,including the design of the architecture and software strategy research.However,most of the research is only put forward the theoretical model,not applied in the real scene,so they can't be directly used in many cases.In particular,the paper is based on the application of Antarctic astronomical observations,where the environment is special and complex,the traditional energy-saving storage model can't meet the unique limitations of the Antarctic astronomical observation system.Therefore,it is very important to design a set of energy-efficient storage systems specifically designed for Antarctic astronomical observations.Through the study of existing energy-saving technologies,disk energy-saving technology is divided into the following categories: disk power management(DPM),memory-based energy-saving technology,disk-based energy-saving technology,load integration technology,data migration technology and data Redundant technology and so on.This paper designs a new energy-saving storage system for Antarctic astronomical observation,combining with the existing energy-saving technologies and taking into account the particularity of Antarctic astronomical observation environment and the temporal and spatial nature of astronomical observations.According to the time domain feature and spatial domain feature of astronomical data request,this paper designs an application-aware and energy-saving storage system called MCS-AA based on multi-level caching strategy.MCS-AA divides the disk into a data disk group and a cache disk group.The related data is pre-fetched to the cache disk by analyzing the correlation between the request data.At the same time,according to the idle time interval sequence of the access request,this paper puts forward the application-aware disk power management strategy,so that the disk can adaptively adjust the timeout threshold in the dynamic workload environment and minimize the energy consumption.In order to fully verify the energy saving effect of the application-aware and energy-saving storage system,MCS-AA performs a large number of simulation experiments under different workloads respectively.At the same time,a variety of experimental comparison and analysis are conducted between MCS-AA and the traditional energy-saving storage system.The experimental results show that the energy consumption of MCS-AA is reduced by 11.06%~12.82%,23.84%~26.67% compared with the traditional energy-saving technology,and the average response time is reduced by 9.82%~37.93%,14.04%~40.74% respectively.
Keywords/Search Tags:Application-Aware, Big Data, Disk Array, Energy Saving, Storage System
PDF Full Text Request
Related items