Font Size: a A A

Research On Weighting Caching Algorithm And Caching Search Optimization Of Meteorological Data WEB

Posted on:2018-02-07Degree:MasterType:Thesis
Country:ChinaCandidate:Y HaoFull Text:PDF
GTID:2310330518498076Subject:Software engineering
Abstract/Summary:PDF Full Text Request
With the rapid development of the Internet technology,uploading and downloading in network transmission has become the main way of data transmission,at the same time, with the continuous improvement of information science and technology, the amount of data in various fields is growing exponentially. The increase of the amount of data brings great challenge to the network bandwidth and storage server. For the meteorological data, the meteorological stations collect,analyze, update and store the data every day. The upper and lower meteorological stations would upload, cache and download data. The level meteorological station would transfer data each other. Because the limited of current network bandwidth performance technology and storage server capacity, access latency between stations is relatively large and increase the storage costs, lower query efficiency, low effective use of network can lead to network congestion and poor rate.Therefore,in order to solve the above problems, this paper proposes a new web cache replacement strategy and describes its cache framework; and propose a method of creating index and caching index for original data. The main innovation point of this paper are as follows. First,we propose a new cache replacement strategy to enhancing the effectiveness of caching data by analyzing and sorting their stored properties. Second, we build indexes for datasets in order to improve the cache query efficiency and both hit rate (HR) and byte hit rate (BHR). Then the network performance was improved.The specific work content of this paper is as follows.(1) To cache replacement algorithm, design a new framework and a simulation tool CacheSim. In the tool we sort out and implement the classic and latest cache replacement algorithm,and use hash data placement algorithm(MeteHash) to placing the data. Full use of the storage space of each node in the distributed system and achieve load balancing. And provide a platform for our experiment.(2) To the deficiency of Weighting and Ranking caching replacement algorithm,proposed a web caching replacement algorithm WSCRP based on weighting and cost. On the basis of weight, consider the cache object's size on cache performance and cost on cache performance and the effects of different sizes of cache space on cache performance are analyzed. It can be seen that the WSCRP has great advantages in the same environment, and improves the performance of the system to a certain extent.(3) To cache query optimization, designed a data query and cache policy based on index, in distribute system create a new database table to storage then make a study of query index and query server data. This paper studied the index query based on distribute system and contrast with the original policy. Experimental results show that the proposed scheme has a great advantage in reducing the access time and improving the hit rate.
Keywords/Search Tags:Meteorological data, weight, cache framework, web cache replacement algorithm, index
PDF Full Text Request
Related items