Research And Application Of Cloud Storage Technology In Network Security Equipment Linkage System

With the rapid growth of data storage,the traditional database has been unable to meet the needs of people to deal with large-scale data. And it has been a hotspot for people to process and store massive amounts of data. The file system of Hadoop which is abbreviated as HDFS, has became a reference mode for cloud storage applications.However, the existing architecture of HDFS is insufficient for storing small files. And the default placement storage of replica will affect the performance of stoeage.So,this paper makes a deep study of the default replica placement strategy of HDFS and the storage of small files.This paper studies the background and significance of the subject,and analyzes the research status of cloud storage system and linkage system, and defines the necessity and practical significance of cloud storage for storing log files of linkage system in the network security devices. This paper is mainly to solve the following two questions:The first one is to improve the default replica placement strategy in the HDFS.By using the method of TOPSIS multi-attribute decision making,which is based on information entropy, it selects a node for a copy of the data blocks, and uses specific examples to validate the improved program. And the experiment shows that the improved program improved the overall performance of the system. The resolution for the second question is to optimize the storage solution for small files and design optimization program. The design of optimization program includes the pre-stored data node, the merging algorithm of small files, indexing structure of small files and the merging process of small files. The experiment shows that the storage optimization solution has improved the storage performance of the entire system when storing massive small files.In this paper,the improved program is applied to the network security equipment linkage system.and the cloud storage system based on the log of the network security equipment linkage system is designed and implemented.The paper reviews the architecture and design ideas of system, elaborates the design concept of each functional modules and functions, analyzes and evaluates operation results of the system.