Design And Implementation Of Distributed Storage System Based On Optical Library

The massive data generated by the continuous development of Internet technology has challenged the traditional storage solutions,and its small amount of hot data and large amounts of cold data characteristics have led to various solutions for cold data storage.Optical technology storage library.However,due to the limited capacity of the single optical disc library,it is difficult to carry mass data storage applications.Therefore,a distributed storage system based on optical disc library is proposed,which can continuously add storage nodes to automatically expand the capacity and make up for the shortcomings of the single machine.In order to achieve the requirement of keeping the locality of the relevant file storage space,a method of judging the relevance based on the file path is first proposed,and then it is assigned to the appropriate node.This method makes the relevant files be placed in the nearest node to the maximum extent.This method is used as a distributed hash hash algorithm,which is responsible for distributing files to nodes.Later,in order to adapt to the problem of dynamic expansion of storage nodes,the node set is divided into two types: readable and writable,using a readable set when reading files,and a writable set when writing files.At the same time,when a new node is added,the address pointer is used to replace the actual file migration,adapting to the feature that the disc storage cannot delete data.Finally,in order to reduce the impact of data reconstruction on file access when new nodes are added,a history set is added to enable the system to perform normal file read and write operations when adding nodes.Experimental results show that the system can ensure that the files with correlation can be distributed to the same node,and the distribution is relatively balanced,so it is not easy for a large number of files to gather on a few specific nodes.In the read and write process,the time taken to locate the file location is only within 100 ms,and will not become a bottleneck of the system.