Design And Implementation Of A Distributed Cloud Storage System

With the development of information technology,the amount of information generated by human society is increasing.How to meet the permanent storage requirements of large-capacity files of enterprises under the conditions of high efficiency,stability and security,and provide enterprises with convenient management methods and low-cost management solutions is an important issue facing the development of enterprises.Cloud storage based on a cloud computing platform integrates hardware and software resources such as physical storage,network equipment,and software services,providing a good solution for this.To this end,a distributed cloud storage system was designed and implemented.The system architecture is designed as three layers.The basic management layer is built on Ceph distributed storage technology,which effectively reduces the hardware cost of the storage cluster.It also has high availability and high scalability.The interface layer encapsulates storage services and cluster supervision services,reducing the coupling of implementation details within the system,and the access layer builds the entrance for users to use the system.When implementing the system,the system services will be split into cloud storage management system,cloud storage application system and interface layer services.These services and the database will be run on the Docker container respectively.As a lightweight virtualization technology,Docker reduces the cost and requirements of cloud application compared to virtual machine technology.The containerized service has good isolation and can easily migrate and expand user data according to business needs.As a result,create a cloud storage system that can be deployed and run everywhere.In addition,the system implements a unified interface layer to shield the underlying logic.The implementation of the interface adopts RESTful design specifications and optimizes the Spring MVC framework.It makes full use of the semantics of the HTTP protocol,realizes stateless interface calls,improves development efficiency,effectively guarantee visibility between subsystems and reduce interaction delay.After deploying a test environment and performing functional and non-functional tests on the system,the cloud storage system has basically reached its design goals.Operation and maintenance personnel can visually monitor and expand the storage cluster through the system.Compared with the single-node storage service,the Ceph storage backend can provide PB-level storage capacity.The layered architecture and optimized interface layer enable the main function of the application subsystem to reduce the response time by more than 30% when the total back-end storage capacity is 10 TiB and the access layer concurrency is greater than 300,supports providing large-capacity storage services with good experience for tens of thousands of employees in enterprises.