Font Size: a A A

Design And Implementation Of Ctrip's Distributed Cloud Storage System

Posted on:2019-06-30Degree:MasterType:Thesis
Country:ChinaCandidate:F XieFull Text:PDF
GTID:2438330566468666Subject:Software engineering
Abstract/Summary:PDF Full Text Request
Ctrip has been the largest online travel platform in China.A vast amount of file data such as images,video,audio and other formats have been updated every day.The amount of data has far exceeded the storage and processing capacity of an individual computer.Aiming to solve these problems,the paper proposes a solution of Ctrip distributed cloud storage system.Ctrip distributed cloud storage system is expanded on the basis of open source distributed file system.Despite that it enables the storage of massive files,it also requires the following innovations,namely file metadata management,image processing,multi-machine room deployment,and file synchronization.All these innovations are the major problems to be solved in the paper.To solve the problem of file metadata management,the paper first stores all file information in the system as metadata,so that the efficient management of the files stored in the system is achieved.What is more,the paper proposing the improvement of metadata indexing algorithm and the file name generation and parsing algorithm.The metadata query speed of the metadata indexing algorithm has been raised by nearly 5 times,while the file name generation and parsing algorithm has improved the security of metadata on the premise of meeting business requirements.In view of the image processing problem,the paper presents the image processing algorithm,which can effectively enhance the image processing performance and fulfill the performance requirements of system users for image processing.The most significant innovation point of the paper is the multi-machine room deployment and document synchronization framework.In the context of globalization,it is essential to establish machine rooms in major hotspot areas around the world.On the other hand,it can also ensure the reliability and security of the system,which is beyond the capability of plenty of distributed storage systems in the industry.As an independent product of the basic frame type,the Nephele system can be used and popularized in the technical department of the whole company.According to the commonality of technology,it can save a lot of development costs and provide a reliable basic technology platform,providing technical support to other business development departments related to the Nephele system,to provide the technical development efficiency of the whole company.
Keywords/Search Tags:distributed technology, cloud storage, metadata algorithm, multi room deployment, picture processing
PDF Full Text Request
Related items