Design And Realize Of Cloud File Synchronization System Based On Rsync

The remote file synchronization technology can keep consistency of files betweenremote hosts, which is widely used to realize remote file backup or remote update. Afterdecades of research, this technology has made great progress. Currently there are somefile synchronization software which provide good performance for remote filesynchronization on reduce the network traffic, but they can not monitor events about fileupdate or changes in real-time, which makes file synchronization require manualinterventions or use scheduled tasks to get initiated, and the real-time performance isnot good. In addition, based on the actual application environment we can increaseefficiency of the file synchronization algorithm by changing the algorithmic flow.In this paper we followed actual file synchronization demands of the cloudplatform, analyzed and compared current remote file synchronization algorithms andseveral mechanisms about file chunking, with the purpose of reduce the amount ofnetwork traffic generated by file synchronization. Because of files involved in thesynchronization process are very decentralized and the amount is large, we decide tointroduce file monitoring mechanism and central control node to simplify theoperational processes. Based on the advantages and disadvantages of each technologyand practical application requires, we design a file synchronization system usingmodified rsync which will use special file synchronization process when synchronizingspecific type of files in the cloud platform, and using an user space file system developwith FUSE which can monitor file change in real-time in order to realize automate andreal-time file synchronization.In the beginning of the paper we introduced the research background, clearedobjectives and contents of the study, and talked about the research status of filesynchronization and file monitoring mechanism in Linux. Then made a thorough studyof technologies used in the system, which include the rsync algorithm and the FUSEmechanism. Finally, we give detailed description about design and realization of the filesynchronization system used in the cloud platform. The remote file synchronizationsystem consists of three major components: the server module, the client module and the user management module. The server module is linked to two other modules of theproject like a router. It is responsible for parsing target file information of the real-timefile synchronization, initiating the static file synchronization, maintaining the log fileand recording the synchronization exception. The client module realized the mostimportant functions of the system, including the file modification monitoring functionand the file synchronization function. In addition, it is also responsible for handlinginstructions send by the server module and collecting execution results of filesynchronization. The user management module bases on B/S structure and provides amanagement interface for users, it is responsible for the input of file synchronizationdemand and the selection of synchronization mode. The user management module notonly modifies data in the database, but also commands the server module to respond touser operations timely.The design of file synchronization system based on the the rsync algorithm in thispaper met the need of file synchronization for certain types of file in the cloudenvironment, and achieved the intended purpose.