Design And Implementation Of Kingsoft International Security Cloud Distributed Storage System

With the development of the Internet, there are more and more securityproblems emerged. With countless new viruses and trojans, traditional anti-virus software which is based on a feature library engine become exhaustedto handle. Although the features in the feature library is growing, the updatefrequency is never able to catch up with the speed of new viruses and trojans.And one of the issue on traditional anti-virus software is that it takes moreand more system resources to scan and kill virus, which eventually makes italmost impossible for users to use their computers. Therefore, the need makesecurity software able to quickly respond to new viruses and trojans, and atthe same time only consume a small part of computing resources isbecoming more and more urgent, and the cloud based anti-virus services iscame up to meet this requirement. Cloud based anti-virus service needsuser’s computer to connect to the internet, so the local data pattern files areable to be uploaded to the cloud anti-virus server for verification, and theverification results will be returned to the user in a few seconds. As long asthere is a connection to the internet, user can use real-time cloud anti-virusservice, and the latest virus database is always use. This service onlyconsumes a few network bandwidth, and the local computing resourceconsumption is almost ignorable.Cloud anti-virus service has lots of differences with traditional featurelibrary based anti-virus software, the most important different is that thecloud anti-virus service is able to store large amounts of small files, andwrite files to a storage system with high efficiency, scalability andavailability. In this paper, the design of Kingsoft cloud anti-virus storagesystem is presented, and this design is based on the following works:We investigate the use cases and application environment of cloud basedanti-virus service, and also the current widely used distributed storagesystems in the world. Besides the survey and investigation, lots of lessonsare also learned from the design of other system architecture, and with the deep thinking on the unique user scenario and working environment ofKingsoft cloud based anti-virus service, we came up with the design of thisarchitecture. This design takes into the requirement on system’s scalabilityand reusability, and using the J2EE component-based ideas to achievethe loose coupling characteristics.Compared with the traditional storage systems which is based on a SQLdatabase to store data, our new design uses a distributed database to storefiles, this will make our system able to meet the required mass storagescalability. And the replication mechanism in distributed database systemwill ensure the data availability and fault tolerance. In the meanwhile, thedesign uses the Thrift framework which makes the system able to beaccessed in different languages on different platforms easily.