Public Security System Information Storage Platforms Based On Hadoop

Nowadays, huge data, documents and video materials need to be stored in publicsecurity department due to the rapid informationization construction progress. Topurchase those expensive storage equipments and resources individually by eachsub-departments increases the construct and operation cost, while there is noconvenient way to share resources. Network is mandatory to implement datatransmission for the data resources share purpose, because those storage equipmentsare located in different places. But considering the security risk, network instabilityand the specificity of Public Security Department, it’s very critical to make thenetwork storage system to be with high performance, including safe access, stabledata connection and expandability of storage capacity. Hence one big challenge forPublic Security System is how to integrate existed storage equipments, and provideone cost-saving and reliable platform for Information Storage.Cloud Storage Technique comprises distributed file system, network transfers,application clusters, virtual storage and etc, which can combine variant distributedstorage equipments into one resource pool, and make it as one service system withone uniform interface. By using Cloud Storage, user can access the combination ofthose multiple storage equipments but not one specified storage equipment. It canintegrate the storage equipment and resource efficiently, improve the convenience ofusage, and share the resources. Hadoop is one of Cloud Storage Software Framework, which can distributely handle huge data and provide one reliable,efficient and flexible way to store data.This paper analyzes the resource storage status of Public Security Department,current situation of Cloud Storage and architecture of Hadhoop. Then the systemmechanism and features are studied, based on which, one information storage systemsolution is provided. The lower layer of the Information Storage System is HadoopDistributed File System.This file system put a large file split into a number of datablocks,these data blocks are stored in the data nodes.Since each block of data has anumber of copies of data blocks, so when the error occurred, the system willautomatically use a copy of data block to replace the current block.At the sametime,data error will be reported to the name node.This mechanism ensures theintegrity of the data in the system.Different from traditional information storage system,The users of the systemare scattered in different places, different departments,The user to upload dataresources are stored in the common and massive storage pool.When users need to findthe resources needed,they can be freely downloaded from the storage platform,eliminating the need for poor communication and data timeliness.The informationsystem is deployed in the Linux operating system-based machine on the cluster, thedefault operating management interface is a command line, if not a professional staff,it is difficult to master the operation.This system implements the storage layer withHadoop, and implements user interaction layer with Web technology. Hence onefriendly interface is provided to users to access system, by which operators canoperate one Cloud Storage based information storage system without knowing thetechnical details of lower layers.