The Design Of The Cloud Computing System Based On Hadoop

The development of computer technology and Internet technology changes our lifestyle. Various types of electronic information products make our life more convenient, but they also make people to face the problem of the massive-data-processing. The traditional data processing modes are not suitable for massive-data-processing; massive-data-processing is increasingly dependent on the big data processing platform.Among many kinds of big data processing platforms, Hadoop is the most popular one because of its high efficiency and low-cost. But the hardware costs of Hadoop cluster and the high training costs of Hadoop Professionals limit the promotion of Hadoop.This paper designed a cloud computing system based on Hadoop. Firstly, the paper introduced the cloud computing, compared to the traditional computing method, the cloud computing is more suitable for massive-data-processing. Then, the paper studied the Hadoop platform, including its file system HDFS, its programming model MapReduce and its resource management framework YARN. And then, the paper designed the cloud computing system based on the Hadoop platform. The system will publish the Hadoop cluster in the cloud for users. When users use the cloud computing system, they do not need to deploy a cluster and do not need to develop the complex code. Users only need pay a fee to the Hadoop provider. For users, the cloud computing system help them solve the massive-data-processing problem with the lower costs, less work. Finally, the paper tested the features of the cloud computing system in order to verify its availability.