Research And Design Of Recommendation System Based On RHadoop Cloud Platform

In recently years, because of the rapid development of the Internet technology and scale,there are huge amounts of data that has created the problem of information overload. Facing with the problem of information overload, the emergence of the recommendation system provides a good solution to solve the problem,through the recommendation system, not only can users find the demand of information, but also the information that meet the demand of users can be timely and accurately pushed to the users who are interested. However, with the era of big data, the traditional recommendation system is too tight when in the face of the storage and processing of big data as well as increasing demand for personalized service.In this paper, for the problem of storage and processing of big data, and according to the widely use of Hadoop that is a distributed cloud computing technology as well as the R language that dedicated to data mining and analysis, there is an idea that make the existing recommendation system distributed and parallel. Through researching for Apache Hadoop and R language, and according to the characteristics of providing dynamic storage space of HDFS and providing distributed and parallel computing of MapReduce, and the characteristics of providing data analysis of R language, building a RHadoop cloud computing platform that combining the Hadoop with the R language. On the basis of the content above we will research and design a recommendation system based on RHadoop cloud platform, the implementation of recommendation system on the RHadoop cloud computing platform not only can we improve the storage and processing ability of the mass data, but also can meet the more and more personalized service demand of users, its fully embodies the advantage of combination of cloud computing and recommendation system, thus there is a solution be proposed that solves the defects of the existing recommendation system. This article is mainly to research and design a recommendation system based on RHadoop cloud computing platform, the main contents are as follows: Firstly, through researching the characteristics of Hadoop and its included components as well as the function of R language, on this basis, according to the characteristics of both, we will build a RHadoop cloud computing platform that combining the Hadoop with the R language;Secondly, based on researching of the distributed and parallel programming principle of MapReduce and recommendation system, not only will we design and implement the typical collaborative filtering algorithm on the RHadoop platform, so as to improve the efficiency of the algorithm, but also through the study of reinforcement learning and reinforcement learning algorithm, research and design reinforcement learning algorithm on the RHadoop cloudcomputing platform, so as to improve the performance of the recommendation system. Finally,through the study of the demand analysis and the basic structure and the component module of recommendation system, as well as combing the characteristics of the RHadoop cloud computing platform, we will implement the recommendation system on RHadoop platform.