The Design And Implementation Of Commodity Recommendation System Based On Hadoop And Mahout

With the arrival of the era of big data and the rapid development of e-commerce market,it's difficult for users to get information which meets their needs from explosive accumulation of commodity information,resulting "information overload".Now the company's trading website is facing such problems.Firstly,due to surge in commodity information,mass data makes users confused,only relying on search engines cannot meet users' needs.Secondly,the trading website have to give accurate feedback to tens of thousands of online users in a short period of time.The commodity recommendation system designed and implemented in this thesis is used to collect the users' information and purchase behaviors,and to recommend some suitable products to users.Users do not need to spend lots of time to find out the right products in mass data.In order to solve the problem of timely feedback,the system is developed on Hadoop distributed platform.The system uses the MVC design pattern,with the Spring+Struts2+Hibernate framework to improve its scalability and to make the bussines layer and logic layer seperated.And jQuery framework,Bootstrap framework are used to design and develop the web pages.The data storage part adopts the method of combining MySQL database and HDFS distributed file system.According to the characteristics of the company's user data set,the system uses recommendation algorithms of Apache Mahout to calculate results with MapReduce programming model.According to the specifications,the system can be divided into six modules.The recommendation service module is the core module of the system.It provides products users may be interested in based on users's preferences and behevior,calculated on Hadoop.Evaluation service module help the manager find out the suitable algorithm matching the dataset.And user management module,commodity management module,and scheduling management module are used to manege users,commodity and scheduling.Storage management module provides basic data storage.