Agricultural E-commerce Based On Hadoop Data Platform To Build Key Technology Research

Current agricultural e-commerce business development rapidly, the user in the agricultural e-commerce site, the traffic data is becoming more and more along with these traffic generated a lot of user data.These data are distributed in different host and different terminals, how reliable collection, store the data, do data support for electronic commerce, as a lot of agricultural e-commerce in order to solve the problem.The rapid progress of big data technology, we can collect, store, different formats and different business in the field of huge amounts of data into a unified data platform, produce a great value.Current Hadoop has become a standard of building data platform technology, this article introduces the basic principle of Hadoop related technologies are studied in this paper, combined with agricultural e-commerce B2C industry research how to deploy Hadoop data platform, how to use Hadoop related technologies for data collection and storage, by the paper can make the agricultural industry personnel to quickly understand the Hadoop related technical, understand the Hadoop related technology application, quick construction based on Hadoop cluster environment, building agricultural e-commerce data platform based on Hadoop.In this paper, the main research Gui content and innovation points are as follows:1. Aiming at the existing problem of agricultural e-commerce platform for the data of related research, this paper proposes a distributed data for mass data processing business to adopt sets, storage platform.Can solve nowadays many kinds of agricultural e-commerce platform in the face of the collection and data storage business problems.2. Considering the hadoop platform construction process more has the certain difficulty, this paper introduces in detail the hadoop data platform construction process, for agricultural e-commerce implementation hadoop platform for your reference, also through the deployment process to further understanding of the hadoop platform.3, in accordance with the technical features of the agricultural e-commerce data collection and difficulties are analyzed in detail, including distributed, high dynamic, collection terminal diversity, and so on, according to the data collection difficulty, the introduction of the flume, sqoop data collection tool, to ensure the reliability of data collection.4, for agricultural e-commerce site, increasing the offline and online data storage problems, the introduction of HDFS distributed file systems, and hbase non-relational database, solve for agricultural e-commerce multi-type, much business data storage capacity of disaster, the redundant backup and so on.