Design And Implementation Of Taobao Commodity Competitive Analysis System Based On Data Mining

With the popularity of Internet technology, the emerging pattern of Commodity E-commerce transaction has injected vitality, reduces the amount of human material and financial resources, due to network characteristics, customer at the time of purchase of goods can not see the kind, so easy on the e-commerce model into question, in this regard the need for restraint policies and regulations, but also on a variety of goods followed a careful comparison and weighed. In addition, businesses also need to be analyzed for the sale of goods, to understand the strengths and commodity price trends in the industry, and make decisions based on analysis results. And because Taobao commodity variety, a huge amount, so the goods access to information is particularly important for this paper is to collect Taobao commodity information via Web crawler method, and then the commodity information for analysis, in order to meet buyers and sellers to different needs.This system is mainly on Taobao Mall online selling goods Lynx timing information to crawl, to ensure the authenticity and validity of the data acquired by product category, product label category, product category, commodity brands, product information, comments, information and shop extracting information, after extracting the data to be processed is then stored in the database for data analysis. Thematic approach adopted reptiles Lynx Taobao Mall to sell goods to crawl, it is a good analysis of pages of information to facilitate the positioning URL link, to reduce the number of extraction efficiency of extracting information. Flexible type and level set extraction begins.By product information and reviews information and where appropriate store information, such as data consolidation analysis to identify service delivery and other aspects of the sales price ranking of the potential value of commodities analyzed, in order to gain competitive situation of the goods, to facilitate different buyers of whether to buy the product provides a theoretical basis, through data mining to analyze the situation of potential buyers and buyers purchase behavior, and make strategic adjustments to facilitate the seller down frame work to increase sales or new products. Thereby increase sales or popularity.There is no multi-threaded extraction work with the sales recorded data extraction, which affects the integrity of the extraction efficiency and data analysis to a certain extent. The next step will be to improve the multi-threaded, or to update the data point analysis and extraction of data mining and enhance the scope and depth.