Research And Implementation On Trust-Based Web Crawler

With the number of netizens growing rapidly, the propotion of Chinese shopping on t he Internet is rising. The development of C2C EC(electronic commerce) technology is rapi d. However, the EC’s own topology’s characteristical of openness, dynamics, and uncertaint y make the security issues becoming more and more prominent in EC trading. Because it was found out that the nodes’ communication under the P2P network has a similar nature with the trading system in C2C EC transactions. Therefore, this study take the algorith m of trust similarity to calculate the global reputation to analytical research of EC securit y issues, a trust-based web crawler system was designed and implemented.This study took researches on the following areas:design a web crawler to gather the web information; proposed method about calculate the global reputation based on the trus t similarity; then, simulate the experiment by using the open source software Nutch Web Crawler to gather the web information, take the data gathered from the web crawler into t he models structured by Netlogo simulation environment to take the experiment. The exper imental results showed that this model can display the nodes’ truth credit/worthiness effecti vely. Through screening the information by the trust mechanism and dissemination can m ake the transaction information more realistic, safe and reliable. In a certain extent, increas ed the likelihood of a successful transaction, reduced the probability of occurrence of the malicious fraud. It verified the model’s effectiveness and accuracy. Also, the buyer can get the seller’s information more accurately in C2C EC. Yang Zhiqian (computer architecture) Supervised by Wu Guowen...