Font Size: a A A

Design And Implementation Of Microblogging System Based On Incremental Crawler For Video Resources

Posted on:2013-02-14Degree:MasterType:Thesis
Country:ChinaCandidate:H LiuFull Text:PDF
GTID:2248330392457849Subject:Computer application technology
Abstract/Summary:PDF Full Text Request
Driven by the age of internet generation and the advent of near-ubiquitous broadband internet access, online delivery of video content have surged to an unprecedented level. The explosive growth in content has given rise to the need of developing effective information retrieval service which can help users discover meaningful and interesting videos. As search engines primarily rely on the query inputs, web based push technology can help to provide active information services. The ’one-to-many’ broadcasting offered by microblogging is thought to increase video coverage. In this paper, we design a promotion strategy involving incremental crawlers, microblogging to increase the utilization ratio of video resources.Crawling has become a promising method to achieve online information. Besides how pages change, incremental crawlers often integrate change frequency, change extent, and document quality for each page to determine its relative order as well as its download frequency. But there are rarely dedicated crawlers focused on video collection. In order to provide fresh videos, we develop recrawl scheduling policies characterizing the longevity of information found on video sharing sites. And we make combination of both video display and microblogging for promotion of video transmission. And we take advantage of collective intelligence in video annotation. In this way, it will increase user stickiness and inspire users to take notes of video wonderful clips.As we show via experiments over real web data, our refresh policies obtain better freshness at lower cost, compared with previous approaches. And the microblogging system can improve he utilization ratio of video resources. After published for couple months, the microblogging system achieves good stability.
Keywords/Search Tags:Microblogging, Crawler, Refresh Policy, Collective Intelligence
PDF Full Text Request
Related items