Design And Implementation Of Hotspot Analysis System For Q&A Sites

Along with the rapid development of the Internet,Internet users have more and more channels to seek information online.Gone are the times when users could acquire knowledge and information from only a handful of web portals.More specialized and detailed information sources have gradually come into being.Social Q&A sites,especially which allows Internet users to freely ask and answer questions of all themes are the fastest developing ones.It becomes popular to extract social hotspot through these platforms.By crawl and analyze the content of social Q&A sites,the paper proposes the method to analyze hotspot,designs and accomplishes the hotspot analysis system for Q&A sites.The work and contribution includes:(1)By taking a social Q&A site as the research subject,this paper analyses the difficulties in crawling data from this site and relevant solutions,upon which designs and implement a data crawling system containing a proxy maintenance module,a finger filtering module and data storage module.With these modules,the system is able to crawl data and store correctly and quickly.(2)Designs and implements a hotspot parsing module to extract the hotspot from data.A historical hotspot display module and a trending hotspot display module are designed to show the historical and trending hotspots data on this site.(3)Crawls the data of 31,520 regularized independent topics and the real-time data of 858,001 questions and answers from this site.Based on these data,the historical and trending hotspot analysis on this site is displayed.(4)Compares the experimental results and weibo index,and analyses the result.The results show that this system has fully met the design objectives and may be used as one of the most important tools to analyze the hotpot of social Q&A sites.