The Research And Application Of Social Media Data Management System Based On Crawler Technology

2000 began,social networking and social media have developed rapidly.2002,My Space was founded,to 2006,it has become the world's most popular social network,Twitter was founded the same year,social media more and more sought after.The following year China's Sina Weibo login network,witnessed great changes in domestic social media,user Sina Weibo,Sohu microblogging,letters and other emerging media creation generated a lot of data,and these data and marketing tools for businesses development of methods worthy of our study and attention.In this paper,social media data management system(Social Media's Data Management System,SMDMS)development is the integration of existing media resources in order to make full use of multi-dimensional model,the advantages of computer technology,information management technology,Internet technology,accelerate media data,marketing means to manage scientific,information technology,networking.This paper describes transactional data and social media data concepts and features as well as evaluating the quality of the content and methods of data,then the traditional data quality dimensions such as accuracy,completeness,consistency,credibility,timeliness,accessibility and correlations were analyzed,considered in transactional data and social media data,the importance of various quality dimensions are significantly different,and to determine the quality dimensions of social media can be used to evaluate the quality of the data.Lists some social media data acquisition method to set the Crawler crawl keyword strategic way to obtain effective social media data.Build a complete social media data capture,filtering,clustering,preliminary analysis of the system,and a variety of tests and analysis in a particular field of marketing,this system can be obtained with the flexible use of social analysis and marketing applications.Finally,it discusses use to determine the quality dimensions of social media data quality management and evaluation,the corresponding recommendations in the future prospects and applications in many fields by model analysis of this system.The successful implementation of the design of the software system can improve government agencies,enterprises for the efficient management of industry-related social data,but also on the existing social media data stored in the analysis of whether the value,whether made on the future development of social prediction contributions verification work,and promote the building of data management standards and datamanagement system reform and play an important role.In addition,the system in promoting social media database construction,data structures,efficient management,improve the scientific and accuracy of the data analysis process,better have a profound impact on the national and community service,while socialization media agencies or related businesses reasonably tailored to optimize this system can achieve the purpose to better serve the community.