| Social hotspot issues generally refer to a certain social phenomenon,major event,news person,etc.that occurs within a certain period of time and within a certain range of society,and has caused widespread public concern at home and abroad.Social hotspots often cover mainstream issues in society.Helping people to understand social hotspots faster will not only help people form socialist core values,broaden their horizons,and expand their knowledge,but also help people to awaken their subject consciousness,integrate theory with practice,and understand society more deeply.With the development of the Internet,news technology also changes with each passing day.The Internet has the characteristics of high efficiency and convenience.Applying this feature to news technology has made the Internet the main channel for news acquisition and dissemination at present.It has become the most comprehensive information database in history.There is no doubt that the resources on the Internet are rich in variety and huge in number,especially the importance of online social tools in real life is increasing,and the number of users is increasing.News data on the global Internet is growing every day at an unprecedented rate.In the traditional way,I hope to find hot news topics efficiently and quickly in today's ocean of Internet news data.This article mainly designs and implements a real-time crawling system for various categories of news in mainstream news websites,researches and proposes extraction methods suitable for the key content of news text,and combines the latest information analysis of news keywords to get current social hotspots Provide basic support for news content retrieval and social hot topic analysis.The main research work and important research results are as follows:1)How to get mainstream newsFocus on researching the method of obtaining the latest process of mainstream media in real time,and make a data foundation for subsequent keyword extraction and social hot words analysis.The latest real-time data also ensures the accuracy of current social hot words.At the same time,it can also provide users with a visual operation interface,which is convenient for managing data and using corresponding functions.2)News keywords extraction methodInvestigate an algorithm suitable for keyword extraction in news.This method is based on the combination of LSTM's classification model,TF-IDF and TEXTRANK,and considers the frequency relationship of each word in different types of corpora and the structural relationship of words in the article.,Improve the accuracy of the extraction of news keywords,and also lay the foundation for subsequent social hotspot analysis.3)Analysis of hot topics based on keywordsThis paper researches a social hotspot analysis method based on news keywords.This method is based on the news keywords extracted from real-time news.Based on the frequency relationship of news keywords over a period of time,the weights of words are calculated using probabilistic methods.Finally,according to the weight of the words,get the hotter words to get social hotspots.The key news content and hotspot analysis system designed and implemented in this article provides users with a platform that can get real-time news names,place names,keywords,types,and social hotspots.Users can get the main news content and social hotspots in a timely manner through the platform.News is a record of the times.It constantly evolves and develops with the progress of the times,and at the same time can reflect the trend of the times and social hotspots.The key content of news has great research and reference value for social development.On the other hand,only when the media,businesses,and the government understand the current social hotspots can they grasp the needs of the public and the direction of public opinion,and take corresponding measures against the hotspots.The design and implementation of this system is of great significance to social development. |
PDF Full Text Request