Design And Implementation Of News Aggregation Platform

With the rapid development and widespread popularization of the Internet,full-media clues News and materials have showed characteristics like various kinds of information and formats,efficiency of processing,and high accuracy,the collection,analysis and process simply by manual work have become extremely difficult,resulting in low efficiency and being unable to meet the needs of all media news production.News Aggregation Platform adopts technologies in the fields of Data Crawling natural language processing,search engine,probability statistics and machine learning and some other related fields,to achieve the automation of news gathering and statistical analysis,to provide clues news and materials for media practitioners,and to improve the efficiency of search,filter and analysis.News Aggregation Platform serves the media practitioners.This article bases on the development of News Aggregation Platform,regarding news search,news details and scheduled task scheduling as the key points,to carry out in-depth analysis and design.News search is a basic business module of the platform,which is to help users search clues news,hot news,event news and web news.News details module is a core business module,providing analysis results of abstract,entity words,keywords,positive and negative emotions,typical opinions,comment areas,comment volumes and media report volume on the foundation of original information,and it can be divided into four parts,including clue news details,hot news details,event details and historical news details.Scheduled task scheduling is the key technology module,which based on Quartz Scheduler,aiming at achieving the automation of news analysis.During the development of this platform,the author participated in the stage of needs analysis and the stage of design and implementation.During the first stage,the author accomplished the business analysis,design of product prototyping and design of front-end page interaction with colleagues.In the process of design and implementation,the sub-modules belong respectively to clue news search,hot news search,event news search and network news search in the news search module,the sub-modules belong respectively to clue news details,hot news details and event news details in the news details imodule,and the sub-modules belong respectively to clue news timing task,hot news timing task and event news timing task in the timing task scheduling module,were all accomplished by myself,meanwhile,the author also participated in the design fand implementation of database table structure.The News Aggregation Platform is still in the user trial phase currently.The one which has been applied to a certain company is running well.The modules of which the author was in charge runs well and have reached the desired goal.