Design And Implementation Of Acquisition And Processing System Of Personalized Focus Information

With the continuous development of the Internet,the network plays an increasingly important role in people's daily life.At the same time as the number of users increases,the information on the Internet is showing an explosive growth trend.Although more and more information on the Internet gives people more choices,it's becoming harder for the users to find and collect the information thatthey really need.In reaction to the phenomenon,a new information acquisition and processing system based on user's personalization is proposed in this paper.The system is designed to help users gather and deal with the information they need in a better way.First of all,in the aspect of information acquisition,the system uses a focused crawler to help user collect data.Meanwhile,in order to meet users'personalizedrequirements,the way in which the system uses to collect data is based on the user configuration.Users can set up every aspects of the information acquisition,especially in information filtering.They can control the type of web pages for filtering.Secondly,in the aspect of information processing,what the users really need is not the web page itself but the information in it,which we call the structured information.Considering this,the final result of the system consists of four parts:the main body of the web page,the key words,the and the classification of the web page.The system uses a combination of statistical analysis and text analysis to extract the structured information of web pages,and has achieved good results in practical application.At last,in the aspect of user interaction,the system uses the popular B/S architecture.The rich client mode that is used in other acquisition system has been abandoned.A platform,which is much easier for the user to use,is constructed.Users can get the structured information that they need only need a few simple steps.The system designed and implemented in this paper is based on the user demand.Based on the current situation of information on the Internet,combined with the special needs of users,this paper wants to create a universal platform for information acquisition and processing.