Font Size: a A A

Design And Implementation Of Network Information Collection And Processing System

Posted on:2016-11-18Degree:MasterType:Thesis
Country:ChinaCandidate:W J ChenFull Text:PDF
GTID:2298330467493752Subject:Software engineering
Abstract/Summary:PDF Full Text Request
It’s very important to increase the click number of the Ads on search engine while the search engine was used. Due to the difference of the users, the difference of the search engine, which has its own ways for its Ads, and the different methods of exhibiting Ads, a great number of values and data were brought and be produced accompanying with the scanning and clicking actions of each search engine. Thus, collecting, watching, analyzing the data, and summarizing the showing ways of Ads become an important role to increase the profit for the Ads companies. Now, a great deal of relative technologies are developed in in today’s highly competitive field of search.The primary works in this thesis are three parts as follows:(1) Design and achieve the part of getting the data from data group at regular time. Complete the building of server and running the action script at regular time, use shell to call pig Latin to collect the data from Hadoop Distributed File System, and save the data on grid server;(2) Design and achieve the part of saving the data on local server, it means that bring the data to local server from grid server, and import the data to MySQL from the form of text files;(3) Design and achieve the part of showing the data on UI, by the means of LAMP, Apache, HTML, CSS and JavaScript to finish the work, and provide charts and tables for users to watch and analysis the data.Through the three parts above, the dashboard system to collect the Ads data automatically and data exhibition for users were achieved, which finally help the staffs away from the boring black and white and uninteresting environment. Moreover, the data were showed by the means of colorful graph, and easy analysis. And the users can watch the data and the trends of query data, even download the data directly. In short, this design and dashboard improve the efficiency of staff impactful, avoid the duplication of effort and time, and make the people attain the data more quickly.
Keywords/Search Tags:Search engine, Ads, Click rate, Accurate, Data Display
PDF Full Text Request
Related items