Development Of Visual Web Scraper

Internet growth continuously from day to day,being filled with huge amount of different information.Sometimes this information can be helpful to different individuals or businesses.Sometimes it's needed to make a lot of routine work to grab the whole bunch of data and sometimes it's nearly impossible for one person – imagine how much goods can be selling in stores like Amazon.Special tools were created in purpose to automate such tasks.They called web scrapers,also known as web harvesters and web data extractors.These tools can automate routine jobs like surfing through the website,saving and sorting data.However,most of these tools require at least basic knowledge of HTML,CSS and other web technologies and very often advanced knowledge about other IT technologies.In this thesis will be introduced powerful tool that called Visual Web Scraper.Visual Web Scraper is built to solve the problem of web scraping for regular users and it can be used by anyone who know how to just use browser in regular way,browsing websites.This tool doesn't require any additional software except the browser(Google Chrome or other Chromium based browser).Visual Web Scraper is designed as Google Chrome browser extension and it will help regular users(without any advanced IT technologies knowledge)to use web scraping.This thesis contains full information about development of Visual Web Scraper and discussion about the problems it supposed to solve.The main contents tell about considering the problems of web scraping for common users,this topic suggests solution of the web scraping problem,identifying most valuable web scraping features and resolving problems of web scraping project setup complexity for non-IT users.The experimental results show the effectiveness of the developed software in compare to existing web scraping methods.