Development And Application Of Mobile APP Integrated Web Crawler Technology

The rapid development of "Internet Plus" and the acceleration of the pace of life require urgent and inexpensive information acquisition models.The popularity of smart phones not only brings great convenience to communication and online shopping,but also gradually changes our work and lifestyle.It has become a trend to use smart phones instead of fixed desktop computers,conduct online work,collaborate with partners in other places,obtain rich cloud food information resources.Developing a mobile APP system that meets various human needs has become an imminent task;As people continue to pay attention to a healthy diet,the development of food recommended mobile APP system has a broad application prospects.Research and develop food recommended mobile application combined with web crawler technology.This application system is divided into two parts:web management system and mobile app client.The web management system implements the functions,such as manage User information,ingredients information,recipe information,etc.The mobile app client implements the functions,such as view recipes information,ingredients information,communication and discussion,health information,search for food,manage personal information,etc.The client uses the C/S structure,and select the Android mobile operating system as the development platform.The background server adopts JavaEE technology and use the rapid development framework which is more popular currently to design.The communication between the background server and the client mainly uses the TCP/IP protocol,and the data format of network interaction use Json.The web management system uses the B/S structure.The browser adopt the technologies such as HTML5,CSS,Javascript and j Query,and use AJAX to the asynchronous interaction with the server.Data acquisition in this Mobile applications using the web crawler system built with the technology SpringBoot,Mybatis and HtmlUnit,which could crawl the related information.Using timerSpringBoot to update data in realtime,then store data in the cloud.The database uses Mysql,the mobile app client uses the Android program development language,and the server usesJava to provide the data interface of RESTful type.A mobile app that uses Android's open source framework as a platform and incorporates web crawler technology can quickly and massively acquire massive amounts of effective data,the system provide convenient,accurate,time-sensitive information to the user,and have strong functional scalability,easy to update and expand functionality.