Design And Realization Of Python-based Book Information System

With the continuous development of the data, it is also increasing demand for data, the data for individual or smaller SMEs may need to get through the web crawler. Web crawlers to read through the web URL address information, to be screened on the web page parsing and text to form the target data. Web crawler written in Python using multi-threading technology to improve the efficiency of the program, by locking to ensure the accuracy of the data obtained, the use of large-scale data stored in the database crawling. The main application is to achieve crawlers aggregation of information, to provide users with more choice of information.The design of the crawler book information primarily to provide users with multiple sites, and ultimately in the form of Web pages presented to the user. First, read the web address from the database and the corresponding rules, combined with web crawlers rules to extract data, the stored data to a connected database, and then writes the data to HTML text, thus completing the entire aggregation of information process.