| China is a large agricultural nation, but agriculture as the foundation of the weak, the agricultural informatization level always lags behind in the western developed countries. After China's entry into WTO, the agricultural informatization construction stage of rapid development, the agricultural sites have sprung up in the website of agriculture, agricultural data, are still in the day and data with exponential growth. But these mass data only original information, contains a number of fuzzy, incomplete, with the noise of the information and knowledge is not as people using directly.There are many agricultural information, macro information, technical information, market information and scientific and cultural information. The information in the agricultural field plays a very important role. According to the characteristics and requirements of agricultural information, can divide again to seasonal information, regional information, comprehensive information, timeliness information, multi-level information and innovative information, etc. The information relay dependent on information carrier, there are many agricultural information carrier. At present, main carriers of agricultural information transmission, television, radio, newspapers, books and Internet media in China. Each kind of carrier has its own characteristics, different carrier complement each other. Compared with the traditional agriculture information carrier, as radio, television, telephone etc. The Internet is developing the new information communication carrier. Currently, the agriculture website is an important carrier of agricultural information. Transfer by agricultural sites, the magnitude of the agricultural information data, and other agricultural information carrier can not ratio. Meanwhile, agriculture website is one of the important means of agriculture e-commerce, and exchange and learning platform.There are a lot of the market information, and soil and crop experience technology policy and regulations as the original message in agricultural websites.Through the application of data mining technology to solve the "information explosion, but little knowledge", to improve the efficiency of agricultural information. Web data mining is the data processing and automatic extraction and knowledge discovery process on web pages. According to different object, the web data mining can be divided into the Web content, structure and web users access pattern mining. Compared with the traditional database, the data on the Web is completely different structured data, and the websites of the information organization each are not identical. Therefore, the data mining technology for the websites to tackle heterogeneous data and semi-structured data. This paper based on the data of agricultural websites as mining. In order to effectively manage and use the data obtained by mining, to construct a star of the agricultural structure of data warehouse, and agricultural websites of data mining model system. The automatic extraction technology on agriculture websites is one of the difficulties in study. The paper analyzes structure characteristics of the agricultural web page,website HTTP characteristics, introduced the principle and data extraction using regular expressions for design, and to extract the price of vegetables market of HeFei Zhougudui piles up wholesale market. The price of vegetables has realized automatic batch data extraction. And the extraction of data, using that time series prediction model for the short-term forecast analysis. |
PDF Full Text Request