Research And Implementation Of Agricultural Data Sharing Technology Based On Cloud Platforms

Agriculture is the basis of daily life, government pays much attention to the developing of modern agriculture. Improving traditional agriculture by utilizing modern information technology is an efficient way for rapid development of modern agriculture. It is of vital importance for the transformation of agriculture and agricultural modernization by boosting agricultural information in production and operation. Recently China have been growing fast in agricultural information. Large amount of agricultural websites have been set up around the country. And huge amount of agricultural data have been accumulated. However the development of these websites is separately. There is no unique national wide standard for these agricultural websites. Data in different sites independent with one another which forms information islands. This causes it difficult for the using of agricultural data. So the key problem is how to fully utilize agricultural data accumulated till now. Current status of agricultural data sharing is first studied in this paper. Then data sharing technologies for agricultural data is studied. A cloud platform based agricultural data sharing system is developed by utilizing the mediator based data sharing technology. Details are as the following.(1) Data integration and sharing methodologies is studied and analyzed. The mediator based data sharing method is chosen to be the core of the study according to the features of agricultural data sharing.(2) Mediator based data integration method is then analyzed, an improvement to the method is proposed by using AMQP message queue for communication between mediators and wrappers, in this way mediators and wrappers are better decoupled, which makes it easier for the scale out of mediator systems.(3) Web crawler for web information structuring is studied, the common features of web crawlers is summarized. An XML based describing language for web crawlers is proposed which makes it easier to write a web crawler without knowing the details in dealing with the details of web crawling and just utilizing the describing language using XML and regular expressions only.(4) According to the development process of the project, a quality management methodology is proposed by utilizing Deming Cycle into Scrum Agile Development. Then the methodology is practiced in the development. The methodology of utilizing Deming Cycle into Agile Development offers theory for software developing in small groups, which benefits in the continuous improvement of software quality.(5) A cloud platform based agricultural information sharing system is developed. By research and survey, an agricultural information sharing system using OpenShift platform and GlusterFS cloud storage developed fulfilling the requirements of “Bohai Granary” in Shandong Province.