Design And Implementation Of Data Storage Management System For Agricultural Internet Of Things

With the in-depth application of Internet of the things in agricultural production,the scale of its system is also increasing.Agricultural data is showing the trend of quantification,isomerization and unstructured,and it puts forward higher requirements for data storage system.Because of the traditional RDBMS(Relational Database Management System)-based storage system mode is simple,not easy to expand,concurrency and fault tolerance,it is difficult to meet the requirements of mass data storage in Contemporary Agricultural Internet of things.The development of distributed storage and No SQL technology provides new solutions for data storage in the era of big data.In view of the high cost of commercial storage expansion,how to build a low-cost and efficient agricultural Io T data storage system on the premise of satisfying mass storage,high performance,high reliability,and high scalability is the focus of this studyBased on distributed storage and No SQL technology,the following work is carried out in this paper.(1)Classify the data collected by the Agricultural Internet of things system and analyze the data characteristics.The shortcomings of traditional data storage system are analyzed,and the research progress of data storage technology and Hadoop technology is introduced in detail.By comparing the differences between RDBMS(Relational Database Management System)and No SQL and analysis the shortage of Hadoop in the data storage,this paper designs an improved scheme based on the data characteristics of the Agricultural Internet of things.(2)According to the analysis of agricultural IOT data characteristics for data storage requirements,the overall architecture of the storage model is designed based on the Hadoop platform,and the key modules in the storage model are designed in detail.The storage scheme of structured data and unstructured data in the Internet of things system is designed respectively.The storage model uses the Master/Slava architecture,the high efficiency,high scalability and high fault tolerance of the massive Internet of things data on the cheap PC are realized.(3)Based on the distributed column database(HBase),the optimistic locking mechanism is designed to support the strong transactional support.The mapping rule between metadata and physical storage location is designed through file index,which realizes the storage of metadata for unstructured data by HBase,and effectively reduces the pressure of main node.The stability and efficiency of the storage system are further improved by the load balancing strategy of weighted polling and the Redis caching system.(4)By building a storage model test cluster,a structured data storage scheme,an unstructured data storage scheme,and the memory consumption of the main node are tested.The design and implementation of networking agricultural data management system prototype based on the model of storage,the practicability of the data storage model of the IOT is verified on the application level.Based on the Hadoop platform,the data storage model of Agricultural Internet of things is constructed,which provides a solution for mass Agricultural Internet of things data storage,and provides reference value for efficient and reliable data storage of Agricultural Internet of things in the era of big data.