Design And Implementation Of IoT Data Distribution And Storage Platform In The Edge Environment

In the recent years,IoT technology has been widely used in industrial production,daily life and military activities.The emergence of a large number of IoT devices will generate massive data,which puts forward high requirements for data collection,distribution and storage.In some special scenarios(such as natural environment observation,military command,natural disaster rescue),IoT devices are far away from cloud data centers.There is no stable network connection or the original network facilities are easily damaged.A large number of IoT devices interacting directly with cloud data centers will cause a greater burden on the network layer which is originally fragile.Therefore,it is necessary to design and implement a platform which has good adaptability to the weak network environment and be able to utilize the limited computing resources of the edge.So that reliable data distribution and storage services can be provided to edge clients.Based on this background,this thesis has designed and implemented an IoT data distribution and storage platform in the edge environment.The platform cooperates three types of platforms:edge client,edge node and cloud node,and makes full use of the advantages of three platforms to provide reliable data distribution,storage and preprocessing services for edge users.For the problem of weak network in edge environment,the communication module uses the MQTT lightweight communication protocol and the Gossip consensus protocol,which improves the bandwidth utilization and has better fault tolerance for network failures.On the basis of the communication module,the platform implements monitoring module,data distribution module,edge data storage module,data preprocessing module and cloud data storage module,which realize data collection,distribution,preprocessing,edge storage and cloud backup function.What’s more,the entire platform is design in decentralized architecture,which has strong adaptability to the edge environment.First,this thesis introduces the background of the data distribution and storage platform;then it investigates the related technologies and achievements of the existing data distribution,storage system and cloud computing system in the edge environment.Then requirements analysis to this platform has been done.After that,the architecture design and subsystem design of the IoT data distribution and storage plateform in the edge environment has been finished.Corresponding solutions are proposed to solve the key problems such as weak networks and frequent node failures in the edge environments.And then this thesis stated the implementation of the entire platform in detail.Finally,through a series of tests,the effectiveness of this data distribution and storage platform has been proved.