Design And Implementation Of Data Acquisition Application Based On Internet Of Things

In recent years,with the rapid development of Internet technology and smart sensor industry,the Internet of things technology which integrates the two kinds of technology is becoming increasingly mature.Many traditional industries also take advantage of Io T to carry out business innovation and industrial upgrading.As a representative of the traditio na l manufacturing industry,the steel industry also has an urgent need to transform to automatio n and intelligence.The topic of this thesis comes from the "Data acquisition platform based on Internet of things" project cooperated with a domestic iron and steel enterprise.In the process of enterprise informatization construction,it is necessary to manage and monitor the operation data generated in the process of industrial production,improve production process and production efficiency by data analysis.Therefore,a large number of industrial sensors are deployed in the enterprise zone to produce data,and then presenting the data by the data acquisition platform.With the expansion of the project size and the gradual diversifica t io n of the sensor types,the traditional solution of equipment access and data collection has been unable to meet the requirements.From the perspective of performance,how to deal with the performance bottleneck caused by massive data is a major chal enge of the system.And from the perspective of scalability,most of the Io T platforms based on private cloud now are aimed at the specific requirement of a certain field.When accessing heterogeneous devices,a lot of repeated programming work needs to be carried out with high cost.In order to solve the above problems,this thesis designs and implements a Io T data acquisition architecture tha support high concurrency.For the performance problems,the system uses Netty framework to optimize data communication and the process of accessing client,and uses Kafka which has high-performance to deal with data jam in high concurrency.For the problem of scalability,we register the resource model of Io T devices to solve the problem that how to manage the heterogeneous devices.The system also reserves some simple secondary programming interfaces to help programmers shield differences of data protocol,so that the platform can access heterogeneous devices more flexibly.According to the current project background and the characteristics of the existing technology,this thesis mainly does the following work:1.In order to solve the problems of delay and packet loss when the data collection volume is increased,we use the high-performance NIO communication framework Netty to increase the concurrent volume on the collection side.Reducing the resource consumption of the server by optimizing the parameters of Netty and using thread pool.Then,the data parsing module is used as the producer to push the data object to Kafka.Through the above ways to achieve flow control and ensure the reliability of the data acquisition module.2.For diversified data protocols,the system reserves the secondary programming interface,abstracts the handler class which responsible for parsing data protocol.It also uses the responsibility chain mode to parse heterogeneous data,and users can complete customized data parsing program according to the developer's guide.This design greatly improves the flexibility and scalability of the system.3.This thesis analyzes the requirements of the system by accessing the two certain kinds of Io T devices,and then it lists the functional requirements and the performance requirements of the system.4.Design and implement the relevant modules of the system,including the device data acquisition and parsing module related to the IOT devices,the device model manage me nt module and the data business management module related to the system users.5.In order to verify the functional and non functional requirements of the data acquisit io n platform.We deploy the Io T platform in the actual environment to test the functions and the performance of the system.