Design And Implementation Of Data Processing System Based On Taihu Cyanophytes Of Internet Of Things

In recent years, Internet of Things (IOT) has become a world wide hot topic; IOT has been included in one of the strategic industries in China, and widely used in many fields. As an environmental monitoring application of IOT, The monitoring of Taihu cyanophytes is an important part of constructing the grand blueprint for IOT in our country. But there are still many problems in the development process of IOT, at present technology for mass data storaging and processing is still in the process of development, so it is worth for us to do a lot of research in this respect.The development of data processing system is mainly introduced in this thesis, which is one subsystem of the project of Internet of Things Information Center (IOTIC), the data of monitoring Taihu cyanophytes are the resource data of the system. The system is based on the HDFS file system and MapReduce parallel computing model of Hadoop framework, Eclipse is used as development tools, and Java is used as the development language in this system. The purpose of the system is to receive, storage and process the data of Taihu cyanophytes, includes analysising of the sensor data, editing of data processing flow, creating and analysising of the process flow file, executing of the rule files, persistence of data, etc. Hadoop framework, which is used in this system, is an efficient platform for storaging and processing, testing showed that the system is to meet the basic needs of customer, to lay a solid foundation for further development of IOTIC.In this thesis, firstly, describes the background of project, the system of development objectives and issues raised, and gives the structure. Then, the related conceptions and key technologies used in the system are introduced briefly; the structure of IOTIC is mentioned. In the section of system analysis, firstly, gets the structure of data processing system, confirms the operation flow of the system, and gets the key problems to solve, and then the specific functions are described finally. In the part of system design, the overall design is proposed and then the concrete design of each module is given in detail. In the part of system implementation, the detailed implementation and the key technologies of each module are described. System application part gets the report forms through the case, which processed the data of Taihu cyanophytes; the whole process of this application validated the function and performance of the system. Finally, the work in this thesis is summarized and the further steps are prospected.