Application Research Of Environmental Monitoring Data Supervision Based On Data Mining

Data mining technology has been widely applied in the field of finance,biological pharmacy,bank credit and so on.However,there are few researches on the application of environmental monitoring data in the field of environmental supervision.Under the requirements of the total emission reduction,environmental monitoring system in the domestic unceasing popularization,the resulting in a large number of environmental monitoring data and with the advance of the work of the open government data,environmental monitoring data access is also increasing.Therefore,it is particularly important to explore the data mining technology which is suitable for the characteristics of the current environmental monitoring data,and to provide a new way of thinking for environmental monitoring data monitoring.In view of the above problems,this paper through the literature research of current data mining tools are analyzed and screened suitable for the characteristics of current environmental monitoring data mining tool,established in Python as the main development language,the scrapy data collection framework as main tool for data mining preparation stage,the pandas,the numpy module as the main tool used in the data analysis phase,with the Matplotlib module as the main tool used in drawing stage of data mining process.With the established from data preparation,data analysis,results based on environmental monitoring data flow,Henan,Hunan,Sichuan,Zhejiang,Xinjiang provinces and The Inner Mongolia Autonomous Region of the environmental monitoring data of sewage enterprise were data acquisition,to build a relational database(My SQL)and distributed database(Cassandra),respectively,for metadata storage enterprise sewage monitoring data and specific monitoring data.And to thermal power plants as an example of the unit emission data for nearly three months of data for data analysis,through data mining can be more easily found emissions rules and exceptions,the regulatory environment can be simplified.And verify the selection of the data mining tools and analysis process is suitable for the current environmental monitoring data mining,to provide new ideas for environmental monitoring data supervision.