Design Of Intelligent Substation Data Management System Based On Hadoop

With the development of intelligent substation and its state monitoring system,the data size of power equipment status information gradually increase.Massive data storage and complex data types make it difficult for traditional data management to meet the needs of power enterprise information construction.In order to ensure intelligent substation economy,safe and reliable operation,it is necessary to set up the intelligent substation information integration platform to strengthen the information exchange and sharing between the substation departments.And it makes full use of massive device status information to support enterprise decision making.Therefore,it is of great significance to construct a new intelligent substation data management system to meet the needs of enterprises in mass storage and query analysis.(1)According to the characteristics of intelligent substation data,the data are organized into three types: structured,semi-structured and unstructured.The different types of data management models are respectively studied,and the fault diagnosis framework and scheme of substation on-line monitoring data are studied.(2)This paper designs the overall framework,data flow process,storage and retrieval function of intelligent substation data management system,and analyzes the substation fault equipment accurately based on information fusion.Based on the keyword extraction technology,the literature retrieval of substation is designed.(3)Based on the information integration platform,the intelligent substation data management system based on Hadoop framework is developed.The data is distributed and managed by distributed file system(HDFS)and HBase database.Map Reduce is used as the calculation of massive data query analysis mode,using the Java language to achieve B/S mode intelligent substatio n data management system.(4)In this paper,the real substation operation monitoring data are used to test the system.The storage performance,query performance,read and write delay comparison and distributed index comparison are analyzed.Hadoop-based intelligent substation data management system can realize the storage and management of various types of substation information,including substation operation data,online monitoring data,equipment management information,fault report and so on.The entered data can be manually entered and also supported for bulk import,and the managed data types include structured data,semi-structured data and unstructured data(documents,images,videos,etc.).Document management can automatically generate keywords for storage,so that the operator quickly retrieve and read.Using Hadoop cluster to cluster I/O performance test,multidimensional data query and analysis for different scale datasets,the test results show that the system can make full use of computing resources to achieve the intelligent substation business information reliable storage and management.The system has the advantages of low cost,high reliability and easy expansion,and also has a useful exploration for the construction of power system information.