Research And Implementation On Electory Line Loss Analysis Based On Hadoop Technology

Line loss is the energy transmission through the transmission line and the energy loss.The size of the line loss rate reflects the power company’s power network planning,maintenance,scheduling,marketing level.Line loss is an important economic and technical indicators of power grid development,reducing line loss can significantly enhance the economic benefits of power companies.The traditional line loss analysis system is based on the relational database such as oracle architecture,and the system is inefficient in data synchronization,data storage,data processing,data feedback and so on,when it is used to calculate the grid line loss to deal with the massive grid operation data such as voltage meter.There is an urgent need to study the new line loss system processing architecture.In order to solve the above-mentioned problems of line loss system analysis,the following two aspects of research work included:1、Analysis and design of line loss analysis system based on Hadoop technology:in the study Hadoop large data technology and line loss analysis based on the business,the system functions in general and detailed design.1)、Designed a data integration method based on distributed parallel extraction technology Sqoop for grid account and operation data,and realized the rapid extraction and integration of line loss analysis data from relational database to distributed data warehouse.2)、In Hood and HBase of Hadoop components,the storage structure of grid line loss data,which ranks and coexists in the ranks and automatically transforms,is designed,which meets the requirements of time-series bulk calculation and instant query.3)、A method to implement computational logic.The method of line loss calculation task based on template technology is designed to realize the loosely coupling of line loss calculation and business calculation logic,and realize the parallel operation of line loss calculation in distributed data warehouse Hive.4)、Designed a data feedback method of the line loss analysis,which combines the synchronous(data instantly write back)and the asynchronous(service call),and solves the feedback problem of the mass result data and the small batch result data.2、Implementation and testing line loss system:line loss analysis function design and detailed design of the overall design,based on the use of open-source Hadoop technology to build a distributed computing cluster to achieve the line loss analysis system,and the system was tested and validated,tested.The results show that the calculation performance of grid loss analysis system based on Hadoop technology is improved 6 times compared with the traditional relational database system.The Hadoop line loss analysis system based on the large data technology can effectively solve the problem that the line loss analysis and processing efficiency and the timeliness do not meet the demand of the business,and provide the information system technical support for the power loss management.