Design And Implementation Of An Electrical Information Acquisition System For Users Based On Big Data

With the expansion of the power marketing business and the accumulation of time,the data scale is getting bigger and bigger.A lot of power data contains the huge value,and traditional user electricity information collection system has the following deficiencies:1,rely heavily on relational database cluster in data storage,and extension ability is insufficient;2.With the growth of the business,it has to restructure the system to meet the new business needs,which is not conducive to system maintenance.This paper presents a big data technology application combined with user electricity information acquisition system,data processing and storage technology,applications of big data refactoring existing users of electricity information collection system;According to the characteristics of power information collection business,choose Apache Kafka distributed message queue combined with HBase database optimization traditional user electricity information collection system in concurrent data request and mass data storage performance bottlenecks;Under the premise of keeping the original relational database storage function,a heterogeneous relational data storage component is adopted to simplify the operation process of heterogeneous database and satisfy the fast growth of marketing business.