The Design And Realization Of The Data Quality Management Platform Of Grid Assets System Based On Hadoop

Human society gradually into the big data era. According to IDC, the global amount ofdata in2011has reached1.8ZB, and50%will continue to grow at an annual rate. Under thisshare data wave swept all sectors of society are beginning to big data industrialization process,the power industry is no exception.According to data from a University of Texas study showed effectiveness againstcompanies by improving the utilization of their data and data quality, can significantlyenhance their business performance. If the enterprise data usage increased by10%, the powerindustry enterprises will be able to enhance the per capita output of about18%; And if10%of enterprise data quality improvement, the power industry to benefit from the most obvious,ROE2(ROE) to enhance the rate of218%. Overall, these effects are caused by the quality ofthe data, because the data usage has been able to improve the power sector to improve outputper capita, but also because the data reaches a certain quality. It can be seen, the data qualityof the electric power industry is essential for the operation of the power industry. Since theimpact of data quality on the electric power industry is so important, then how to ensure andimprove the data quality of the power industry under the background of big data in it?Through reading the relevant literature on these issues more in-depth study and putforward their own ideas on the grid design system data quality asset management platform inthe paper that the use of a combination of prevention and treatment as well as a combinationof automated and manual to ensure the power grid data quality assets of the system. Inaddition, due to the current system of using a grid assets relational database, so I deal mainlyrelated to quality issues for relational databases. Considering the quality of the data grid assetmanagement platform system scalability, the platform also provides the appropriate interfacefor other data formats, in order to achieve a platform for other formats of data processing inthe big data era.Finally, under the guidance of the above design ideas, this article uses the programdesign phase to use UML technology, database design phase to the ER diagram usingtechnology, and program development phase of development mode and SSH architecture andHadoop-based distributed platform, development the power system data quality asset management platform.