Based On The Research And Practice Of Power Data Flow Link Monitoring System

With the rapid development of mobile Internet technology,State Grid Corporation of China has carried out a series of analysis and mining work by using big data technology in various specialties,and achieved remarkable results.However,in the process of conducting cross-disciplinary and cross-domain analysis of the business,many difficulties have been found that the data of various specialties cannot be effectively integrated and the data quality is not high.At present,the company also lacks overall data demand management and resource scheduling,and the business department cannot directly obtain concise and accurate business data.At the same time,the data vein is not clear,there is no data flow artery through the whole network business system,let alone can not directly find the data flow problems in the process of business data interaction,which brings great troubles to the data analysis work.,therefore,need to develop full view of all the source of the business system data link monitoring evaluation methods,using advanced technology to monitor the whole process of data resource scheduling,early warning and data flow anomalies in time,to improve the validity of the data analysis results for the company’s future development in the process of auxiliary decision provide strong data support,also for the large data center lay the foundation to realize the unified dispatching tech-oriented web data resources.Data link to monitor all key technology research and practice is the foundation of security data resource scheduling and stable operation,by building a data link all monitoring index system,using advanced data acquisition technology to automatically obtain data transfer all link data,using big data algorithms used throughout link comprehensive evaluation model,for its Chinese headquarters and province in company two level scheduling abnormal situation of real-time monitoring,to ensure that each business module based data output,high quality for SGC to carry out the large data analysis application to lay the solid foundation.This project based on the data itself,the first data link all monitoring index system,index system mainly includes the priorities in the core business system in longitudinal and horizontal run-through collaborative data interactive way,data flow context and database resources,network interfaces,etc.,through the establishment of index system of scientific,standardized,achieve an overall comprehensive evaluation on data link;The research of index acquisition and link automatic discovery technology is to realize the automatic acquisition of the data flow monitoring and scheduling information of the transmission link between the headquarters and the provincial company.On the basis of breaking the traditional manual statistics mode,the data flow topology relationship is automatically obtained through technical means to ensure the comprehensive and reliable data flow information.This paper makes full use of mathematical algorithms to build a data full-link evaluation model from four aspects: data health,data dependence,data contribution and comprehensive evaluation of data flow,which provides quantitative data support for data flow link monitoring and provides a powerful starting point for the company to carry out data resource governance.The visual designer is used to construct the data analysis model for comprehensive evaluation of data link,and the real-time and effective monitoring and analysis of data link are realized.Data link to monitor all key technology research has broken the traditional data link information collected through artificial offline access,use advanced can be rigorous technical means all aspects of science and technology to achieve the automatic reading of data link information,at the same time,also solved the subsequent data for operational technical problems,in the process of conventional data flow information maintenance,automatic identification and check each business system data link changes,eliminating defects,such as abnormal information,ensure the data flow information consistent with the actual business,on the whole largely reduced labor costs and time costs,improve the comprehensiveness and accuracy of the data flow.In addition,the data link to monitor all key technologies can be used in the electric power enterprise’s business department,through the use of monitoring technology,real-time control and monitor each business system data flow of the arteries,found that the anomalies in the data flow in the process of interaction,to ensure that the normalized data operations and provide high quality data to support business analysis work,for business development and company development in the process of auxiliary decision-making to provide strong technical support.