Data Reconstruction And Governance Of Operators Based On Big Data Platform

Based on the ease of a large data platform project of an operator in Hong Kong in 2018,the author has made on-site investigation and sorted out the painful points existing in the data processing of this operation at this stage,such as:inconsistent access of data sources,inconsistent data caliber,many manual processing links,a large number of single application stacks,and the application relies on manual development.Personnel skills are demanding,data analysis support platform is small,starting point is low,equipment is few,lack of intelligent analysis means,unable to effectively mine the value of data and so on.Through screening and matching the existing open source big data platform components in the industry,and using the tide cloud sea big data platform,we can provide a safe,stable and efficient construction scheme with open technology,service-oriented architecture,rich and easy-to-use layout tools,complete system and meeting the requirements of operators in accordance with international standards.Firstly,according to the construction plan of large data platform proposed by operators in 2018,this paper introduces in detail the reconstruction project through the construction of network crawler,HBase cluster,stream computing engine,search engine,data govermance,data mining,graph database and other modules,enriching data acquisition means,improving data city-state and optimizing design.Computation and query efficiency,deep management of data,so as to mine the value of organizational data;improve and realize big data on the platform architecture;secondly,refer to and follow the "China Mobile Enterprise-level Provincial Big Data Platform Technical Specification" content,in accordance with the "platform+Tools+services" model,"integration,layered and open" thinking;and enhance the number.According to the unified support of internal and external departments,diverse and flexible large data sharing and application service needs,it provides strong support for operators' various departments'flexible large data sharing,application and service;secondly,in business,it realizes user behavior analysis,explores user relationship map,and ultimately through systematic organizational data governance.Provide strong support for business analysis and digital transformation of operators.The innovation of this paper lies in using the most popular technology framework in the industry,combing the three-domain data applications of operators O/B/M,especially the specialized operation of local voice,data,IDD and international roaming business in Hong Kong,to provide innovative and diversified communication services for enterprises.Through the integration and opening of data,it can constantly stimulate huge commercial value and incubate unlimited possibilities of innovation.Combining with new technologies such as artificial intelligence and machine learning,the platform uses resources,data and tool service capabilities to encapsulate,so that data drives business innovation of operators.It also provides a strong guarantee for the construction of network intelligent support system and agile management support system,and is also a booster for the future company's digital transformation.