The Design And Implementation Of Data Sharing System For China Mobile

As the largest communication operator in China,China Mobile has accumulated huge amounts of data with great value during its decades of operation.In order to support the development of provincial and local subsidiaries,China Mobile Group Corporation commissioned Huawei to build a big data PaaS cloud platform.Provincial companies,subsidiaries and third-party vendors can enter the China Mobile Big Data platform and apply for resources and custom tools in the platform.However,due to the isolation of platform tenant resources,data cannot be transferred between tenants.There are also problems such as heterogeneous data sources of different tenants,data dispersion and redundancy between data systems,and difficulty in obtaining cross-domain data in data mining applications.Direct access to individual data sources is heavy workload and difficult to coordinate.To this end,building China Mobile's data sharing system to prepare the basic conditions for data mining for tenants becomes a problem that must be solved in advance to bring into play the value of data.Based on the analysis of China Mobile s data status,this thesis proposes two main challenges in building China Mobile's data sharing system:(1)Heterogeneous data sources integration challenges.(2)Data sharing problems.And this thesis gives a solution to the problems.By designing data access interface specifications,heterogeneous data sources are docked to achieve heterogeneous data sources integration.Data sharing is achieved by publishing data and subscribing to data.At the same time of data sharing,low coupling and high scalability are achieved.The thesis expounds the background of the project,briefly describes the current research and application status,and reviews related technologies including Docker,Kubernetes,Spring Boot,RBAC,Apache Shiro and so on.This thesis briefly describes the overall planning of the system,defines the system boundary,analyzes the system requirements in detail,and extracts the five functions of data source access,data source service management,data product management,order management,and rights management.On this basis,the system design idea and working principle are expounded.The system is designed through system architecture design,functional component design,system deployment design,and system database design.The five functional modules of data source access,data source service management,data product management,order management,and rights management are designed in detail,and the specific implementation details are given,and the system test is carried out.The system has been online,which has better realized the data sharing of multiple heterogeneous data sources of China Mobile by multiple modes,and prepared the basic conditions for mining data value.The feedback is good after actually use by users.