Data Collection And Modeling Of Enterprise Data Center

This system is a design and implementation of data acquisition and modeling part of a mobile data center.The data center includes the mining layer,the data service layer,the application service layer and the access layer.In this paper,the construction of the mining layer and the data service layer is discussed.The data in this system is divided into structured and unstructured data,in which structured data is stored in GBASE database,unstructured data is stored in HADOOP environment,the data scale at the PB level,build relatively low price distributed environment Storage and calculation.Development of the use of OCDP large data development platform,data storage using HADOOP and GBASE database,process control using BDPE tools for configuration management.Data center access to move the three major business support system data,will be scattered in the business system of different databases,different formats,different types of data according to the business type is divided into 7 major domain data,through a unified data interface to the data center,Mobile company's existing business needs,the data abstracted as close to the business needs of the data model to achieve the upper application development and the underlying data separation,simplify the application developers to develop the program more difficult.This paper introduces the development of data acquisition layer and data service layer,and the data acquisition layer implements the access of different source data.The data service layer abstracts the data into the data model close to the service and provides the data service for the upper application.