| With the rapid development of mobile Internet, the explosive growth of data, the data have become important and natural resources, human resources, strategic resources, the ability to control data resources is a manifestation of national digital sovereignty. Research and application of big data is an important driving force of the rise of the modern industrial upgrading and new industry, if the backward means lost the commanding heights of the strategic emerging industries. Big Data also are triggering a revolution in scientific thinking and research methods. Geological work is a national economic and social development of the necessary basic, advance work, and geological data are results of the work of geologists experienced hardships obtained an important manifestation. Geological data is a major component of geological information. For national economic construction and social sustainable development is also very important basic information resources.Based on this, the Ministry Key Laboratory of Geological IT and Business Characteristics based on geological data, geological data to design and build a platform for big data technology to explore and research in geology industry applications. In this paper, combining with the characteristics of geological data and laboratory existing hardware resources, design and build based on laboratory data of Oracle architecture environment. The big data platform into the overall framework:Facilities layer, the platform layer and the service layer, which provide hardware virtualization, databases, Web services platforms and high availability features. According to another specific services and functions into hardware virtualization unit (Oracle VM) database high availability environment unit (Oracle RAC) spatial information management environment unit (Oracle Spitial) Hadoop (HDFS/NoSQL) Network Application Services unit (WebLogic) spatial data release service Unit (MapBuilder). The main research work is as follows:(1) Studied on the Openfiler open source storage software, from the bottom division of storage space on the storage, installation and deployment of Oracle VM virtualization management software, making full use of existing hardware resources.(2) Research between structured databases (Oracle) and unstructured databases (Hadoop) emplaced large data connector to solve seamless integration of structured and unstructured data. (3) Research ORACLE SPATIAL spatial data engine to solve the storage, management, and analysis of the problem of geological spatial data.(4) Separately from the load balancing two research platform application systems, one using Oracle RAC and Oracle ASM storage layer load balancing platform, and second, the deployment of a cluster of Web Logic triage service requests on the Web application server, thus ensuring high system load under normal operation.(5) Research and deployment of Hadoop open source software, using HDFS and MapReduce mechanism, distributed storage and computing mining geological data(6) Research "smart gateway content management system" to solve the large amount of data of geological information access efficiency, which can automatically adapt to manage content types to block reads the stored content, allowing users to preview the first time you want to check the contents.Finally,in order for big data technologies more fully understood, but also to the geological information work experience, the more a test platform for big data management and computing capabilities. Access from unstructured content Web, remote sensing data sharing and management of large data mining geology three aspects do applied research.From the three applications, we can conclude that the platform has structured, unstructured data management and organizational skills as well as large-scale spatial data, with high availability, high responsiveness, have distributed, parallel processing computing power, the ability to live migration and disaster recovery. |
PDF Full Text Request