The Research Of Real-time Data Analysis In Drilling Engineering Based On Hadoop

With the application of information technology in drilling industry,the drilling engineering data grows exponentially.The storage,analysis and use of the vast amounts of drilling engineering data become a hot issue in the current drilling engineering industry.Therefore,the thesis applies the Hadoop in drilling engineering to analyse and design a Hadoop-based real-time drilling data analysis system,which can provide a guidance program for the real-time operation in drilling engineering.Firstly,the thesis describes how to use HBase,a distributed storage system subproject of Hadoop ecosystem,to store the historical drilling engineering data.Then Sqoop and Map Reduce are used to solve the problem of the heterogeneous data importation.In order to improve the retrieval efficiency for the historical drilling data in the analysis process concordance list is created for the HBase database table with the technology of Map Reduce after analyzing the HBase storage characteristics.Then Map Reduce is utilized to integrate and analyze the search results from multiple index tables,and an optimization guidance scheme for real-time drilling engineering operation can be obtained.At last,the optimization guidance scheme that includes drilling optimization data,prediction data for drilling accident,diagnosis and treatment of drilling data,drilling track data and so on is uploaded to the system interface to guide the site operations.Compared with software of drilling engineering based on traditional database,the data analysis system of drilling engineering based on Hadoop has a more comprehensive analysis on multiple sources and distributional data to obtain more accurate annalysis result,and then provide better guidance for the drilling field operations.