Design And Implementation Of The HBase Based Flight Real-time Tracking System

With the increasing of aviation management data,the traditional Mysql and Oracle relationship database are unable to meet the increasing demands of aviation management data,the emergence of HBase-based big data technology has provided us with a solid guarantee for massive aviation management data.In combination with the urgent demand to check flight information timely and accurately for aviation managers any time and any where.it is necessary to establish a system that can provide professional,accurate and real-time flight information query.Therefore,the author designed and implemented this HBase-based flight real-time tracking system.This paper mainly studies how to use HBase-based big data technology to design a real-time flight tracking system.Based on the characteristics of HBase's massive data,we can import the data of various aviation management systems into the system and store them.Combined with the efficiency and security of the Geode distributed memory database,we can store hotspot data in Geode,which can improve the efficiency of data collection and processing,deploy data collection services according to geographical distribution,and improve the efficiency and concurrency of the data query service of this system.According to the ability of providing massive calculation by Spark distributed computing,we can put flight data statistics or other modules that require a lot of calculations into Spark.With Kylin's ability of supporting very large-scale data processing and efficient,large-concurrency data queries,we can query historical flight data.HBase,Geode,Spark,and Kylin have good cluster expansion capability and have good stability,even a small number of nodes' failure will not affect the operation of the entire system by using proper redundancy configuration.Moreover,these software based on big data technology can be deployed into virtual machines or ordinary PCs,which can effectively control the cost of deploying devices.Combining HBase,Geode,Spark,Kylin and other big data technologies in a scientific and rational way can provide an efficient,stable and secure data processing platform for our flight real-time tracking system.In this paper,the design and implementation process is described detailedly based on the design and implementation process of HBase-based flight real-time tracking system.According to HBase,Geode,Spark,Kylin and other big data technologies,based on the characteristics of modular design and cluster services,the system can provide with prefessional,accurate,real-time flight information query service and good stability,functional scalability and performance scalability.