Research On Indexing Technology Of Traffic Flow Data In Cloud Environment

With the development of information technology,the amount of data is increasing exponentially in many fields such as e-commerce,social network,Internet of Things,scientific computing,data mining and so on.Human has stepped into the era of large data.The rapid growth of data has brought great challenges to the traditional relational database,which makes the traditional database have bottleneck in the aspects of expansibility,fault tolerance and high efficiency.And cloud computing technology to rely on its own advantages,a large-scale data management and effective technology.However,the current cloud data management system also has some shortcomings,because of the lack of indexing,view and other mechanisms,so for multi-dimensional query,join and other operations were weak,which limits its application in many ways,resulting in these processing methods can not Very suitable for massive data in the context of demand.Based on the research of the existing cloud data management system,this paper puts forward some new ideas and solutions,the main research work is as follows:(1)With the background of large traffic data and the storage characteristics of HBase,a storage and query model of mobile objects with spatial and temporal attributes in HBase is designed.In this model,the space-time attribute is encoded as rowkey,and the inverted index structure is used to store the encoded object.Then,the HBase table is designed.Finally,several query states are given and the algorithm is given.(2)In order to improve the query speed of mobile objects in the cloud data management system,it is found that there is a common drawback of these models to index each data by summarizing and comparing the existing cloud data management index structures.Resulting in relatively low data query efficiency.To solve this problem,a new classification index TA-index based on time and space is proposed.This method can solve the real-time query problem of data flow and improve the query efficiency of traffic flow data by the way of data rule partitioning,thus improving the above.(3)This paper designs and implements an intelligent traffic analysis system(ITAS)based on the framework of Spark Streaming,cloud data management system HBase and traffic flow data.This paper presents the modeling of moving object,and combines the analysis data of the open map function display system.The design of the system design,system architecture,the design and implementation of various modules to do a detailed introduction.