The Design And Implementation Of The Traffic Data Management Platform Based On HBase

With the development of economic, the number of vehicle has grown rapidly, resulting in serious transportation traffic and increase of traffic accidents and related crime. Accordingly, the public security and traffic management departments have introduced a large number of intelligent gathering equipment to record the tracking information of each vehicle. However, on the one hand, the amount of data has increased rapidly due to the increase of number of gathering equipment and the increase of pixels of the captured image, bring great challenge to the capability of data access, data storage and data analysis of the system. On the other hand, taking advantage of the huge amount and variety of data can bring great social and economic benefits. With these challenges and demands, we propose to build new traffic data management platform, utilizing the popular big data technology.To solve the problem faced, we do some research on the distributed file system, NoSQL databases, disk arrays, distributed batch framework, distributed stream processing framework, distributed message queues, and other related technologies. Based on these, we conduct deep analysis of the user demand, and propose a distributed architecture based on HBase. In more detail, we use a distributed file system named HDFS to store unstructured data such as pictures and videos, and use HBase to store structured data. We then utilize a distributed computing framework to analyze the data in HBase, and we use a distributed message queue as the middleware to pass on system message, which is a good solution for massive data access, storage, query, and analysis.Following the basic principle of software engineering, after user demand analysis and the above-mentioned framework design, we continue to complete the detailed architecture and functionality design, and the implementation and testing of the software, and then use the system in the actual environment. In our implementation, the system utilizes the MVC software architecture, Java Web-related technologies and frameworks, achieving low coupling between modules and high cohesion within the module to ensure the good structure of the code and stability of the system.