Design And Implementation Of Traffic Big Data Intelligent Monitoring System Based On Ambari

With the rapid development of the national economy and the continuous improvement of urbanization,the number of motor vehicles in China has grown exponentially.The car ownership is growing rapidly,the utilization rate of expressways is getting higher and higher,and the traffic congestion,traffic accidents and highway evasion incidents are increasing frequently.How to make traffic travel efficiency and safety based on big data technology? Promotion is a research topic of great application value.Traffic big data has the characteristics of multi-source heterogeneous data,complex types and high real-time requirements.The traditional single-center relational database technology processing method can not meet the needs of the current stage,and based on this,the subject is based on Ambari technology.Smart traffic big data monitoring platform to improve the ability of intelligent traffic supervision and utilization of traffic big data resources.Firstly,it analyzes the status quo and major problems of big data application in smart transportation,and combs the functional composition of the proposed platform.Then,it combines traffic big data with the characteristics of complex traffic data structure,large data volume and high real-time requirements.The overall architecture and database model of the intelligent traffic big data monitoring platform were designed according to the application scenarios of acquisition,cleaning,classification,storage and processing.Next,based on Ambari technology,the intelligent traffic big data intelligent monitoring system was implemented to carry out traffic big data.Efficient aggregation and intelligent analysis,display the operation status of the big data platform through the management and monitoring interface of big data visualization,effectively improve the level of intelligent traffic monitoring and the ability to identify abnormal traffic behaviors;finally,perform functional tests on system functions in combination with actual application scenarios.And performance testing to verify and optimize platform functionality.The platform design absorbs the advanced ideas of the current mainstream big data platform construction.Based on the mature open source underlying framework,the service components are encapsulated in the upper layer,and the upgrade and update of the underlying framework are adapted to the minimum changes,thereby ensuring the stability and high availability of the overall framework.Using data fusion,cloud computing,cloud storage,and other technologies,combined with the data characteristics of the transportation field,the secondary development of open source components,independent development to increase the system's maximum support for the unique characteristics of the transportation field,to maximize the traffic Data collection,monitoring,and analysis requirements can be effectively improved in terms of system functionality,robustness,and stability.Combine the Ambari Metrics System for indicator collection,storage and application,and provide system administrators with many convenient service functions such as cluster creation,management,monitoring and upgrade,as well as providing various services and host related indicators to achieve judgment.The purpose of the cluster health situation.Generally speaking,the traffic big data intelligent monitoring system developed by this project is in good condition.At present,it has been piloted by several smart transportation application enterprises in North China,and the intelligent monitoring level of traffic big data and the higher-level application of smart data driven by big data.Laid a good foundation.