The Research On Data Processing Cloud Platform Of Large Open Style Wharf Mooring Monitoring System

Along with the increasing development of international communication, the navigation of world is also booming, coupled with the economic taken off of China, the harbors modern level is getting higher and higher. Our country has long coastline and the coastal line condition is complex, so the mooring safety is very important. The wharf mooring monitoring system can ensure the safety of the mooring working, but this system will generate a large scale of information, it’s difficult to storage and analysis these mass information, besides every wharf has different information format, so it’s difficult to share these information and analysis. With the rapid development of cloud computing, provides an effective solution for the above problem.This paper focuses on how to design data processing cloud platform of wharf mooring monitoring system to do the following works:First a thorough research to the feasibility of the wharf mooring monitoring system cloud platform has been made, and analysised the architectural principles of Hadoop, HBase, Hive, including HDFS, MapReduce computing method, the API of HBase, the HQL of hive. Build an excellent performance cloud platform based on understanding the theory of cloud computing.The operation flow of wharf mooring monitoring system and the theory of cloud computing system have deeply researched. For the problem of large amount of information generated by wharf mooring monitoring system, saving the information into distributed database HBase, not only improve the data storage capacity, and ensure the safety of data. For the problem of low efficiency in accessing to the database, use the memcache technology to upload the information periodicity. In order to solve the problem of Hive and HBase table structure heterogeneous, desige the table in the HBase which the Hive can recognize too. Developed the Web system based on the J2EE architecture to communicate with the cloud computing platform, provides massive real-time monitoring data query, monitoring data analysis, mining, and other functions after the cloud computing platform established successfully. Finally, use the Apache Ambari to monitor the cloud platform running state, so that to optimized the cloud computing platform.In this paper, the design of the wharf mooring monitoring system data processing cloud platform is the effective solution to the problem of large-scale monitoring data storage and monitoring data isolated problem, after simulation tests prove that the wharf mooring monitoring system data processing cloud platform has a good application value and economic value.