Based On Massive Data Storage And Real-Time Events Found System Design And Implementation

With the shipping industry toward large-scale, systematic development,Digital management becomes an inevitable trend. Provide users with accurate and efficient data services to become one of the main objectives of the shipping platform. However,in domestic,the research of shipping with digital is lagging behind the international advanced level. The use of AIS data is still in the level of providing raw data inquiry In this case, an urgent need to develop a real-time AIS data system to find the events behind the data. And then,by shipping platform,Event information is sent to users concerned with these events.Huge amounts of data that is large, or super large amounts of data. Since size is a relative concept,Therefore, the definition of mass data storage of data is on hardware performance,Calculation speed of data processing of the equipment,and the performance of software which built on the equipment. AIS data of this paper is a massive data, As the special nature of the amount of data, in data storage and provision of I/O services field,the use of traditional relational database revealed many problems. Therefore,this paper based on netCDF formate to build AIS data storage is a useful attempt.1. First studied the mass data storage. Based on the current popular open source database MySQL. Including the research of the mainstream MySQL storage engine, and to do the I/O performance test under the conditions of the massive data.2. We studied the netCDF data format, and in-depth studied the physical model of storage with the netCDF data format.3. According to the study of netCDF data format,we constructed function library which is used to store AIS data.4. We designd and implementated AIS real-time data storage system based on the netCDF function library.5. We studied the AIS data,and constructed the sailing event model that can be calculated from the AIS data. Finally, based on the event model, we designed and implemented the event discovery engine, and applied to the actual project.