Storage And Acess Service Of Spatial Data Based On Hypertable

Data mining, a hot research field in many enterprises and research institutes, is developing quickly. And the massive data access service is one branch of the many popular data mining research issues. Dealing with massive data divides into two aspects:data storage and data analysis for data management staffs. In the field of massive data storage management and analysis, all of the staffs focus on how to deal with the massive data efficiently and confirm security, reliability, consistency and completeness at the same time. Distributed data storage management system, a mass data storage management system new favorite, gets much attention from everyone. Although the spatial data dealing is a field who usually deals with massive data, distributed data storage management system is new to spatial data dealing. Therefore, this paper mainly analyze the efficiency of three distributed storage management systems on storing, calculating, service procedure of shipping information management data.Meanwhile this paper introduces Hypertable, an open source distributed data storage management system of Google Bigtable, several Google technology components, row storage mode and column storage mode. Row storage mode is used to design port monitor of the shipping information management system. Split the frequent query part out of the shipping information management system because of inefficiency of row storage mode. The final design of system is Hypertable+MySQL+SQLite. The mainly work of this paper is here:1) Introduce Google File System and chubby. Analyze the technical architecture of distributed data storage system.2) Analyze the advantage and disadvantage of row storage mode and column storage mode.3) Design the shipping information management system. Design AIS data storage system and shipping event calculation algorithm.