Research On Logistics Waybills Data Application System Based On Hadoop Big Data Platform

In recent years,the development of China’s logistics industry is changing with each passing day,a large number of logistics enterprises have emerged,the number of express waybills has shown an explosive growth trend,logistics data is an important basis for running through the logistics and transportation process,while having a high data value.In the face of massive logistics waybills,the use of traditional relational database storage has problems such as capacity and efficiency.Big data technology has been widely used in the fields of transportation,meteorological forecasting and e-commerce,and the big data technology is applied to logistics to achieve the storage and rapid retrieval of massive logistics surface sheet data.It has good theoretical research and practical application value for improving the efficiency of logistics transportation and tapping the potential value of logistics data.This paper explores and studies the logistics face sheet data application system based on the Hadoop data platform,including the construction of the Hadoop data platform,using HBase to store logistics face sheet data;since HBase itself only supports primary key indexing,this paper provides logistics surface sheet data retrieval function based on Elastic Search,which can support mobile phone number,waybill number,address information and other retrieval methods.By subdividing the data collection and upload process of logistics face sheet,this paper divides the data collection process of logistics face sheet into multiple modules such as data access,bar code recognition,HBase reading and writing,ES retrieval,etc.,and builds a logistics waybill data collection back-end system based on the Spring Boot framework in the form of microservices.This paper organically integrates the Hadoop data platform and the logistics waybill data collection back-end system,provides the collection,storage and retrieval of logistics waybill data and other functions.Through the joint commissioning test of the system,the system runs stably and meets the expected relevant design standards.This paper combines big data,full context search and other related technologies with the traditional logistics and transportation industry,explores and studies the storage and retrieval schemes of massive waybill data,provides a feasible reference scheme for the development of data storage and software in the logistics industry,and has a certain role in promoting the scientific research work related to the logistics industry.