The Design And Implementation Of Big Data Platform For Logistics Information

With the continuous improvement of logistics informationization,logistics information has begun to reflect the characteristics of large data volume,high real-time,heterogeneous data types.The traditional single-machine and structured logistics information system used by logistics enterprises has not been optimized and improved for these new characteristics of logistics information.Whether logistics information can be efficiently processed will affect the competitiveness of logistics enterprises and thus affect the development of the whole logistics field,so there are extensive studies in the relevant topics in industry and academia.However,there are still some deficiencies in real-time computing,platform management,data acquisition and other aspects of the related platform,so the study of this paper is necessary.The main work and innovation of this paper are as follows:(1)This paper analyses the related functional and non-functional requirements of the big data platform for logistics information,studies the important framework technologies related to the platform,and forms the idea of solving the platform requirements according to the requirements and research framework technologies,mainly including real-time data processing solutions,micro-service big data service management system and data access mechanism.The design and implementation of the platform are introduced.(2)The overall framework of the platform is designed according to the idea of demand solving.It is emphasized that the platform is composed of big data infrastructure system and big data service management system.The big data infrastructure system is expanded and integrated by the big data framework technology,and the micro-serviced big data service management system is innovatively designed to provide the platform with visualization,log service and unified data access functions.According to the idea,the authentication strategy,data access strategy,data caching strategy,log strategy,monitoring strategy and disaster recovery strategy are designed from the platform level.(3)Design and implement the big data base system.The design of real-time data processing solution for logistics information is emphasized.The scheme collects logistics information data by data aggregation module,transfers the message flow to message middleware after aggregation,and then distributes the flow to real-time computing framework to realize real-time computing.(4)Design and implement the big data service management system.The data access module in the big data service management system realizes the platform data access mechanism and caching mechanism,the visualization module realizes the platform visualization function,the log service realizes the log mechanism and the Web two-tier verification function.(5)The function of the platform is verified to be practical through the test of each functional module.The performance test includes the real-time data processing,off-line data processing and data access module of the platform.The application process of vehicle information monitoring,vehicle routing planning and logistics demand forecasting on the platform is listed.Compared with the related platforms,the platform presented in this paper has the richness of functions,the stability and security of the platform and advanced technologies.