| In recent years,with the rapid development of industrial automation,more and more warehouses use robots to monitor and supervise the goods,of which real-time streaming media system is one of the important components.More and more modern warehouses began to use multi-position fixed-point camera and mobile robot assisted monitoring means of remote monitoring of the warehouse.However,in the warehouse environment,the size of wireless transmission bandwidth used by mobile robots is limited,and the clarity and real-time performance of streaming media are usually limited to the real-time performance of streaming media system.So it is of great practical value to research and design a remote mobile monitoring system with high efficiency and stability and good interactive performance.This paper focuses on the research of streaming media transmission technology of mobile robots in indoor warehouse scene,and analyzes the encoding and decoding technology and network transmission technology in streaming media transmission,designs the logic and process of streaming media transmission.Besides,Based on the mobile platform of Android platform,a mobile remote monitoring system is designed and implemented.The main results are as follows:(1)Design and implement a real-time streaming media-based remote monitoring system,including video capture terminal,streaming media service and mobile monitoring client.The system supports high-definition IP cameras and intelligent mobile devices as streaming media input,and supports multi-user video surveillance,remote robot mobile control,realtime information exchange and other functions.(2)A hybrid transmission scheme of panoramic video and ordinary video streaming based on RTMP protocol is proposed.By separating the video data and distributing it through different transmission strategies,the system realizes the clear and stable characteristics of the panoramic video data and low-data real-time interactive streaming video streaming data with low latency.(3)Design and implement mobile monitoring terminal based on FFmpeg decoding library.The decoder uses the JNI(Java Native Interface)to improve the efficiency of decoding playback.The monitoring terminal has designed the multi-level buffering and playback optimization strategy of streaming media reception,which improves the quality and real-time of the monitoring picture.(4)Remote monitoring client added remote control,real-time information exchange,monitoring channel switching and other auxiliary functions.By studying the usual instruction prediction model and using the three-level instruction detection scheme,a remote control subsystem with good interactive experience is designed and realized.The simulation results show that the system can transmit the panoramic video and audio stream with the bit rate up to 4mbps and the interactive audio and video stream with the transmission delay less than 500 ms,which can meet the performance requirements of indoor monitoring of most mobile robots in a normal wireless network coverage. |