Research On KVM System With USB Redirection And Intelligent Analysis

KVM(Keyboard Video Mouse)technology can support one or more users to simultaneously manage multiple remote controlled computers connected to the KVM system,enabling simultaneous access and operation of multiple controlled computers with a set of keyboard,display and mouse devices.Although there are many kinds of KVM products on the market,for some specific application scenarios,few products can provide relatively complete functions to meet a variety of application requirements.The more critical function is to perform real-time intelligent analysis on video screen content and redirection of HID class and mass storage class USB devices.At present,domestic research on this type of KVM system is relatively lacking.This paper studies and designs a KVM system with USB redirection and intelligent analysis.The main work of this paper includes:Firstly,the USB redirection scheme and intelligent analysis method are demonstrated,and the embedded end encoding board + PC end decoding system architecture and FPGA+Hi3519 embedded end encoding board architecture are proposed,respectively.Secondly,the embedded end coding board hardware platform is designed.Subsequently,the training and test data sets are established to verify the feasibility of the neural network-based intelligent analysis algorithm,and the weight matrix under the optimal effect is obtained.After that,the FPGA logic architecture and each functional module are designed to realize the functions of HDMI/DVI receiving and transmitter configuration,video interface timing adaptation,intelligent analysis,etc.,and behavior simulation and timing simulation for FPGA logic design are performed.Finally,based on the Haisi mpp programming framework,the audio and video encoding program is designed.The server program is designed based on KVM communication protocol.The USB redirection program is designed based on STM32 USB driver.The data structure management and multi-thread synchronization technology are used to implement the audio and video encoding transmission and USB redirection.The test platform is built to test the function and performance of the KVM system.The experimental test results show that the average video delay is 130 ms and the audio delay is 70 ms.The typical rate of U disk redirection is 42.4KByte/s,and the intelligent analysis image recognition rate is 0.72.The intelligent analysis function of the KVM system studied in this paper can save labor cost and improve the processing efficiency of sudden situation on a large scale.USB redirection function changes the inconvenient data interaction between the remote controlled computer and the local U disk device.Therefore,the research results of this paper have certain reference value for the development of high performance KVM system.