Design And Implementation Of Intelligent Cockpit Interactive System For Intelligent Networked Vehicle

With the rapid development of intelligent connected vehicle technology,people’s demand for cars is getting higher and higher.They are no longer satisfied with simple transportation tools,but hope that cars can bring them more rich and comfortable experiences.Many car manufacturers have proposed interaction systems with large screens and fewer physical buttons.However,the actual feedback effect of virtual buttons on the large screen is not ideal,and the different positions of controls on the screen increase the driver’s operational difficulty and learning cost.In addition,frequent operation of virtual buttons on the large screen will also distract the driver’s attention and increase driving risk.This paper proposes an intelligent connected vehicle interaction system based on gesture recognition technology.The system uses a camera to capture the driver’s hand gestures,quickly locates and obtains the gesture semantics through edge computing technology,and then controls the car or meets multimedia service requirements.Compared with traditional physical buttons and virtual buttons integrated on large screens,this system has the advantages of convenience,accuracy,speed,and simplicity.It reduces driving risk while not distracting the driver’s attention.The proposal of this interaction system is to provide drivers with a more comfortable and enjoyable driving experience.Firstly,this article proposes the overall structure and design of the car interaction system,which is divided into three parts: hardware design,algorithm design,and software design.In terms of system requirement analysis,the Horizon company’s AI chip(Sunrise 3)was chosen as the inference chip for this design,and the algorithm and software were selected and designed accordingly.Then,this paragraph describes the design of the car interaction system in terms of hardware,algorithm,and software.Specifically,for the AI chip’s characteristics and application requirements,the author designed a series of peripheral circuits and signal acquisition circuits,including power modules,communication modules,and interface circuits,to provide the foundation for the efficient operation of the system.For algorithm design,the author used a detection network and a classification network to improve accuracy and response speed,and addressed the low recognition rate issue under low image contrast by adding a night-time dataset and proposing an image pre-processing algorithm to improve stability and robustness.In software design,the author deployed the two networks to the chip end using a development toolchain,designed a customizable gesture recognition method,an IPC communication protocol to protect data transmission security,and a scheduling module to coordinate the smooth operation of multiple image acquisitions and inferences,all of which provide reliable guarantees for the stable operation of the interaction system.Finally,this paper conducted a comprehensive functional test on the entire interactive system,verifying the correctness of the system and successfully implementing the gesture-based interaction system with efficient,stable,and reliable operation.This system provides drivers with safer,more reliable,comfortable,and enjoyable driving services,and has broad application prospects.