Vehicle Music System Control Based On Visual Gesture Recognition

With the rise and development of the Internet of things,the feature direction of the Car Entertainment System will be more efficient,more natural and more humane.The research of the Controlling car music system base on the visual gesture is to comply with this trend,and the result is considerable.The main study in this paper is using visual gesture to control the way of the car music player,including the recognition of the visual gesture and the design of the car music system.In the visual gesture recognition part,first of all,the gesture image captured by the camera is segmented with YCrCb color space,and the segmented image will followed by the method of the image binary,morphological processing and median filter processing,Secondly using the maximum contour area method to remove the impurity of the skin color in the gesture image,innovatively proposed and applied the inscribed circle algorithm to cut the arm of the gesture image.Thus a complete gesture binary image binary is obtained.Thirdly,Using two algorithms to recognize the static gesture,one is based on the geometric topological structure and the other is based on the combination of the feed-forward neural network and Hu moments.In the hand gesture samples used in this paper,the recognition rate is up to 93%.Finally,To recognize the dynamic gesture with different frame rates images by the center of gravity offset method.In the car music system design part,first of all,using the ARM Cortex A9's i.MX6 Quad development board from Freescale Semiconductor company as the hardware platform for the car music system;Secondly,transplanting the Yocto project into the development board;Thirdly,building the sorftware environment of the car music system in the host Ubuntu 14.04;Finally,developing the car music controlled based on the gesture software in Qt,which is combined both with the gesture recognition module and the car music module,and using the Qt signal and the slot mechanism to achieve the communication of the two modules,therefore using gestures to control music playback can become possible.At last,using the cross-compilation tool meta-toolchain-qt5 of the Yocto project to compile the whole project of the car music gesture control in the host,the compiled executable file and the related documents are transferred to the i.MX6 Quad development board via the SSH command and the executable file is run in the i.MX6 Quad board.Such a car music system controlled by visual gesture is successfully developed,and realizing the functions that using both the static gesture and dynamic gesture to control the car music to start,stop,increase the volume,reduce the volume,switch to the last song and switch to the next song.