Design Of Human-computer Interaction System For Collaborative Robot Based On Gesture Recognition

With the development of human-computer interaction technology and the deepening of research in the fields of ergonomics and user experience research,people are increasingly demanding the usability and ease the robots.Gesture understanding for human-computer interaction has become an important research content of human-computer interaction technology.At present,most of the solutions for gesture recognition have problems,such as the accuracy is low and the usage scene is limited,they can't actually be applied for the collaborative robot.This paper use Python,establishes a set of gesture language library for collaborative robots to complete assembly work,and completed the gesture recognition human-computer interaction system of collaborative robots.Based on the Kinect to collect the depth image of the body,completed "static gesture recognition and dynamic gesture recognition algorithm".Among them,the threshold-based gesture segmentation algorithm segmentation of the hand-held image,extracting the feature information of the gesture-related operation;meanwhile,based on K-curvature detects the number of finger points in the hand and determines the type of gesture.Based on the HMM-NBC model,the dynamic gesture recognition method uses the obtained a large number of gesture image features and motion trajectory features to train the HMM model,completed dynamic gesture classification through NBC classifier,and completed the addition and input of gestures(semantics),features.According to the process requirements of the assembled gear pump,designed the corresponding gestures,the system is docked with the collaborative robot,and completed a workstation platform for human-machine collaborative assembly.The experimental results show that the gesture interaction system can realize the cooperative operation of the gear pump man-machine of the cooperative robot.The single motion recognition rate reaches more than 90%,and realizes the gesture recognition problem of the cooperative robot based on the Kinect platform.The "gesture(sign language)recognition scheme" implemented in this paper has practical significance for a kind of cooperative robot to realize human-computer interaction through gestures.