Research On Natural Gesture Interaction Technology Based On Leap Motion In Industrial Robot Teaching

Human-Computer Interaction(HCI)is a technology for the study of human and system and their interaction.The purpose of the study is to use all possible information channels for Human-to-Computer Communication.To improve the naturalness and efficiency of interaction.The robot has been integrated into our lives,Natural Human Computer interaction research is significance.Natural Human Computer will give us a more direct and effective to Communication with the robot,people and robot communication such as communication between people and nature as directly.This paper presents an Intelligent Iuman-Computer Interaction model for robot the research aims at a more natural way of human-computer interaction.(1)This paper analyzed the advantages of hand gesture interaction in natural human-computer interaction in comparison with other interactive methods,solve the problem of higher threshold of traditional robot teaching,and use natural gestures to perform the actions of grasping,moving,placing and so on.Research on gesture interaction is of great significance for interaction design and user behavior research.(2)To analyze the interactive demand in gesture teaching interaction.A hand gesture interaction design method based on mental model is proposed,which makes full use of gestures to express the characteristics of rich information.By using LeapMotion to obtain gestures data and to establish the principle according to gesture gesture in the subject,6 gestures are designed for robots.(3)A set of teaching gesture interaction model is designed for the handling of industrial robots,and six gesture teaching actions are set.(4)The KNN clustering algorithm is used to classify the gestures of teaching gestures.The success rate of the gesture classification is 96%.The dynamic mapping method is used to map the gestures to industrial robots,and the flexible control of the industrial robot is realized by the teaching gesture.(5)In the part of gestures teaching practice,the project uses Leap Motion and Industrial Robot to build a gesture teaching platform,and designs three experimental rival potential teaching platforms for testing and evaluation,which are gestural interactive user experience test,gesture teaching actual case experiment,and teaching interactive contrast experiment.The interactive system in the subject shows a good performance in the actual test results,especially in the interaction between teaching and the learning efficiency of the instructor.It proves that the interactive design method based on mental information can effectively guide the design of gesture teaching interactive system.