Design Of Vehicle Robot Control System Based On Leap Motion Gesture Recognition

As a practical type of robot,the robotic arm is widely used in manufacturing,transportation,and other fields for its extremely high work efficiency and stable repeatability.With the rapid development of human-computer interaction,the original ecological interaction represented by somatosensory interaction has begun to receive widespread attention.The development of various types of somatosensory devices has also made the joint research of somatosensory interaction technology and robotics a cutting-edge topic.This thesis designs a dynamic gesture recognition robotic arm control system built on an omnidirectional sports car body.The Leap Motion sensor is used to capture gestures.The processing of the handy feature values and the processing of the data are performed through the PC software Processing.The data is transmitted to the Arduino control board of the lower computer through WiFi,thereby realizing the gesture control of the robot arm.The robot arm is set up on a mobile body with a camera remotely controlled by a Windows tablet,so that a remote crawling task can be realized.The main works of this article are:(1)Structural design and hardware selection.Through the analysis of the functional requirements of the system,relevant indicators are drawn,the design scheme of the robot arm and the omnidirectional vehicle body is determined,and the kinematics analysis and hardware module selection are performed on the basis of meeting the design requirements.(2)Establishment of a gesture model.In combination with the five-degrees-offreedom structure of the robotic arm,Leap Motion's hand feature extraction technology was used to design five dynamic gestures corresponding to a single hand to achieve flexible control of the robotic arm.(3)Programming.In the Processing and VS2013 software,the upper computer control software for the gesture recognition robot and the omnidirectional vehicle body was written respectively.The lower computer controlled the servo and the motor through Arduino programming.(4)Assembly and testing.On the basis of the completion of the system hardware and software design,the robot arm and the omni-directional sports car body were assembled and tested separately,and the performance and performance index requirements were basically achieved.The vehicle-mounted robotic arm control system based on Leap Motion gesture recognition has the advantages of lower equipment cost,flexible and convenient control,and the ability to reach more complex and dangerous environments to complete the grabbing task.It has good application prospects in medical applications,military investigations,home applications,education and scientific research.