Research On Unmanned Aerial Vehicle Control System Based On A Portable Electrooculography Acquisition Device And Hybrid Brain-Computer Interface

In the brain-computer interface(BCI) control system,the electroencephalogram(EEG)signal has become a hot spot in BCI application research due to its characteristics of stability,safety and easy acquisition.Hybrid brain-computer interface(h BCI)is an interactive technology that combines EEG with other physiological signals for hybrid control,which include electrooculogram(EOG)signals,electromyography signals,etc.Hybrid braincomputer interface makes up for the shortcomings of traditional brain-computer interfaces in response time,control command diversity,etc.In recent years,due to the rapid development of flight control technology,unmanned aerial vehicle(UAV)has been widely used in agriculture,civil engineering and military fields.Nowadays,the control of UAV is still dominated by traditional manual control.In order to explore a new and promising method for controlling the UAV,this paper studies the UAV control system based on on portable EOG acquisition device and hybrid brain-computer interface.Design online and offline experimental paradigms,and analyze the feasibility and performance indicators of the system through experiments..The main work is as follows:(1)Based on the open source flight control platform,full research has been conducted on the flying principles,attitude calculation and control methods of UAVs.At the same time,according to the characteristics of the system,a wireless communication protocol between the PC and the UAV is designed,and the remote control of the UAV is realized through the wireless transceiver module and the upper computer software.(2)A portable electrooculography(EOG) acquisition device was designed,and an EOG-based UAV control system was built on the basis of this device.The device is divided into two parts: A collecting headband is worn on the forehead to collect EOG signals,and a receiver is connected to a PC for data forwarding.The two parts communicate via Bluetooth Low Energy(BLE).Compared with the traditional EOG collection method,it is lighter and easier to operate.Through the drone control software on the PC side,the user can follow the stimulus interface to blink simultaneously to issue a variety of control commands to the drone,thereby realizing the hands-off control of the drone.(3)Construct a hybrid brain-computer interface that combines motor imagery(MI)potentials in EEG and EOG,and build a drone control system on this basis.Motor imagination potential is a spontaneous EEG,with fast response speed and strong adjustability,and can output continuous control commands through uninterrupted motor imagination behavior.Design online and offline experimental paradigms,and prove through experiments that combining the two signals to perform hybrid control of the UAV has better response speed and real-time performance than the EOG control method.Finally,a number of subjects participated in drone control experiments,including EOG UAV control experiments based on self-developed portable EOG acquisition devices,and h BCI UAV control experiments based on Nu Amps EEG amplifier equipment.Through the discussion and analysis of the experimental results,the feasibility and reliability of the system are verified.