Research On Human-computer Demand Interaction In Severely Paralyzed Patients Based On Affective Computing

In the current society,economic development makes people's living standards gradually increased.At the same time,car accidents and stroke caused by severe paralyzed patients also gradually increased.This will cause great damage to the patient's physical and psychological health.The treatment rehabilitation work of paralyzed patients will be a heavy burden to the family.Severe paralyzed patients have a special type: loss of language skills,loss of limb activity,but the brain consciousness is still awake and the patients still have the ability of head and eye mouth behave.According to a rough statistics from Shandong University of Traditional Chinese Medicine Hospital,these typepatients account for about 10% of the total number of patients with severe paralysis.If there is a way to obtain the real needs of such patients to control rehabilitation arm or rehabilitation beds and other rehabilitation machinery by themselves can help them to take care of themselves.This way can reduce the cost of care and burden,reduce the suffering of patients,and solve many family problems.This type of patient has awake brain consciousnesses and normal head and facial actions,so we cancollect the patient's head and facial actions via video information to identify their real demands(Drinking water,sitting up,turning over,etc.).Specific research content of this project is human-computer demand interaction in severe paralyzed patients based on affective computing.The affective computing refers to the identification of the head action(left and right head shaking,upper and lower head swing)and facial action(eye open and closed,mouth open and closed)recognition.The “ humancomputer demand interaction approach”is(1)directlyissued by a specific combination of action for the patient's common,emergency demands(water,SOS,etc.)and(2)through the cursor movement,simulate the mouse operation to select the demand button to send needs to the rehabilitation bedfor the general needs(sit up,turn over,etc.).The main work includes(1)creating a hierarchical demand model for patients with severe paralysis,and designing the interactive mode and interactive interface of the mouse operation through the emotional control according to this model,(2)studying and improving the algorithm of head action and facial action recognition in affective computing.Using head action recognition algorithm based on the regional,the eye action recognition algorithmbased on gray surface,the mouth action recognition algorithm based on the brightness to obtain a better action recognition effect,(3)developing a set of interactive system based on the above model and algorithms,and achieved good test results.The innovation of this paper is as follows(1)using the affective computing of the way to obtain severe paralyzed patientsdemandfor the first time,(2)building a severe paralysis of patients with hierarchical demand model,and then developed a corresponding humancomputer interaction system,(3)building a hierarchical demand model of severe paralyzed patients,and then developed a human-computer interaction system.The results of this study combined with other participating units` mechanical equipment can enable patients to complete their own living and rehabilitation activities.The results can also makea significant reduction in the workload of nursing staff,and improve the quality of life and rehabilitation of patients.