| The demand for humanoid service robots have been increasing along with the deteriorating of labor shortage and aging of population.And humanoid service robots have got a huge development space by the great successes of advanced technology,including Artificial Intelligence,Human-Computer Interaction.Internet of Things.et.al.Therefore,both industry and academia pay more attention to the user emotional experience of humanoid service robots interaction,which plays a vital role in the design and assessment of service robots interaction.However,the present user emotional experience research focus on how to express and transmit emotion by design robotic emotional behavior when the research relative to measurement of robotic user emotion and effect of robotic emotional behavior on user's emotional experience are absent.Thus,the method of combining eye tracking and EEG is proposed in this paper,to explore the influence of robotic emotional behavior on user's emotional experience under perception condition and explore the influence of robotic emotional behavior on user's emotional experience of music in music interaction process.The main content of this research are as follows.(1)Twenty robotic emotional behavior prototypes of five basic emotions(Happy,Fear,Neutral,Sadness and Anger)were designed by extracted and combined the elements of emotional behavior.Then,an experiment.sing subjective questionnaire,was carried out in order to assess the prototypes.And five prototypes which gain the high score in each basic emotion were selected.(2)The formal measurement experiment of user's emotion invoked by robotic emotional behavior was performed.The subjects are required to watch the selected prototypes,and subjective ratings,eye-tracking and EEG data are simultaneously recorded and preprocessed then.(3)Data processing and statistical analysis are performed based on the multiple types of experiment data in order to to explore the influence of robotic emotional behavior on user's emotional experience under perception condition.(4)Using the physiological and psychological measurement Indicators of user's emotion to explore the influence of robotic emotional behavior on user's emotional experience of music in music interaction process.The main conclusions of the study are as follows.(1)Compared to neutral emotion,maximum pupil diameter,average pupil diameter and gaze time ratio,are significantly increased both during positive emotion and negative emotion.Compared to neutral emotion,relative power of parietal delta rhythm is significantly increased duiring positive emotion.Compared to neutral emotion,relative power of frontal midline theta rhythm is significantly increased during positive emotion.Compared to neutral emotion,the relative power is significantly decreased during positive emotion in the left frontal and significantly decreased during negative emotion in the right frontal.All the three types of relative power ratios are changed in same trend of the relative power of alpha rhythm.(2)As the result shows that the robotic emotional behavior of happy induced user's positive emotion and sad emotional behavior induced user's positive emotion.However,the emotional behaviors of fear and of anger didn't induce significant emotion from neutral emotional behavior.(3)The results from experiment shows that robotic emotional behavior can enhance user's emotional experience in the interaction process of music playing.Specifically,robotic behavior of happy induce more intense positive emotion than neutral behavior when robot plays happy music and the sad behavior of robot induce more intense negative emotion than neutral behavior when robot plays sad music.(4)The user's emotional experience was significantly increased during music interaction condition compared to perception condition,and music matching with emotional behavior can enhance user's emotional experience. |
PDF Full Text Request