Emotion Recognition And Application Of Learning Interface In Smart Learning Environment

Today the common digital learning environment can no longer meet the needs of “digital natives”,and the rapid development of artificial intelligence,big data,blockchain and other technologies will profoundly change the talents demand and the form of education.And as a high-end form of digital learning environment,smart learning environment comes into being.The smart learning environment focuses on cultivating the learners' high-level abilities such as creative ability,problem-solving ability,decision-making ability and critical thinking ability.And cognitive activities play a crucial role in coordination and control in the cultivation process.Emotion is a psychological response caused by external stimulus,which can influence and regulate the cognitive activities such as attention,perception,representation,memory,thinking and language.In the learning process,positive emotions can stimulate learning motivation,foster learning interest and promote cognitive process,while negative emotions can affect degree of patience,attention and hinder cognitive process.The off the shelf smart learning environments put more emphasis on cognition,that is,pay more attentions to the adaptability and individualization of the learner's cognitive level.This means that smart learning environments can provide appropriate learning content,learning path and problem-solving approach according to the learner's cognitive ability and learned knowledge but seldom consider the role of learners' emotions,interests,motivations volition and other non-intellectual factors.Besides,the existing smart learning environments neglect the theoretical and practical research on harmonious emotion interaction,resulting in its lack of emotional adaptability,individuation,and emotional support for learners in the smart learning process.In the smart learning environment,learners mainly watch the learning interface(information presentation interface of learning content)through the intelligent learning terminal to learn.Learning interface is the main information channel interaction between learners and the learning content,and it is also the main learning environment for learners at same time.On one hand,the learner's learning emotions,interests and effects will be considerably influenced by color arrangement,composition,graphic decoration,background texture of learning interface.On the other hand,accurate identification of learners' emotions is the basis of building harmonious emotional interaction in smart learning environment,and it is also an important means to judge learners' learning status and is of great significance to promote the smart learning of learners.The learning interface affects the learner's emotion and cognitive activities with intuitive visual features and implicit artistic features.In addition to providing learners with personalized learning contents and learning paths,the smart learning environment also provides learning personalized interface according to the learning's emotional state and visual emotion preference,and can regulate and stimulate the learners' learning emotions.Regarding the implicit emotional attribute of learning interface as breakthrough point,this study focuses on the problem of “the deficiency of emotion” in the smart learning environment,which provides a new idea and method for the realization of adaptive interaction in the emotional level of smart learning environment.In this study,on the basis of interviews and surveys,the learning interface mainly include 14 emotions,such as warm,cheerful,lively,funny,exaggerated,humorous,interesting,desolate,boring,oppressive,messy,illusory,thrilling and horrible.And through literature review and practical observation find the learners' learning emotions mainly include 7 types: neutral,happy,angry,sad,terrified,dedicated and distracted.Finally,the study has built two databases,which including 17456 learning interface images and 85,085 learner expression images respectively through autonomous collection and web crawlers.Considering factors such as accuracy,training speed and memory consumption,and according to the image characteristics of the learning interface,this study designs a model based on convolutional neural network constructed by 9 layers for recognizing the emotion of learning interface.This model consists of 4 convolutional layers,4 pooling layers and 1 full connection layers,and the model are trained on the self-build learning interface database.Then a model of 7-layer convolutional neural network is also designed to identify the learners' learning expressions according to the characteristics of the learner' expressions image.The model consists of 3 convolutional layers,3 pooling layers and 1 full connection layer.And the model are trained on the self-built learner' expressions database.The experimental results show that the model of convolutional neural network in this study can identify learning interface emotion and learner's emotion accurately.In this study,the first experiment that lasted for 15 weeks is carried out.Students of grade 7 and grade 8 from a school in Jinan of Shandong province are objects to explore the influence of learning interface on learners' emotion.During the experiment,different emotional learning interfaces were used for actual teaching,and learning interfaces and corresponding learners' expressions were collected at the same time.Finally,experimental results show that the learning interface with warm,cheerful,lively,funny,humorous and interesting can motivate learners' positive emotions such as neutral,happy,and dedicated.But the negative emotion of learners such as anger,sad,terrified,distracted can be caused by learning interface with desolate,boring,oppressive and messy.However,learning interface with exaggerated,illusory,thrilling and horrible is more special and has different emotional characteristics from the previously mentioned two.Another experiment in this study lasted for two weeks is carried out with students of grade 7 and grade 8 from a school in Jinan as objects to explore the influence of self-adaptive adjustment of learning interface on learners' emotions.In this experiment,the experimental group watched the self-adapted learning interface for learning,while the control group watched the unadjusted original learning interface for learning.At same time,the expressions of experimental group and the control group were collected.The experimental results show that the key visual characteristics of learning interface can be adaptively adjusted according to learners' expressions,visual emotional preferences and the emotions of learning pictures.Then the adjusted learning interface can effectively regulate learners' learning emotions and stimulate learners' interest in learning.This study brings new development to the research and implementation of the emotional adaptive interaction in the smart learning environment,and it has considerable innovation and practical application value.