The Realization Of Human-Computer Interaction Based Learning System And The Detection Of Students’ Interest Level

With the rapid development of information technology, it has been widely used in most aspects of society. At the same time, information technology based HCI(human-computer interaction) learning has a profound impact on the traditional teaching method and mode and it has also been an important research topic in the field of e-learning.In this thesis, children are the subjects of the research. It a HCI based learning system is designed and realized, and the students’interest level is detected. HCI based learning system could offer safe, predictable and attractive interactive learning environment. Multimedia technology based learning system has been widely used worldwide. However, most of the system focuses on the teaching rather than the analysis of the learning state of students during the learning progress. Students’interest is not only the reflection of the students’learning state, but also the key factor that influence the learning result. Therefore, this thesis studies the children’s interest level in the HCI based learning environment via the multi channel information.The research content involves 2 aspects including the realization of the HCI based learning system and the detection of students’interest level. The specific contents include: firstly, the learning activities are designed based on the cognitive psychology and child development theory. Secondly, the HCI based learning environment is realized based on the HCI theory and computer technology. The design of the system focuses on not only the user experience and friendly interface, but also the children’s preference to attract the students for active learning. Finally, the skin conductance signal and image information are obtained through the physiological signal sensor and camera. The skin conductance signal can reflect the activation degree of emotion. Facial expression can reflect the degree of positive and negative emotions e.g., smile can reflect the positive emotion). The students’interest level is analyzed by the fusion of multi channel information.This thesis realizes the HCI based learning system with the detection of the children’s interest level. Children can acquire knowledge through the vivid, interactive interface and rich user experience. At the same time, the system can detect the children’s interest level and understand the state of children’s learning by the fusion of physiological and image recognition. In the future, HCI based learning will be multimodal and more intelligent. Based on this dissertation, the future system may include a real-time feedback of interest level of the students and intelligently adjust students’ learning activities adapting to the current state of the student and improve the learning efficiency.