Eye Movement Study Of Speechreading Chinese Sentences For Students With Hearing Impairment

Speechreading is not only an important way for hearing-impaired students to obtain verbal information,but also an important part of language rehabilitation training.At present,eye movement research on speechreading mainly focuses on the study of eye movement patterns for hearing people under dual audiovisual channels,but lacks the research on the processing mechanism of speechreading for hearing-impaired students under single visual channel through eye movement technology.From the perspective of behavioral response selection and visual perception processing,based on different discourse stages,this study focuses on two major facial regions,eye and mouth shape,carefully examines the processing characteristics of facial information acquired by hearing-impaired students in speechreading comprehension,and focuses on the influence of age and gender in the facial processing of speechreading for hearing-impaired students.This research found some results as followed.①The social-turning pattern of"eye-mouth-eye" is generally presented in speechreading for hearing-impaired students.②There are significant differences in local and global facial processing among hearing-impaired students with different ages.To be specific,11-12 years old,13-14 years old and 15-16 years old pay more attention to the whole face area by using social-turning pattern,while 15-16 years old and 17-18 years old hearing-impaired students pay more attention to the eye and mouth globe area in speechreading,which indicates that the way of facial perception processing changes with the development of age.③ The face processing pattern in speechreading for hearing-impaired students is influenced by gender.The hearing-impaired girls shows local processing advantages.The globe processing characteristics is only reflected in the gaze duration of the facial area,but does not show the attention of resource allocation advantages,but only the local regional processing advantage is not enough to make the hearing-impaired girls show advantage in speechreading.④The way in which the hearing-impaired students process the facial area in speechreading is influenced by speechreading ability.High-ability group tends to adopt parallel processing and globe processing when acquiring visual linguistic information.Eye and mouth information support each other;low-capacity group tends to adopt serial processing method to obtain speechreading information.Depending on the single mouth area,the information provided by the eye area does not effectively promote or even interrupt the acquisition and understanding of speechreading information.According to the research results,the following suggestions are proposed:speechreading training should focus on cultivating the attention-distributing ability of hearing-impaired students,and conduct full-course intervention;pay attention to combining the characteristics of age development of hearing-impaired students,and carry out whole-process intervention;consider the gender differences of hearing-impaired students,and carry out training according to their ability;comprehensively improve the globe and parallel processing ability of hearing-impaired students,and conduct overall intervention.In addition,in the future,we can conduct a more in-depth discussion on the facial information processing mechanism of Chinese speechreading comprehension for hearing-impaired students by supplementing cognitive variables,improving experimental materials,and expanding research objects,etc.