Research On Speech Perception Strategies Adopted By Deaf And Hearing Adults

Experimental psychology is a psychological discipline that studies the psychology and behavior of human beings through experimental methods.The traditional experimental psychology research mostly uses the statistical method to analyze the data,and the data processing basically uses the manual or the semi-manual way,so the efficiency is low.With the invention of computing and the development of computer technology,many cross research methods emerge at the historic moment.The cross integration of computer and other disciplines has improved the traditional research methods and greatly promoted the development of various disciplines.This paper uses computer technology to assist psychological research,that explore the perception strategies adopted by deaf adults and normal hearing adults in audiovisual speech perception and sign language perception through analysing of the eye movement data.In the data acquisition stage,the Python SDK was used to collect the underlying eye movement data.In the data processing stage,the automatic processing program was used to eliminate the zero value data and classify the normal data.In the data analysis stage,the variance analysis was used to analyze the data and study the influencing factors,and the clustering algorithm combined with spectral clustering and hierarchical clustering was used for further analyzing of the data and studying the different perception patterns of the two groups of participants.For the audio-visual speech perception,this paper would explore the allocation of visual resource of two groups of participants in processing familiar and unfamiliar languages under two tasks.And this paper would study the allocation of visual resource of two groups of participants in processing sign language under audio-only and audiovisual conditions for sign language perception.In this paper,we verified that the clustering algorithm combining spectral clustering and hierarchical clustering is suitable for the analysis of eye movement data,and we obtained the following results: deaf adults and normal hearing adults adopt different perception strategies.In audio-visual speech perception,normal-hearing adults mainly looked at the eyes and deaf adults mainly looked at the mouth.Additionally,language and task could also modulate the speech perception strategy.In the sign language perception,both groups of participants mainly looked at the face,but normal hearing adults fixated more at the body than the deaf.