User Interface Design And Research Based On Eye Movement-based Interaction

With the arrival of multi-screen information era,human-computer interaction has become more frequent and complex.Eye movement-based interaction is gradually applied due to its advantages of high band width,adaptability and narural interaction.However,at present,most of the applications of eye movement-based interaction simply use the eyes as a pointing device instead of a mouse and interact with users in the WIMP interface,thereby bringing about many usability issues that greatly limit the development of eye movement-based interaction.This article argued that the next generation of user interface Post-WIMP interface was well compatible with the characteristics of eye movement-based interaction,so that the potential of eye movement-base interaction can be released.Specifically,this paper maily did the following three aspects of work:Firstly,in the aspect of theoretical research,the research status of the field of eye movement-based interaction was comprehensively reviewed from the micro to the macro perspective.The characteristics of the Post-WIMP interfaces including input continuity,multi-dimensional information,interaction implicitness and real-time feedback were discussed enphatically.Balancing these four major characteristics is the key to designing eye movement-based interaction interfaces.Secondly,in the aspect of experimental research,experiment 1 was a guessiblity study focusing on intuitive eye movement-based interaction in VR.360 eye movements were collected and a consensus set of eye movements in VR that best met user's cognition were obtainded.This consensus set can be applied to most interfaces design based on eye movement-based interaction.Experiment 2 studied how the three factors including area size,symbol type and feedforward type that influence the performance of gaze gestures input through the analysis of 1200 trajectory data of gaze gestures.Through these two experiments,the details of the four major characteristics of eye movement-based interaction were summarized.Thirdly,thanks to the theoretical and experimental research,an Post-WIMP user interface model based on eye movement-based interaction called IMEMI was presented.The model described the relevant elements involved in the process of eye movement-based interaction in a hierarchical and abstract way.Meanwhile,the interactive relationship between the elements in IMEME were also explained.Due to the IMEMI model,the example "Eye Games:3D Tetris in VR" was effectively constructed.This example used many innovative interactive components,such as a pointer for eye movements and a marking menu based on gaze gesture.These components could take advantage of eye movement-based interaction in Post-WIMP interfaces.Finally,through the evaluation and research,the example in Post-WIMP built by the IMEMI model was proved to be superior to the example in WIMP.This paper started from the macroscopic interface aspect,providing the theoretical guidance,objective experimental conclusions and the methodology of interface model for the designers when design interfaces based on eye movement-based interaction.