Efficiency Evaluation On Perceptual Interaction For Large Display-based User Interface And Its Optimization Methods

Benefiting from a rapid development of display and sensing technologies,perceptual user interface(PUI)has become an increasingly prevalent application in wide domains.PUI has many types and motion-sensing interaction based on posture and gestural perception techniques is the most well-known application for most users.Motion-sensing interaction has been widely used in video games,public advertisings,information retrieval and collaborative platforms in office situations.By contrast with traditional mouse-and touch-based interactions on normal-size screens,motion-sensing interaction in large displays provides a more natural and intuitive interaction method for users.But some usability issues are concerned in such interaction,such as discriminating interaction efficiency across the overall display areas,inaccuracy of operation,and frequent change of operating hand due to upper limb fatigue.These issues are not only caused by limited capacity and precision of perception techniques,but are also affected by the effects of user's visual searching and gestural operation characteristics as well as bodily movements in interactive spaces.However,these characteristics and behaviours are often underestimated in previous research.To fill this gap in knowledge,this paper conducts some empirical experiments to study the effects of user's sensory and motor functions on motion-sensing interaction with large displays;and based on the findings,proposes optimizing methods to guide user interface design in large display-based motion-sensing interactions.The contributions of this paper are as follows:1.This paper testified that orientation of user's operating hand and gestural movement direction affects interaction efficiency on large displays,thus to demonstrate that user's sensory and motor functions have effects on gestural operation in motion-sensing interaction;2.This paper analyses and demonstrates that users' proxemic information and bodily movements in interactive spaces have significant effects on visual searching(target perception)and gestural interaction efficiency on large displays;and based on the findings,this paper summarises optimization methods for designing user interface of large displays;3.Given the effects of user's sensory and motor functions,this paper puts forward an optimization model to guide large display-based user interface design in motion-sensing interactions;and based on the optimization model,this paper also presents adaptive techniques to optimize user interface on large displays;4.This paper presents an example to examine the promoting effects of the optimization model and the adaptive user interface techniques.In this example,an online shopping application is developed,and its user interfaces are designed based on the optimization model.Furthermore,adaptive user interface techniques are applied in user interface implementations.Finally,this paper conducts a comparative experiment to test interaction performances on the user interfaces in terms of task efficiency,user interface usability,comfort level of gestural operation and overall user experience.