Research And Design Of Menu With Mid-air Interaction In Visual Analytics System

The development of natural interaction technologies provides more diverse display spaces for visualization systems,such as interactive exhibition installations in public spaces and wall displays that support collaborative multi-person interaction.In remote interaction scenarios,the WIMP interaction paradigm is no longer applicable,while freehand interaction has the immediacy and immediacy of touch interaction,which can provide users with a relaxed,natural and immersive user experience.In the mid-air interaction scenario,early menus were mostly interacted with by rays or cursors.In recent years,researchers have used their hands to draw markers in the air to interact with menus,or introduced a motion dimension specific to freehand gestures to map motion space to menu items.At present,there is still relatively little exploration of the motion space of freehand gestures.In this paper,we hope to expand the design space of freehand gestures through user participatory design,and explore a new paradigm of freehand interactive menu interface to make menu interaction more smooth and natural.The main work of this paper includes three parts.(1)Participatory design of gestures:through the user participatory design approach,we collect gesture sets oriented to value adjustment tasks and propose the classification dimensions of gesture sets to help future researchers and designers to be able to quickly select suitable gestures when designing unassisted interaction menus.(2)Comparative study of dimensional menu-oriented freehand selection techniques:First,the design space of dimensional menu-oriented freehand interaction techniques is constructed,and three dimensional menu selection techniques are proposed.Then,the performance comparison experiments of the three interaction techniques are conducted.Finally,the design suggestions of the freehand interaction menu are summarized according to the experimental results.(3)Color-in-Fist interaction technique for color picker menus:A metaphorical design approach is adopted to design and implement a Colorin-Fist interaction technique for color selection by hand.performance comparison experiments are conducted to verify the performance and usability of the interaction technique.