Research And Application Of Mid-air Gesture Interaction For Children

With the continuous advancement of gesture recognition technology in recent years,a large number of gesture tracking devices have emerged in the market,which has promoted the mid-air gesture interaction widely used in education,treatment,family and other fields,and also brings the hot spot to the mid-air gesture research.Because of its low cost and easy of use of mid-air gesture interaction learning,it is very suitable for design and development of child-oriented interactive systems.However,in the existing children interaction systems,there is no standard design criterion for gesture interaction.The parameter setting used in most systems is still a temporary choice.In addition,the research on children's motor skill for mid-air gesture is also relatively limited,lacking the discussion on the availability of children's mid-air gesture in different directions and the performance of children in different age groups.This paper will conduct research study children's mid-air gesture interaction from the following three aspects:1.Research on children's mid-air gesture interaction ability in pie menu task:This chapter intends to explore the spatial constraints and usability of children's mid-gestures in different directions.The experimental design is a formalization of the selection task in pie menu:the spatial plane was divided into 3 kinds with different accuracy to explore the aiming performance of children's arm movement.The children were divided into two groups according to their age to complete the arm waving movement task in the direction specified in the pie menu.The data were collected by Microsoft Kinect.During the experiment,the kinematic indexes such as completion time,error rate,trajectory offset and range of motion were recorded.Through the analysis of experimental data and subjective ranking,we can find that 8-direction division is the most suitable spatial direction division density for children.The characteristics of children's control of arm movement in different directions are as follows:accurately control the movement when waving up and down,being slow and cautious to the direction on the left side,being casual and fast when complete movement on the right side.2.Research on children's mid-air gesture interaction ability in target acquisition task:Based on Fitts' law,this chapter explores the speed accuracy trade-off of children's arm movement in target acquisition task.In this chapter,we use the spatial 8-direction pie menu as the model,and set targets with some particular widths in several particular distances from the starting point in each direction.Children participants complete the target acquisition task and the completion time,error rate were recorded.According to the experimental data and subjective ranking,the effects of direction,index of difficulty(ID),target distance,target width and age groups on children's performance in target acquisition task were analyzed.The result shows that the target acquisition task of children using mid-air gesture conforms to the speed accuracy rule of Fitts' law,and children's mid-air gesture performance is mainly affected by three factors:index of difficulty(ID),target distance and target width.3.LotusMenu——application of mid-air gesture in innovative 3D menu:Apply mid-air interactive gesture to the design of innovative 3D menu.As menu selection in 3D user interface has long been a challenging task,some researchers tried to use the information of 3D rotation gesture to expand the selection ability,but the combination of freehand 3D rotation gesture has not been fully used in the menu design of 3D space.In this chapter,3D rotation gesture and marking menu are combined as the basic design idea,and the rotation gesture is integrated into Chinese traditional lotus pattern by using the proprioception design.3D LotusMenu is innovatively proposed for the 3D interface to achieve the intuitive and easy-to-use effect.Through the control experiment,the performance of users in the selection task of traditional three-level linear menu and innovative 3D LotusMenu is compared in terms of completion time and error rate.Through data analysis,it is found that LotusMenu has higher operation efficiency than traditional linear menu without sacrificing the error rate,and can effectively reduce the user's fatigue.The conception of this paper starts from the research of children's mid-air gesture interaction ability,innovatively puts forward the exploration of children's mid-air arm movement ability in different spatial constraints and different age groups.The research is carried out from two aspects:pie menu task and target acquisition task.On this basis,the innovative menu widget is designed as an implementation of the application of interactive gesture in 3D interactive interface.This paper provides theoretical basis and innovative interactive component for the design and development of children's interaction system.