Research On Intelligent Selection Of Dense And Small Targets Based On Gesture Information In Touch Screen

In recent years,with the popularity of smart phones,PQ labs and other smart devices with touch screens,touch technology has been widely accepted by the public due to its advantages such as portability,intuitiveness,and flexibility.However,there are some interactivity issues between users and touch devices.The small-sized touch devices represented by smartphones are often affected by the size of fingers,resulting in a "fat finger" problem.First of all,since the finger has a relatively large size relative to the selected target,it is difficult to accurately obtain the target when selecting a small size target.Therefore,when a finger selects a small-sized target in a dense environment,it has a low selection accuracy.In addition,when the user selects a target,the finger will block the user's line of sight,which results in the user's inability to judge the current selection state and is likely to cause selection errors.Moreover,large-scale touch devices represented by PQ labs,due to their inherent physical characteristics,make it difficult for users to select targets that exceed their selection range;at the same time,frequent movement of users during the interaction process will additionally increase fatigue.In summary,the interaction with the touch screen has received widespread attention,and target acquisition has become a key research direction in the field of human-computer interaction.In this paper,we conduct research based on the interaction problems generated during the interaction between the finger and the touch screen.The interaction between the finger and the touch screen mainly faces four problems: 1.The finger has a large contact area with the touch screen and the contact position is blurred,which leads to a low precision of finger selection;2.When the finger is in contact with the screen,the user 's line of sight will be blocked by the finger,causing occlusion problems;3.The touch screen edge has a small selection range,which makes it difficult for the finger to accurately reach the edge of the screen and complete the selection of the target;4.When interacting with a large touch screen,it is difficult for the finger to select a target beyond its selection range,and the movement of the footsteps will cause the interruption of the current work and increase the user's fatigue.The main research results of this paper are as follows.First,it proposes a mobile terminal small target selection technology based on direction and level information,referred to as LayerGesture;second,it proposes a small touch target selection technology based on gesture information for a large touch screen remote end,referred to as StretchCursor;Third,Android applications were developed based on LayerGesture and StretchCursor respectively.Fourth,by comparing with the existing target selection technology,the experimental results show that LayerGesture and StretchCursor are superior to traditional target selection technology in terms of selection time and accuracy,and they can solve the interaction problems caused by selecting targets on the mobile terminal and the large touch screen respectively.