Design And Research Of Desktop Document Operation Interaction Based On Multi - Touch

Multi-touch technology has broken the traditional graphical interface using the mouse by boring single operation, realizes the hands free interaction. In this paper, we applied the multi-touch technology to operate desktop document icons. First, we proposed two kinds of data structure of single touch and multi-touch; there is a concept of fingers sequence-the fingers that touching the screen were sorting in chronological order. According to the way to touch the targets, the fingers are divided into two categories:one is touching icons, the other is operating icons. Followed, the primarily interactive tasks on the desktop documents are the selection operation and scaling-rotation operation. Depending on the tasks, we design the different interactive gestures--Stripe Action. There is a stripe linking the touch points. The Stripe is "Scanning" on regional icons to realize the selection operation, to achieve the scaling and rotation operation by changing the stripe delta length and delta angle. Stripe Action is retain the characteristics of natural interaction, but also reduce the fat finger touch operation problems and hand occlusion problem. Again, we design the bubble icon, desktop menu and Cylinder menu, which could help build a three-dimensional scene desktop environment. Finally, the design takes Unity as the platform, C#as the language development, implementation multi-touch operations on the desktop documents icon on the Tablet PC of Android operating system.This paper elaborated the process of design and implementation of the desktop document interface in multi-touch from the platform, touch theory, gesture, and project implementation; but also discusses the purpose and significance of this design.