Research On Multi-parameter Parallel Operation Technology Based On Pen,touch And Mid-air Gesture

Single channel input is a common interaction mode for implementing the traditional WIMP interface operation.However,the limitation of the number of channels also makes the interface operations tasks that can be completed in parallel have to be accomplished in a sequential manner,which reduces the user's operating experience.Although the use of an empty area on the screen can improve interactive performance,it also sacrifices effective operating space and may result in additional misoperation.In order to improve the concurrent input capability,a multi-parameter parallel operation technique was proposed and designed.The parallel operation of multiple parameters was achieved by using the mixed input of pen,touch and gesture.Combined with the characteristics of the input mode,the multi-parameter parallel operation under a single-channel condition and multi-channel condition is designed respectively.The performance of single-channel,such as pen pressure,pen tilt angle,pen azimuth angle and boundary drag input technology,is investigated with the pan-zoom task respectively.And the performance of multi-channel mixed input for timing and main auxiliary input under mode switching tasks was analyzed comparatively.In order to further improve the ability of multi-parameter parallel operations,the performance of pen,single-finger touch,and gesture input techniques in 11 single-handed and two-handed situations was designed and investigated.The results show that under the single-channel condition,the pen tilt angle technology has the best overall performance among the three pen input technologies,and the overall performance of the pen pressure technology is the worst.In the case of timing,the comprehensive performance of the single-handed pen+single-finger touch mode switching technology is better than the contrast reference technology.Under the case of main and auxiliary input,the comprehensive performance of the pen+gesture input technology under single-hand command is superior to the reference technology.The designed technology effectively improves the performance of multi-parameter parallel operations.Finally,according to the characteristics of each technology,the principle of using each technology under different task types is given,and the design proposal and application scene of the multi-parameter parallel operation technology for mixed input are given according to the result of the study,which provides a reference for the design of multi-parameter interface.