Research On Gesture Coding And Design Method For Natural Interaction

With the development of sensor technologies and the improved demand for natural interaction,gesture interaction has become an important development direction of humancomputer interaction with its rich,convenient,and natural semantic expression.Nowadays,gesture interaction has been widely used in medical,driving,virtual reality,robot teleoperation and other fields.Moreover,the research quantity and application fields of gesture interaction show a continuous upward trend.However,at present,the number of gestures used in practice is minimal,and the stability of gesture recognition needs to be improved.There is a massive gap between the richness and flexibility of gesture interaction and the limitations of the gesture number and posture in current applications.The reason for this phenomenon is the lack of scientific gesture representative methods and design methods.In order to solve this problem,this project tries to put forward a unified and objective gesture representation framework and a scientific gesture design method.These efforts aim to apply the user’s intention expression results to engineering practice to improve gesture interaction’s diversity,naturalness,and reliability.The main research results and innovations of this paper are as follows:(1)A unified coding method of gestures in human-computer interaction was proposed.The method maps people’s continuous actions into discrete intention space and represents gestures by character strings.Therefore,the method can give consideration to human gesture perception and intention expression and machine recognition and data storage.(2)A universal participatory gesture design method was proposed.Based on gesture coding,this method proposes suggested gestures through participatory gesture design,collects unconscious gestures and excludes them from suggested gestures to solve the interference problem of unconscious gestures,and calculates the gesture distance to solve the problems of low recognition and memory difficulty of gesture differences.(3)An assistant design software for gesture interaction was developed based on gesture representation and design methods.The software provides convenient and intuitive gesture encoding and decoding function and gesture design auxiliary function through the coding module,decoding module,unconscious gesture collection module,rapid gesture recognition development module,gesture distance calculation module and recognition algorithm usability calculation module.Taking the driving scene as an example,this project expounded on the application examples of gesture coding method,gesture design method and auxiliary design software.Finally,it produced a natural human-computer interaction gesture set of the vehicle driving environment.This practice proves that this project has guiding significance for gesture interaction design.