Design And Implementation Of Sonar-based Hand Gesture Tracking System On Android Mobile Phones

With the development of computer science technology,the use of mouse and keyboard and other mechanical means of interaction as a method of human-computer interaction techniques,has been unable to meet the growing need of the Intelligent demand of human-computer interaction.Human computer interaction technology has gradually become one of the main directions of computer development in the world today,while as one of the most convenient and intuitive means of human-computer interaction,gesture recognition technology is becoming one of the most important directions in the development of human-computer interaction technology.In this paper,an Android based mobile phone gesture tracking system based on sonar is proposed,which aims to extend the gesture recognition in the field of sound.In this paper,we transmit the OFDM signal by sonar using the mobile phone,and the phone detect the arrival time of the echo signal to calculate the distance between the mobile phone and the gesture,used to calculate the coordinates of the gesture relative to the mobile phone,so as to achieve the purpose of hand tracking.According to the difficulty and focus in the research process,the Android mobile phone gestures tracking system based on sonar can be divided into the following parts: Android mobile sonar ranging feasibility analysis,OFDM ranging principle,coordinate detection principle.The studies were designed to explore the possibility of implementing a gesture tracking system in a mobile phone with hardware that contains a speaker and two handsets.The Android mobile phone used in the research is HUAWEI glory series,Android development platform is Android studio,this paper uses the above development tools and platforms to achieve the tracking system on the mobile phone.By using sonar and OFDM technology,a novel method of hand tracking on Android mobile phone is proposed.This method can achieve centimeter level positioning with 5-35 cm distance to the mobile phone.While it is also different from the previous method that requires the use of sophisticated peripherals,the system only needs one Android mobile phone,with a high degree of convenience and accuracy.