Development Of A Hand-gesture Controller For Virtual Interaction

Recently,the rapid development of sensing technology has greatly promoted the change of interactive intelligent devices.The means of human-computer interaction shows a diversified development trend.With the rise of virtual reality technology,the traditional means of human-computer interaction,which are represented by keyboard,mouse and handle,is not able to satisfy people's demand.There is an urgent need for people to communicate with the computer in a more natural way.Hand gesture input,a new means of human-computer interaction,with the characterisitics of lively and intuitive,can provide users with a perfectly natural interactive experience,which is of great significance to enhance the immersion of virtual reality.Based on the background,this paper designed and developed a hand-gesture controller based on inertial sensor technology,to meet the needs of virtual interaction.The main work is summarized as follows:1.Scheme design.According to the motion features of human hand,a sensor's layout scheme of the hand-gesture controller is designed,and the sensor's types and principles are introduced.Based on the inertial navigation technology,the data processing method of the inertial sensor is introduced in detail.The method of four dimensional attitude calculation based on complementary filter is selected according to the functional requirements of the systems.2.Hardware circuit design.According to the functional requirements of the hand-gesture controller,a sensor node,a data aggregation node and a feedback driven node circuit are designed.And the hardware function of each circuit board is tested.3.Software design.The software design can be divided into two parts:the lower computer program and the upper computer program.The main function of the lower computer program is data acquisition and processing and transmission of attitude information.The upper computer program realizes the mapping of the attitude information and the driving of the virtual model.The upper computer and the lower computer communicate with each other through the serial port,and accomplish the attitude information upload function and the feedback data download function.4.Comprehensive testing.The experimenter wears the hand-gesture controller equipment to carry on the joint debugging of the upper computer and the lower computer.In order to solve the problems such as the instability of the original data of the sensor and the jitter of the model,a filtering method is designed to improve the stability of the system.A virtual interactive experiment has been designed to verity the integrity of data transmission.When the virtual hand touched the virtual object,the vibration feedback is triggered at the corresponding position of the hand.5.System optimization.According to the result of comprehensive testing,the hand-gesture controller is optimized.On the basis of satisfying the virtual interactive function,the number of sensor nodes is reduced and the cost is saved.The mobile phone APP of Android version is designed to replace the computer as the upper computer to complete the display function.