Research Of The Hand Haptic Interactive And Reconstruction Technology

Haptic interaction is a key type of human-computer interaction technology.It refers to the touch interaction for the purpose of sensing and operating objects.Haptic interaction has been paid more and more attention in recent 10 years.If the virtual environment system only involves the user's visual and auditory,it will be insufficient and limited in terms of the ability to interact with users.Haptic interaction has an irreplaceable role as a unique perceptual channel for the existence of two-way information interaction.In real life,workers perform parts assembly,grasping,handling,and doctors perform surgical operations.To achieve precise control and manipulate objects,operators must be able to effectively sense contact conditions to make accurate judgments.In the virtual environment,haptic interaction also has important significance.If the haptic information in the virtual environment can be truly fed back to the operator,the interactive telepresence of the virtual environment will be effectively improved.In view of the lack of research on existing hand wearable haptic interaction devices in China,this thesis conducts in-depth research on hand haptic feedback devices for human-computer interaction,and designs and implements two sets of wearable haptic feedback systems.It mainly includes wearable fingertip haptic feedback devices for computer terminals and a set of haptic interaction software based on Unity3 d.The interactive system is mainly used to implement force and tactile feedback operations of object grabbing in the virtual environment.In addition,a set of finger-skeleton wearable haptic interaction system for mobile terminals and a set of haptic interaction software based on Android system platform are designed and implemented.The haptic system can extract the height information of each pixel and the edge information of the image on the mobile terminal platform to obtain texture feature information of the image.The two sets of hand haptic interaction devices designed in this thesis both use Bluetooth communication technology,rechargeable battery power supply to achieve the miniaturization and portability.When the operator is using the device,it can obtain haptic information when users interact with virtual scenes in different terminals,thereby enhancing the sense of realism and sense of immersion during human-computer interaction.The research focuses and innovations of this thesis are as follows:(1)The system can realize the force and vibrotactile feedback of object grabbing in the virtual environment based on computer terminals,and the force-feedback is implemented and expressed by the wearable finger-type elecromechanical structure.Collision detection is implemented by a linear resonant actuator.A virtual hand model is created and Leap Motion is used to capture and track the virtual hand gestures in real time.(2)This thesis conducts in-depth study of the vibration response characteristics of piezoelectric vibrators.This thesis also studies differences in subjective perception of vibration intensity by human hands and the significance of the difference.It can lay a theoretical foundation for the accurate and effective vibration tactile feedback.(3)This thesis introduces image feature extraction algorithm to realize the extraction and expression of spatial tactile information of virtual objects in the mobile terminal platform.It will have great help for users to identify the three-dimensional feature information such as height,contour,and texture,especially the visually impaired person.(4)The two sets of hand haptic interaction systems both have the advantages of miniaturization,light weight,and portability.The interactive software is user-friendly and easy for operators to use.It reduces the amount of model calculations as much as possible to realize efficient and real-time hand haptic feedback in limited resources.