Hand Haptic Interaction For Floating True Three-dimensional Display

3D display has gained wide attention for its natural and intuitive performance.Haptic interaction,as a new two-way interaction method with feedback,can transform the traditional human-computer interaction system into a closed-loop system,thereby greatly improving the accuracy and authenticity of the interaction sense.Combining 3D display and haptic feedback can directly interact with projected images in 3D space,making the interaction easier and more interesting.We proposed a hand haptic interaction method for 360° degree floating three-dimensional display system.The fingertip coordinates are measured by Leap Motion,and we use binocular camera to assist the fusion of light field display area and the interaction area and then judge the positional relationship between the hand and the display area.The signal is transmitted to make the finger sleeve vibrate if we tough the display model.Experiments show that the proposed method can complete the fusion of the light field display area and the interaction area,and the fusion precision is within 5mm.Based on this,a solution for extracting fingertip coordinates using a binocular camera is proposed for the problem of narrow recognition range of Leap Motion,which can interact in the whole model range.For gesture recognition interaction,a hardware-assisted judgment method with gloves is proposed to laid the foundation for more elaborate gesture design later.The three-dimensional display of the light field gives the user a more realistic sensory experience.When the user interacts with the three-dimensional display model,effective and real-time haptic interaction can contribute to the sense of reinforcement and immersion.