Realization Of A Non-medium Floating Image Interactive System With Tactile Feedback

With the rapid development of screen display technology,more and more novel display methods have entered people's lives.The non-medium floating image technology introduced in this article can provide a brand-new visual experience.The technology is based on the secondary reflection of light in the micromirror matrix structure to project objects into the air to form a real image.The imaging can be achieved without any media,watching with naked eyes.This new type of display technology is full of sense of science and technology,but the traditional human-computer interaction method cannot adapt to this new type of display technology.Therefore,this article implements a human-computer interaction system for non-medium floating image.Gesture interaction is the basis of the interactive system.This article first implements a non-medium floating image gesture interaction system.Infrared array touch sensors are used as gesture interaction devices.The sensor forms a two-dimensional touch area through a one-dimensional infrared array to achieve air gesture positioning.Analyze the ASN.1 protocol encoding,realize USB communication with the host,and complete the construction of the mapping relationship between floating projection and touch area.By simulating the floating area,the touch area is tested for positioning.The test results show that the infrared array touch sensor can achieve accurate and stable positioning of the finger,and the movement error is as low as millimeters.Unity 3D is designed Gesture interaction events can complete gesture interactions such as clicking,dragging,zooming,and rotating on floating image,adapting to various interactive scenarios.Haptics,as a way to obtain information through human-computer interaction,can improve the sense of reality in the interaction process.This paper is based on the principle of ultrasonic phased array technology to complete the construction of a tactile feedback platform to achieve ultrasonic focusing in the air and generate radiation pressure feedback in the air.The platform has the characteristics of real-time focusing,focusing scalability,and no need to wear any equipment.The focusing effect is verified by finger experience and visual observation.In this paper,ultrasonic haptic feedback technology is applied to the non-medium floating image gesture interaction system,and the floating image interactive interface is designed.Click on the floating image to achieve interactive events and obtain real-time haptic feedback.Tests by multiple experimenters show that it has the effect of haptic feedback.It can improve the experience of the interactive process of non-medium floating image.The application prospect of the non-medium floating image interactive system with tactile feedback is very broad.The non-medium floating image can bring a cool visual experience similar to that in science fiction movies,truly "de-screening",replacing traditional touch screens.In public places,many necessary touch screen operations need to be completed.The combination of non-contact gesture interaction and non-medium floating image can fundamentally prevent cross-infection in public places,especially during the epidemic period,which can greatly reduce the spread of the virus.Tactile feedback technology can become an important support in the non-medium floating projection interactive system,which can improve the sense of reality and safety in the interactive process.