Research And Applications Of Smart Interaction Technology On Glasses-free 3D Displays

In the past ten years,display technology has gradually developed from traditional twodimension(2D)display to three-dimension(3D)display,and different types of 3D displays have also emerged in the market,such as glass-assisted 3D display commonly used in theaters,glasses-free 3D display of Nintendo consoles,and virtual reality /augmented reality(VR / AR)display technologies that have received much attention in recent years and so on.Three-dimensional display technology can more accurately reflect the real situation and bring greater visual impact to users.At the same time,the introduction of intelligent human-computer interaction technology has also improved the user's immersion.Thanks to these,it has been widely used in entertainment,education,medical and other fields in recent years.The development of 5G technology has also pushed VR / AR technology to overcome bottlenecks and move forward.The entire 3D display industry is booming.However,there are still some experience deficiencies in different types of 3D display.Compared with other three-dimensional displays,the directional backlight autostereoscopic display with a hybrid spatial-temporal control developed by this research group has the advantages of natural comfort,low crosstalk rate,high compatibility,and large viewing angles and so on.However,there are still some shortcomings in face tracking and other interaction technologies,and the potential application scenarios of new display technologies also need to be further explored.Thus,we have done the following work in this article:(1)Proceeding from the principle of the directional backlight auto-stereoscopic display with a hybrid spatial-temporal control,each link that causes delay to the system is carefully analyzed,and a latency measurement device for this display technology is built to measure the overall system latency.According to the measurement results,a method of face tracking with motion prediction is proposed,which effectively improves the timeliness of face tracking of the stereoscopic display technology,thereby improving the viewing comfort and meeting the market acceptance.(2)Based on this glasses-free 3D display technology,its application in stroke rehabilitation was explored.With the help of 3D graphic engines such as Unity 3D,a virtual rehabilitation training scene is produced.Patients can perform interesting training in the virtual scene by introducing Leap Motion to provide gesture recognition and tracking,and the training performance will be recorded in real time.The training effect is evaluated by the Fugl-Meyer scale and transcranial magnetic stimulation(TMS)before and after training.All results show that the stroke rehabilitation effect based on the naked-eye 3D display technology is better than traditional rehabilitation training.(3)Based on this auto-stereoscopic 3D display technology,its application in the field of ophthalmology was explored,mainly the application in intelligent visual function screening.This paper develops an intelligent visual function screening system based on We Chat mini apps,MySQL database,C++ and so on.Compared with traditional visual function screening,while ensuring accuracy and repeatability,it has the advantages of higher integration,self-service detection,no need for single-eye cover,and digital management of screening results.