Research On Eye-Tracking System And Its Application In VR Environment

Eye movement reflects people's thinking activities,and we can analyze people's thinking mode and perception by tracking the eye movement.In the field of psychiatry,eye-tracking is considered as an important method to diagnose mental disorders,and the detection effect of observing a more real target object is better than observing a plane image.VR is exactly a technology that can satisfy this reality to the greatest extent.It adds one more dimension of color rendering than a plane image,so as to better simulate the feelings in real state.At present,desktop and spectacle type eye-tracking systems are more common.The eye-tracking system for mental disorder detection is only desktop eye-tracking system based on 2D images,lack of VR eye-tracking system for mental disorder detection.Therefore,the purpose of this topic is to develop an eye-tracking system based on VR environment.It expands the detection scene from two-dimensional to three-dimensional.While users are immersed in the virtual scene,the system can track their eye movement trajectory,so as to realize the detection of mental disorders and provide help for the clinical identification of mental disorders.The main achievements of this paper are as follows:An eye state recognition algorithm adapted to the system is proposed,which can effectively and quickly detect the opening and closing of the eyes.Meanwhile,the extraction algorithm of the pupil center is improved according to the eye diagrams obtained by the system,which can accurately obtain the required eye movement parameters on the basis of ensuring the real time.The software and hardware system of VR eye movement instrument for mental disorder detection is built,which provides a more immersive VR detection scene.The system can be used to record and analyze the number of eye fixations(NEF)and the responsive search score(RSS)of users for early screening of mental disorders,which provides a more objective basis for the timely detection of patients with mental disorders,and lays a good foundation for the development of immersive and wearable medical eye-tracking system for mental disorders detection.Although the virtual reality eye-tracking system built in this paper achieve the basic functions,it still needs further research on the hardware device,the eye movement parameter acquisition algorithm and the further analysis of the characteristic parameters of mental disorders.