Application Of Mobile Augmented Reality Tracking Registration Technology In Hand Function Rehabilitation

Augmented reality technology is developed from virtual reality technology.It realizes the augmentation of reality by superimposing virtual information onto real scenes.Augmented reality technology allows users to interact with real-world scenarios in a more natural and realistic way.The application of mobile augmented reality technology in the rehabilitation of hand function makes the rehabilitation training more convenient,accurate,and interesting.This paper takes the National Natural Science Foundation of China as the background,combines natural features and target tracking algorithms,and designs and develops a hand-function rehabilitation training system based on mobile augmented reality.The main research contents of this article are as follows:Firstly,the research status of augmented reality technology is elaborated.Aiming at the needs of mobile augmented reality hand rehabilitation training,this paper proposes an algorithm based on B_AKAZE feature extraction and matching.Experiments show that the improved algorithm is more robust on mobile devices.Secondly,using the B_AKAZE feature extraction algorithm with high matching accuracy will result in too much system overhead.In this paper,through the study of the Spatio-Temporal Context(Spatio-Temporal Context,STC)algorithm,it is integrated into the mobile augmented reality system.In this paper,considering the characteristics of the STC algorithm,sensor data and target detection functions are integrated based on the B_AKAZE feature extraction matching algorithm and the STC tracking algorithm.The sensor data is used to optimize the position and attitude tracking of the target,and the target detection function is used to correct the tracking error,so as to effectively improve the real-time performance and robustness of the mobile augmented reality system.Finally,this paper designs and develops a mobile augmented reality hand function rehabilitation system based on natural features and target tracking.Three training items are designed for different parts and with different difficulty: mobile training,hanging ring training and loop training.These three items mainly exercise the functions of human fingers,wrist joints and so on.Finally,the feasibility and practicability of the system are verified through experiments.