An Augmented Reality-based System For Hand Rehabilitation

Augmented reality is a new technology that is an extension of virtual reality, hi this platform, the virtual information generated by the computer is merged with the real world, resulting in a more natural interaction for the users. At the same time, users are interacting in the real world with three-dimensional virtual objects. Augmented reality is more authentic, interactive, and user-friendly than virtual reality. Local, as well as foreign, attempts have been made to apply augmented reality technology in the field of rehabilitation. The objectives of these attempts are to reduce the dependence of patients on therapists as well as to provide accurate, stable, and personalized training patterns and quantitative indicators for assessing the effects of training.This paper focuses mainly on the design and development of an augmented reality-based system for hand rehabilitation. This research was conducted as follows. First, we analyzed and summarized the two main innovations of augmented reality technology, that is, the designing of a new marker and a new registration method. Next, we compared the parameters in terms of several markers, and we then described and analyzed the advantages and disadvantages of these markers.We propose a new type of color-marker for hand rehabilitation practice that considers the needs of hand rehabilitation. The color-marker is coded based on the principles of encoding Hamming code. The color-marker is composed of 7x7 squares, which are filled with four colors on the basis of the binary bits. We can recover the original bit from the check bits when the marker is partly covered. Moreover, the tracking and registration of the color-marker can be accomplished. This paper performed many related experiments to verify the validity and reliability of the color-marker.This paper presents a number of enhancements to the ARToolKit SDK. The interface was designed with the MFC application framework, thus improving the convenience and operability of the interaction. Under the guidance of doctors, we conducted three rehabilitation projects: track practice, cup practice, ping-pong practice in accordance with the rehabilitation methods of functional recovery level and the principles of occupational therapy. The difficulty levels of these three rehabilitation projects were designed progressively. Finally, we performed experiments to verify the feasibility, effectiveness, and innovation of the rehabilitation practice.