Development of a Haptic-based Rey-Osterrieth Complex Figure Testing and Training System with Computer Scoring and Force Feedback Rehabilitation Functions

This research develops a new system for assessment and rehabilitation of motor skills in Traumatic Brain Injury (TBI) patients. By using contemporary computing technologies, including virtual reality (VR), haptic devices and telecommunications, the system can work as an alternative to traditional labor intensive and expensive diagnosis and rehabilitation procedures for TBI patients. This study also introduces a general approach to the design and prototyping of a haptic-based VR System for motor skill assessment and rehabilitation.;The Rey-Osterrieth Complex Figure (ROCF) is a neuropsychological test that has been used to manually assess various cognitive operations, such as perceptual apprehension, attention and control, graphomotor coordination, etc. The focus of this research was on developing a VR-based ROCF test system incorporating a haptic interface with functions to support testing protocols, based on specific user requirements, and to facilitate automated scoring of tests and quantitative test result output. Computer-based tests have advantages over traditional paper-based tests for motor skill assessment including automated recording of complete behavior information in the drawing process, simplifying the job of examiners, and reducing biases in evaluations.;Haptic technology was used in the simulator as both an input and force feedback device. Haptic devices have the capability of recording user performance in six degrees of freedom (6 DOF) in the drawing process and providing force feedback in 3 DOF. This means they have the potential to provide user performance data on the traditional three dimensional (3D) method of ROCF testing. Also users may experience a more realistic feeling of drawing when using the haptic device versus using a tablet or tablet PC.;To develop the ROCF scoring system, advanced technologies of handwriting/pattern recognition were reviewed and adapted. A software application was created for recording of freehand drawings, recognition of strokes and normalization of strokes for unit scoring. ROCF scoring and analysis reports can be generated automatically with the system.;The haptic-based VR system was extended in capability for motor skill rehabilitation. Numerical models were used to describe motor skill assessment results and to parameterize the rehabilitation training application. The prototype system demonstrates the potential for using advanced information and VR technology to build more effective and intelligent tools for healthcare.;This study identified the major challenges in developing a fully automated ROCF test system, including hardware options and criteria for choosing the proper devices for human performance. The software challenges are also identified and algorithms were developed for use in the system. The prototype system is expected to change the process of motor-skill evaluation in clinical practice.