Design And Implementation Of AR-based Wrist Flexion And Extension Rehabilitation Training APP

Wrist joint has complex structure and is frequently used.Prolonged maintenance of upper limb support or stroke and other diseases may cause motor dysfunction and seriously affect daily life.Wrist rehabilitation training plays an important role in restoring and promoting dysfunction.AR technology can merge virtual scenes with the real world,augment and complement the real world.In order to alleviate the urgent need of clinical rehabilitation treatment resources,the thesis introduces AR into the rehabilitation of wrist flexion and extension,combining the external sensor to complete the design and development of APP,and superimposing virtual model on the real training scene as guidance,which is not only fun but also helpful for patients to carry out rehabilitation training safely and effectively in hospital or at home according to the training information.Therefore,the thesis has important engineering application value and social benefits.The application of AR in rehabilitation training has become a research hotspot.In recent years,some achievements have been made by foreign works,and domestic development is constantly catching up.However,in-depth investigation and analysis found that most of the existing AR wrist rehabilitation training system consists of PCs,projectors and sensors,which is high cost.The rehabilitation training process requires the assistance of therapists and does not support autonomous medical rehabilitation.Most of the rehabilitation training process drives the wrist joint through upper limb training,and lacks targeted wrist training.Design lacks user experience guidance and usability evaluation.In addition,most of the rehabilitation training data lacks targeted analysis.The thesis work will focus on solving the first three issues.The main goal of the thesis is to design and develop a clinical application based on AR technology,which is available for clinical use,and can effectively support wrist flexion and extension rehabilitation training in hospital and home settings,so as to alleviate the shortage of rehabilitation resources.The main tasks are as follows:First of all,on the basis of being familiar with the physical and anatomical structure of upper limbs(especially the wrist joint)and related rehabilitation medical knowledge such as occupational therapy and ROM evaluation,the thesis investigates the business process of the rehabilitation department and the user experience of physicians,rehabilitation therapists and patients,and summarize user needs.The functional and non-functional requirements of the APP are further analyzed.Secondly,based on AR technology,guided by the theory and method of object-oriented system design and the system design principles based on user experience,AR rehabilitation training design,system architecture and system element design,database design,and interaction design are performed.Among them,the AR rehabilitation training design is mainly for tracking registration,virtual reality integration and human-computer interaction.The system architecture is a layered architecture based on the Android technology stack,and the internal implementation adopts MVP architecture model.The dynamic and static structure of each functional module is designed by using communication diagram,sequence diagram and class diagram.The database design is completed using the Hibernate object mapping framework based on the static structure.In addition,Axure RP prototype design tools are used to complete the user interface wireframe design.The last part is about system implementation,testing and usability evaluation.The APP was implemented by Java programming on the Android platform.The database used local SQLite.The test was performed according to GB / T25000.51-2016 for functionality,convenient to use,reliability and portability.Usability evaluation utilizes user testing and questionnaire survey method.A total of 10 physicians,rehabilitation therapists,and patients participated in user testing.After testing,AR tracking registration and rehabilitation training effectiveness analysis were carried out.User satisfaction evaluation was collected and the evaluation results were quantitatively evaluated using the "The UX Radar" tool.The results showed that the five evaluation indicators of effectiveness,efficiency,safety and reliability,convenient to use,and satisfaction had reached requirements,proving that the APP has high availability.The thesis work has reached the set goals,and the innovation is mainly reflected in the following four aspects:(1)Rehabilitation training is completed through natural human-computer interaction.Through AR technology,the doctor's prescription and ROM evaluation results are rendered into three-dimensional virtual scene,which is superimposed on the rehabilitation training process of patients in reality to form a virtual reality fusion scene.In this scenario,the patient interacts with the natural wrist flexion and extension behavior,which is not only fun but also helpful for the patient to train effectively according to the prescription guidance;(2)User experience and usability evaluation run through the development process.In APP development process,the thesis focus on user needs and feedbacks.User are even encouraged to directly participate in the design.Usability evaluation facilitates the iteration of the development process;(3)The development is clinically available,the engineering practice has high application value and good social benefits.In addition to the patient's own smartphone,the patient only needs to add a sensor device,which is small,portable,and low cost.The APP has high clinical experiment feedback effectiveness,safety reliability and satisfaction indicators in hospital and home application scenarios.It supports self-healing.This helps alleviate the current tension of medical resources and has better application prospects;(4)Interdisciplinary.In addition to computer and AR technology,it also combines sensor technology and related theories and methods of rehabilitation medicine,such as occupational therapy and ROM evaluation.However,in actual clinical rehabilitation training,it was also found that the industrial design of the sensor should be designed to promote ease of use.In the future,we will learn industrial design to design sensors that are more reasonably worn,fit firmly on the back of the hand,and conform to ergonomic principles to better promote the user experience.