Design And Application Of The Auxiliary Control System For The Disabled Based Upon Binocular Vision Location Tracking

The recent studies of auxiliary control system for the disabled indicated that the control signal includes active control system, electromyographic control signal and audio control signal. But all these control methods can't satisfy the needs of patients with high disability, it unable to get the electromyographic signal for ectromelia, and audio control signal can't give the target location in time. Therefore this topic combine human-computer interaction technology with computer vision to design binocular vision tracking and localization control system, in order to help the disabled to have real-time and high precision control of the mechanical auxiliary system. It helps highly disabled people to handle the system effectively.This auxiliary control system for the disabled based upon binocular vision tracking ind localization is composed by two parts, one is software system, another is hardware system. The software system consists of three modules:Image processing and object extraction module; corner extraction and camera calibration module; three-dimensional reconstruction and eye-sight location tracking module. In the first module, it uses the method of digital image processing:image cutting, image denoising, image edge fiting. It also design the ellipse fitting algorithm based on least square method to get the result of the destination coordinate. In the second module, it use new corner detection methods with adaptive threshold and window invariance to have a more precise result. It also designs new camera calibration method using feedback regulation of neural network, in order to eliminate the radial and tangential distortion. In the third module, it use the photometric stereo method to reconstruct the eye model. Using the reconstruction coordinate, it builds the skew lines model to tracking the eye-sight location. The rdware system consists of a pan-and-tilt test system and a wearable vision tracking system.Software testing results show that the first module accurately extraction the centre point of eyeball and S&p khin spot. The second module can eliminate the radial and tangential distortion, and gives the relationship between 2d coordinate and 3d coordinate. The third module is reconstruction of the eyeball model and build the skew lines model to precise calculate the localization of the vision, its precision meet the requirements within the limits of 0.5 meter to 2 meter. Compared to traditional binocular vision tracking system, this new system has a more intuitive and simple mathematical model, in order to improve the body comfort, it allows any head movement. What's more, it uses software design to reduce the program redundancy to ensure the system live well. Therefore, the auxiliary control system for the disabled based upon binocular vision location tracking is a real-time high precision system for disabled.