Design And Development Of Integrated Personalized Virtual Hand Modeling Platform

Virtual reality technology aims to simulate the environment of real world.It allows users to interact with the virtual environment and makes users feel immersive.Virtual reality has two important features:interactive and immersive.While the hand is an important tool in the interaction with the virtual environment,realistic hand model will give users a more realistic experience in virtual environment.There are many challenges in the establishment of realistic hand model:the interference of natural environment when collecting image,the difficulties in separating of the hand with the background,the influences of lighting on the clarity of the hand,the image blur caused by hand shaking.Besides,too much manual intervention required by the software to make the modeling duration very long and inefficient.This thesis has developed an integrate platform of hardware and software that makes hand modeling more convenient,efficient;and the result more realistic.In the aspect of hardware,a multi-view image acquisition device is designed and implemented.The device is designed according to the principles of camera stereoscopic cone,light illumination model and hand motion constraint.Using our device can reduce the environmental noise and motion noise generated during the human image acquisition,and improve the quality of the collected images.In the aspect of software,we designed the user-oriented software interface and efficient,practical operation process,so that modeling become more efficient.According to the principle of multi-view geometry in computer vision,we can obtain three-dimensional information from the multi-view image of hand.We divide the information into three categories:the point features reflecting the size and the position of hand,the line features reflecting the contour of hand,surface features reflecting the undulations of hand.We deformed the hand template model according to the three features:point,line and surface and then obtained the virtual hand with the same size and shape as the real hand,finally mapped the texture of real hand to the virtual hand,making the model more realistic.The hand modeling method in this thesis is compared with the three-dimensional laser scanning technique and the time-of-flight technique.We can find that on one hand,the operation of our method is much easier than the latter two,on the other hand,hand model established in this thesis is more realistic than that generated by the time-of-flight technique.Meanwhile,the equipment we used is much cheaper than the three-dimensional scanner.