Construction Of Virtual 3D Life-like Human Hand For Real-time Human-Computer Interaction

Virtual hand plays an important role in many human-computer interaction applications. We can get a better experience in a virtual environment through a virtual hand. However, hand is a very complex structure, modeling a life-like 3D virtual hand is not a trivial task, especially the creation of flexible skin textures. The existing virtual hand production are based on the general hand of the 3D models, without the texture information. In this paper, we propose a new method to execute texture mapping for the 3D virtual hand model automatically and apply it for human-computer interaction in real-time.In order to model a life-like 3D virtual hand, we first adjust the general hand of 3D models using dorsal image, then adjust the palm image using the mirror of the dorsal image. It can ensure the correspondence between the hand images and the hand models. Then color transfer is performed for the palm image to ensure its similar color as the dorsal image. By selecting the crop box, we can establish the mapping function using orthogonal projection, the colors can be getted from the texture coordinates. Finally smooth shading is used to further adjust the direct texture mapping considering the virtual seams in fingers and thumb side. The proposed method is very efficient and experimental results show that the generated virtual hand model is more realistic than conventional virtual hands and can yield a stronger sense of immersion in the virtual world.