Synthesis, Based On Opengl And Kinematic Model Of The Gesture

Sign Language Synthesis as an advanced technology of Human-Computer Interaction, has a wide range of applications and academic significance. Such as the communication between deaf-mute and normal person, multi-model interface of Virtual Reality, TV news in Sign Language, intelligent human- computer interface etc. It deals with range of fields, involving computing linguistics, computer graphics, robot motion, biomechanics, psychology, physiology, and physic etc.Sign language is a visual language. The difference between sign language and natural lies in that sign language expresses a complete meaning by posture and its changes. So we create a model that can be controlled by computer. The model can realize animation, the movements of hand and arm. Then we can synthesize the sign language.In the paper, efforts mainly focus on the techniques and theories of Sign Language Synthesis, emphases are on Computer-graphics and Computer-animation. The key contributions are mainly on the following aspects.At first we study on the methods of three-dimensional graphics modeling. The three-dimensional geometrical objects are completed by 3DS MAX. Then 3DS model is used in the OpenGL. Thus we can generate more complicated graphics than that are generated by OpenGL. And we can control the model and real-time interface. In order to simplify program , a scheme is provided, which create an public OpenGL graphical class for MFC and encapsulate the codes.Then our task is realization of Sign Language Synthesis. On the base of arithmetic and technology of the Computer-animation, joint animation is chosen for it is exactly in point. According to physiological structure of human's body, We define the DOFs of hand joints and constraint and establish Denavit-Hartenbery mathematic model. We can deduce the kinematics equation. By kinematics principle, coordinate values and joint angles that educed according to Forward Kinematics and Inverse Kinematics.Finally, we give a summarization of design and realization of SignLanguage Synthesis, which can be treated as the basis of further design and study of Human-Computer Interaction and Virtual Reality.This task is supported by Shanghai Natural and Scientific Fund(serial number. 02ZD14053).