Sign Language Synthesis System Based On The Arm Kinematic Model Study

Sign language synthesis is a process that makes natural language or text sentences to be translated into sign language which is familiar and widely used by the hearing-impaired people for communicating with each other. In the meanwhile, the translated sign language was displayed through three-dimensional virtual man in the computer in order to help the impaired to understand natural language or text information quickly and easily. On the basis of analysis of Chinese sign language(CSL), we get sign language gestures by controlling the arm arthrosis movement parameters based on robot kinematics. In the meanwhile, we adopted a method of using software to produce sign language gestures and designed a sign language synthesis system based on LabVIEW.At present, there are two means used to produce sign language gestures. One is to use motion capture based on hardware sample, which records the motion and position of hands through gloves with sensors; the other is realized by program designing based on software. Each method has its disadvantages and advantages. The first method, as a traditional one, needs a considerable amount of financial investment for equipment, and has a critical disadvantage in that recorded numerical data is hard to modify. Therefore, we take the advantages of software-based method to produce sign gestures. In succession, we built the kinematics modeling of arm based on the theory of arthrology and robotics, and then realized the control of arm movements in LabVIEW.The production of sign gestures is an important component of this system. Firstly, we analyzed the characters of Chinese sign language, and subsequently built several program modules in order to produce sign gestures efficiently; lastly, a database which involved amounts of information of sign gestures that was produced by the gesture-producing system was built.In order to save the gesture data and manipulate the database of sign gesture information efficiently, this system adopted database technology inside using the database manipulation functions offered by the LabVIEW Database Connectivity Toolset which was presented by NI company based on LabVIEW.For the purpose of translating text sentence into sign language continually, we propose a solution to the problem of character segmentation based on the sign gesture database at the end of this paper. By the large, it meets the need of the sign language synthesis system for translating daily dialogue sentence.