Research And Implementation Of Sign Language Synthesis System

With the rapid development of Internet technology,the sign language teaching mode still stays in the traditional classroom,signed by the sign language teacher in accordance with the sign language teaching syllabus.This teaching method is limited by the time and venue,and the lack of sign language teachers resources,making the sign language is not only high cost and low efficiency,cause we encountered a bottleneck in the process of learning sign language,in the "Internet plus" era,in order to make the Internet technology to better improve our lives,at the same time in order to bring more convenience to sign language learning groups,this paper designed a system based on sign language synthesis of Internet technology,the main function of the system for the user's voice for speech recognition,and the recognition results in the form of sign language video display on the screen,and also equipped with sign language video acquisition system library and the backstage management system management system,the need to learn to use sign language and to communicate with the user or to deaf only need a computer.The whole system is divided into client and server,the client is divided into sign language synthesis system and language acquisition system,the server is the backstage management system,in which the client interface using the PyQt4 framework after the Qt package to achieve the program for modular processing,mainly a voice recognition module,text segmentation module,the use of ffmpeg technology for video synthesis,the implementation of video recording by using opencv.The server uses the Django framework based on Python,defines the interface based on Restful to provide the interface to communicate with the client,and realizes the visual management of the database and the use of CDN technology.This paper discusses the system according to the following order.The first chapter is the introduction.It introduces the background and significance of the research,the problems that need to be considered before the research,the main work of the paper,and the organization structure of the thesis.The second chapter is the research on the key technologies involved in the development of the project,including the comparison of several client development framework,using iFLYTEK SDK in and describes the implementation of Python call DLL file,ffmpeg technology introduction,research on Key Technologies of server development,described Django framework in detail,CDN Technology,network programming and database,the use of seven cattle cloud SDK.In the third chapter,the design process and implementation principle of sign language synthesis system and sign language acquisition system are analyzed in detail,from requirement analysis to module division,and then the detailed design process is introduced in detail.The fourth chapter describes the design and implementation of background management system,firstly analyzed and modules on demand,server architecture design,database design,database visualization,using CDN technology,as well as the back-end interface to write unit tests.The fifth chapter carries on the system test,respectively carries on the test to the system client side and the server side.The sixth chapter summarizes and looks forward to the thesis.