Design And Implementation Of Sign Language Translator Based On Mobile Internet

According to the population of our country in the sixth national census,proportion of the disabled population to our country's population,and proportion of the deaf population to the disabled population in the second national disabled person sampling survey,we can calculate that the deaf population is about 27 million in China at the end of 2017.As we know,compared with other classes of persons with disabilities,the deaf is more difficult to communicate.In order to solve the deaf and normal communication difficulties,the article puts forward an integrated solution including natural sign language resources construction,service platform development,and mobile terminal APP.This system mainly includes the following several aspects:1.The electronic sign language resources.First collect daily conversations 300 words,designed the 300 daily conversations related semantic resources(natural language and natural language semantic knowledge needed to translate).Write programs,from network images collected in sign language I love sign language resources,by collating,sign language gallery is established;The three sign language role model was established,simulate the 30 sign with the hand,and establish a sign-language animation library;Collect sign language video and establish Sign language video library.2.Develop the resource management system.This module is mainly to manage grammar knowledge and sign language repository,Grammar knowledge base were classified as conversations library,morphemes,words,phrases,synonym library database grammar dictionary,the term semantic web,natural sign language and natural language text library.In the development process,In the development process,the article use the mass of knowledge management technology,establish a set of generalized modeling scheme of knowledge management.The set of solutions is generally lack the tools of knowledge management system,is a kind of fine-grained management,and this kind of granular knowledge management can help the administrator analysis more effectively from the knowledge in the operation of the real-time use of user,thus more effectively for scientific decision-making.3.Set the natural sign language resources service platform,and it provide the sign language resources For the application of access platform service system,including natural language processing and sign language animation generation.In natural language processing technology,this system mainly adopts the conceptual space,semantic grammar and knowledge fusion to complete semantic analysis.In animation automatic generationtechnology,the article mainly use the key frame animation technology,motion path animation techniques,deformation and animation techniques,frame by frame animation to design a can support different skeletal animation role of sign language automatically generated and expert tuning mode.The pattern is not only the integration of artificial intelligence research,and combined with sign language experts,knowledge administrator,artificial factors such as animation experts,which is a combination of human and service mode.4.To develop mobile phone APP.In the process of development of mobile phone APP,design the function of voice,text input,learning sign language features and the interface of APP.Mobile phone APP using Web services client access to natural language resources service platform to provide natural language processing and animation automatically generating function.In the APP voice input function,this system,eliminate background noise,get clear without a murmur of voices through the noise reduction algorithm,and then call xunfei sound.After identification,Xunfei server will return the corresponding text.5.Based on the above work,the paper developed a new sign language interpreter.Take100 volunteers who don't understand sign language and the volunteers is divided 4 groups randomly and let them learn 160 sign language vocabulary from APP,teacher,website,Sign language dictionary in a week's time.According to the test result,The correct rate of volunteers who use dictionary is 11.9%,the correct rate of volunteers who learn by teacher is 23.1%,the correct rate of volunteers who use website is 43.1% and the correct rate of volunteers who use APP is 74.3%.By comparison,Using APP to learn sign language efficiency is much higher than other sign language learning methods.The program is economical,practical,widely used,and easy to use with vast prospects.It can be used for banks,hospitals,telecommunications and other service sites.It can also be used for the Internet and help with the communication between the deaf and the normal which will promote the construction and development of the harmonious society.