| In the hearing society,the hearing-impaired people have many survival problems,such as employment and unemployment,education and communication issues,and communication problems between the hearing-impaired and hearing society,which prevents people who are hearing-impaired from smoothly integrating into hearing society.Among the above problems,the most urgent issue is the communication problem.To solve this problem,this article uses campus as a sample and proposes a system that can alleviate communication barriers.In the process of project implementation,this article mainly uses Android to structure the overall system,and uses a series of third-party libraries,such as Dagger2,Rxjava,GreenDao and etc,in the process of system architecture,which can be at the code level.In the link of sign language recognition,the action recognition framework openpose is used to identify body information and extract key points of the human body,and using subnets thought sign language algorithm to combine,and finally using a series of feature points such as similarity and body distance to complete the judgment of sign language recognition.The main work of this paper is to complete the overall architecture of navigation system for the hearing impaired people,and carry out the basic design and implementation of the system.In terms of functional design,in order to meet the information interaction needs of users at different levels,firstly carry out information interaction at the regional information level to meet the basic needs of users,and develop it in the form of information cards for the hearing impaired.Secondly,users can search and call all surrounding merchants and product information,and conduct further information interaction on the detailed page.Furthermore,the hearing impaired can conduct information interaction at the sign language level and use sign language for location search.Besides,users can perform their own management,such as login,user dictionary exchange and so on.Finally,the componentized management process and asynchronous data management process for the system are also designed and implemented to ensure the normal operation of the system.The overall structure is as follows.The first step is introducing the background of the project.Researching and analyzing the existing hearing impaired apps,based on the researching results,and the use case diagram is used for detailed analysis.Then,refering to software engineering theory,designing the system function system and combining with the functions of the regional information interaction module,merchant product interaction module,sign language interaction module,user management module and basic module were described using function diagrams.After that,describing each module and designing them in detail.Combining with UML class diagrams to describe the interfaces,methods and connections between each module,describes the important methods in the implementation process,combined with the flowchart,described each module that being utilized.In addition,various functional modules were tested.Finally,the paper summarized the full text work and prospected the follow-up work.Currently,the detection accuracy rate of the core module can reach more than 75%,which can meet the user’s basic sign language vocabulary recognition requirements.The system could be used smoothly and the memory is consumed moderately.Through the realization of the system,it is easier and more convenient for the hearing impaired people to travel,narrowing the communication gap between the hearing impaired pepole and the hearing people. |
