| Company with the expansion of computer's application, computers be used in more and more field. Education is the most important use of computer.In the domain of deaf children education, we can combine traditional media and multimedia with the advanced multimedia techniques, and then we can obviously improve effects of hearing recovering for deaf children. Under the instruction of deaf child teacher's experience, many kinds of media have been integrated play an important role. Children learn to understand the world and culture surrounding them, and to recognize and blend themselves into the social and cultural context, by a good courseware. However, due to the unnatural switch operation, the traditional interaction style with mouse and keyboard is not suitable for children. Recently, the Pen-based gestures interaction is a rapidly developing technique in the Human-Computer Interaction. It adapts the "human-centered" principle of natural interaction and has been proved to be a valid way to improve the efficiency and the neutrality of interaction by a lot of research work. With the development of the multimodal user interfaces, the Pen-based gestures interactionhas been applied in several children's interaction systems.The thesis presents some novice method focus on the application of deaf children's teaching system combine with the single gestures. A pen-based multimedia courseware system for deaf children has been designed and developed, which uses the natural interaction modal to enhance the imagination and creativity of teacher and attract deaf child's attention are based on teacher's experience. The main contributions of the thesis are:1. Analyzed the development of technology of gestures and the use of multimedia in education. Presents a pen-based multimedia educates method.2. Applies the many kinds of media in the teaching process, combine the traditional interactive method such as icon and mouse with pen gestures, which used in audio and video's edit progress. Simplified the complicate operations in preparing and teaching lessons. So that teacher can pay more attention to the deaf children's recovering.3. Give a way to re-edit audio and vedio files by pre-view and re-choice.Reduced the interface difficulty and satisfied the requirements of teachers. 4. Based on the work above ,designed multimedia teaching system used for deaf child and several related tools . The interaction is based on pen gestures, improved users experiences. |
