Application And Research Of The Mobile Augmented Reality In Children's Publication

As children's first enlightening tool to cognize the world,children's publications occupy an irreplaceable position in their cognitive growth stage.With the fast development of technology currently,the information transmitting methods of traditional paper publication can no longer satisfy children's psychological needs.The emergency of the Mobile Augmented Reality(abbreviated as AR)technology invigorate the traditional paper media.This technology can present the real-time combination of virtual information and publishing paper content by the display screen of mobile terminal,replacing the traditional static passive reading mode,and establish a close connection between reading experience and children's sensory(such as auditory,tactile,et al),bringing more room for imagination and possibilities in their childhood.Hence,researching children's electronic publications,which are highly admitted by children,is of very important academic value and practical significance.AR designing and development of children's publications involve the combination of the three-dimensional modeling technology,the processing technology of image and audio/video,the technology fusing virtual and reality,the tracking registering technology,human-computer interaction technology,et al,and the cost and difficulty of development is high.Therefore,in this thesis,the application-development process based on the combination of Unity 3D and Vuforia and decreasing the difficulty and developing cost of AR publication is studied in depth.Based on these,according to the existing problems of most AR publications,for instance,only bringing visual enhancing presentation for children,the single and boring of interaction mode,ignoring the multi-sense interaction problems(such as touch and auditory,et al),this thesis studies further the AR technology which is based on the visual interaction,touch interaction and auditory interaction,aiming at bringing more complete reading feeling and experience for children.The detailed research contents are as follows:(1)The related key technology and principles of the application and development realizing in AR publication are studied in depth.The three-dimensional modeling technology based on Maya,the fusing technology of virtual and reality based on Unity 3D and the tracking registering technology based on Vuforia are comprehensively analyzed.Exploring the application systematic framework and development progress are completed based on these.Traditional publication can possess the presentation appearance of AR simply and fast,and the difficulty and cost of developing are reduced significantly.(2)The research of the AR technology which is based on visual interaction includes the interaction technology based on logo image,the visual interaction technology based on painted children's reading materials and the interaction technology based on virtual roaming.In the interaction technology based on logo image,the traditional mode of using single logo image to interact in AR technology is broken,the interaction mode based on multiple logo images is achieved.The development process of painted children's reading materials is explored.In the interaction technology based on virtual roaming,the immersion interaction technology based on CardBoard and the AR technology are combined to give children subversive visual interaction experience.(3)The AR technology research based on touch interaction include the interaction technology based on touch control on touch screen,the interaction technology based on two-dimensional natural gestures and the interaction technology based on virtual bottom clicking.The research of the interaction technology based on two-dimensional natural gestures focuses on two-dimensional natural gesture recognition algorithm,besides the effectiveness of the recognition algorithm and the fact that children prefer linear gestures are verified.The principle and development progress based on virtual bottom clicking interaction technology are studied further,and it is proven that the virtual bottoms need to be distributed in positions of abundant feature points in order to obtain excellent successful clicking rate.(4)The AR technology based on auditory sense interaction includes the audio controlling technology in Unity and the interaction technology based on voice recognition.Based on the in-depth study of children's phonetic features and phonetic recognition principles,a system of small vocabulary and specific person's phonetic recognition is achieved,and the applicability and limitations of the system are verified by experiments.(5)The research achievements above of the AR technology are applied to the AR development of children's publication through living examples.The respective AR system of painted,image recognizing and card category children's reading materials is completed.It is verified that applying the above technologies to make AR children's publications become comprehensive multi-media books gathering vision,auditory,touching sense,feeling together,providing new interaction ideas for developers and designers of AR children's publications can be practical.