Design And Implementation Of Children's Literacy System Based On Mobile Augmented Reality

With the development of AR devices and AR applications,augmented reality technology has quickly become a hot topic for developers around the world.Augmented Reality(AR)is a technology that combines and interacts with the virtual world and the real world.Due to the immersive interaction of augmented reality technology and the presentation of its virtual and real fusion,the technology has been widely used in different fields,especially in the field of children's education,such as AR Zoo,AR literacy cards,etc.However,these systems are mainly developed using the marker-based tracking registration method,which needs to scan specific cards or objects,which makes the system's versatility greatly reduced.Therefore,the paper adopts the unmarked registration method based on natural feature points,which has the advantage of not needing to take a specific card or a marker,and can scan the Chinese characters that can be seen everywhere in the usual book,and display the corresponding virtual information in real time,improving The versatility of the literacy system,which is also the main innovation of the paper.The main work of this paper is as follows:(1)Describes the background significance of the research and the research status at home and abroad,and then make a brief analysis of the system requirements from the overall and details of the system.Then divides the system into four functional modules,namely user interface module,data processing module,network communication module and Augmented Reality module,and detailed design of each module(2)Explain the specific implementation process of the four functional modules,and introduce the methods used in it.The first is the user interface module,which is implemented using the SurfaceView class in Android UI development;the second is the network communication module,which uses the TCP-based Socket data transmission method;then the data processing module,which encapsulate and parse related data in the system using json data format and gson tool;Finally,the AR display module uses the unmarked registration method based on natural feature points to perform feature detection and feature matching on the real-world image captured by the camera and the template image in the database,and use the matching result to calculate the homography matrix to obtain the camera.The outer parameter matrix is then combined with the internal parameter matrix of the camera itself to determine the rendering position of the virtual information in the real world.Next,the virtual information corresponding to the Chinese character is merged with the real-world Chinese characters to achieve the enhanced display function of the Chinese character.(3)This thesis implements a children's literacy system based on augmented reality technology on the Android platform.The system can use mobile phone cameras to recognize Chinese characters in the real world,and display corresponding pinyin,English and three-dimensional gestures on the screen of the mobile phone in real time.Model and other information.