AR Three-Dimensional Picture Book Multi-Modal Interactive Experience Innovation Design And Research

With the rapid development of information technology and artificial intelligence,the way children learn in the 21st century has also undergone major changes.The traditional one-way communication and passive learning methods can no longer meet the learning needs of contemporary children,and children also tend to choose multi-sensory and interactive picture books when choosing picture book reading.At the same time,with the gradual development and maturity of AR technology and three-dimensional structure technology,the combination of the two has become possible.The application of AR in three-dimensional picture books can greatly improve this situation,and the three-dimensional structure can provide children with rich interactive forms.,AR can integrate various modal information with each other,so as to fully mobilize children’s visual,tactile,auditory and other sensory organs,and build a rich sensory experience for children.Therefore,how to organically combine AR and three-dimensional picture books to provide children with a multi-modal interactive experience has become the focus of this research.This paper firstly conducts research on AR technology,three-dimensional picture books and multi-modalities,sorts out the characteristics,development status,advantages and educational significance,etc.,discusses the realistic background and possibility of AR,three-dimensional picture books and multimodal combination,and discusses From the perspective of narrative design,we discuss the possibility of combining AR,multi-modality and three-dimensional picture books,and then combine the case to analyze the narrative method of threedimensional picture books from the functional layer,the action layer,and the narrative layer,and sort out the key narrative elements.Furthermore,with the help of the relevant theories of interaction design,the AR scene is taken as the research object,and the narrative influence of AR technology on the three-dimensional picture book is analyzed from an example,as well as the interface narrative,interactive narrative and multimodal media fusion narrative in the AR scene.Summarize the elements of narrative design in AR scenarios.Then,carry out user research on the physiological and cognitive development characteristics of preschool children and the interaction level of AR devices,and summarize the design suggestions for AR multimodal interaction experience based on preschool children.Dimensions,extract the narrative design elements of AR multi-modal three-dimensional picture books and clarify design ideas.Finally,using the related theories of narrative design,interaction design and user experience design,the AR multi-modal three-dimensional picture book "Langlang" is designed and AR application development is carried out.This research presents the design process of AR multi-modal interactive experience by combining the narrative design method to create AR multi-modal three-dimensional picture books.