Augmentated Reality Based Interactive Learning System For Chinese Guqin

The Guqin, a seven-stringed fretless zither, is the most representative traditional musical instrument in China, and also an important world intangible herritage. However, the character and cultural value of the Guqin, especially the complexity of its unique notation and theory hasmade it very difficult for nomal beginners, thus severely limited its popularity in the modern world.With the development of information processing and interaction technology, augmented reality has been increasingly applied to enhancing musical instreament learning in order to gain better efficiency and experience.With the goal of providing an easy and effective way of learning Guqin for beginners, this paperintroducedan interactive learning systemcalled ChinAR which employs augmented reality. This sytem can attatch the visuliazedinformation of static or dynamic instruction directly to the instrument, it also provide natural user interface and learning modes using audio processing and gestures recognition, in order to facilitate the harmony between visual, aural and behavioral practice systematically.There are three main contributions in this paper:(1)a systematic method to design for instrumental learning combing visual, aural, behavioral elements and guiding modes(2) anatural user interface for the instrument learning system applying gesture detection;(3) a primary validation of the effect of augmented reality in facilitating learning of the Chinese Guqin. The result of user study showsthe design of ChinAR is helpful in providing better learning experienceand enhancing performance and memorization with markedly less time spent learning.This work shows how a new interaction method helps promote the use of heritage instruments and culture, and illustrates new methodology for musical learning system design.In this paper, I will first review the background and related works before describing the design and inplemention of ChinAR in detail, followed by the user study and its discussion, and finallyconclude with an overview and future work.