Design Research Of Shadow Puppet Manipulation Interactive System Based On Augmented Reality

Shadow puppet is China’s precious intangible cultural heritage.However,with the development of the times,the shadow puppet art has fallen into a difficult development predicament.At present,domestic and foreign scholars use digital technology to protect shadow puppet art.The research on digital protection of shadow puppet mainly includes digital preservation and creation of shadow puppet characters,creation of digital animation with shadow puppet elements,and human-computer interaction applications.However,in the current research field of digital protection of shadow puppet,there are few researches on digital protection of shadow puppet manipulation techniques.At present,in the digital research of shadow puppet manipulation techniques,one is to use a manipulator instead of a master to operate the shadow puppet,and the other is to use gestures to control the movement of a virtual shadow puppet character.The former cannot allow humans to experience the joy of manipulating shadow puppet,while the latter abandons the shadow puppet joystick and loses the characteristics of traditional shadow puppet that users use a stick to manipulate shadow puppet.In order to solve the above-mentioned problems in the digitalization of shadow puppet manipulation techniques,the article studied the technical characteristics and application scenarios of augmented reality technology,and decided to introduce augmented reality technology into the digital protection of shadow puppet manipulation techniques.The article uses the augmented reality device as the hardware carrier to design a shadow puppet manipulation interaction method that allows users to hold a real wooden stick and bring Holo Lens to manipulate virtual shadow puppet in an augmented reality environment.Among them,there are two technical difficulties to realize this manipulation interaction mode.One is to design real-time digital animations for the virtual shadow puppet so that the virtual shadow puppet can move according to the user’s control.The second is to design a fast and accurate wooden stick key point tracking algorithm,so that the device can capture the position of the manipulating stick in time,so that the virtual shadow puppet character can give feedback.Therefore,the article first uses skeletal animation technology based on dynamic principles to design and describe the actions of shadow puppet.Then,the article takes the case segmentation algorithm based on deep learning as the core,and designs a fast and accurate wooden stick tracking point algorithm framework.Finally,the article applies the above two solutions to design an interactive system for shadow puppet manipulation in an augmented reality environment,and evaluates the usability of the system.In the design of the digital shadow puppet character’s action description method,the innovation of the article is to introduce the collider and gravity mechanism into the skeletal system to solve the problem of wearing the model during the movement of the character and simulate the natural sagging posture of the real shadow puppet.In the design of the wooden stick key point tracking algorithm,the innovation of the article lies in the introduction of one-dimensional convolution and dynamic convolution in the depth model,which ensures that the model processing speed is increased without reducing the accuracy.The interactive system for shadow puppet manipulation in the augmented reality environment designed in this article simulating the traditional way users manipulate shadow puppet,simplifies the difficulty of traditional manipulation methods,and allows people with no performance experience to perform shadow puppet.The research content in the field of digital protection of shadow puppet manipulation techniques provides new ideas for the digital protection of shadow puppet art.