The Design And Implementation Of The Interactive Theater Game System Based On Multi-modal Interaction

Interactive cinema is one of the main forms of entertainment in the field of theme parks.Under the trend of development of human-computer interaction and virtual reality technology,the interactive theater combines the now mature 3D stereoscopic video technology and multiplayer interactive technology,so that the audience can involve in the film’s environment and plot through the appropriate interactive devices,and they can immerse in and feel that they are the role of the film,and continue to interact with the video content.The dynamic system will simulate the corresponding action.The most important feature of the interactive theater is that the audience can participate in,and even change the film plot,achieve a certain purpose through cooperation,promote the plot and ultimately success.Interactive mode is complex and increasingly mature today,however the interactive theater is still dominated by shooting theater,and the interactive devices used are a still ordinary interactive gun,which leads to a single interaction and bad empathy.The simulation action generated by the dynamic system is still pre-recorded motion data according to the film,and is not in good conformity with the video content.Although the audience can work together to complete the tasks of the video interaction,the audience participate in the video interaction in the same way,and there is no division of labor and interaction among the audience,which causes poor interactive experience.In this paper,an interactive theater game system based on multimodal interactive mode is introduced.This system uses 3D stereo display technology based on arc screen stereo projection,which can achieve the real-time rendering of high-resolution stereoscopic images.This system includes several three-degree-of-freedom dynamic seats,a six-degree-of-freedom platform(which is equipped with a steering wheel,a throttle and a brake),and several interactive guns that can provide recoil,mobile phones and kinects.The multiple-degree-of-freedom dynamic system equipped with 3 DOF seats and 6 DOF dynamic platform can simulate a more natural action,and the steering wheel,throttle,and brake on the platform enrich the interactive mode of the system;the interactive guns used in this system can provide recoil which makes user experience more real and stimulating;The system also allows players to access their mobile phones to participate in the interaction,which can solve the problem that players cannot join the entertainment in case of the lack of interactive devices.Kinect gesture recognition introduces a natural interactive way,which is novel and interesting.The system allows the audience to experience different ways of interacting with each other.It is a combination of division of labor and cooperation to complete the task.The system integrates immersion,interactivity,fun and challenge,which fully embodies the characteristics of interactive theater.