Research On Collaborative Interaction Model Of Multi-User Multi-Device In Mixed Reality

Mixed reality is a computer technology that enables virtual objects and the real world to be displayed in the same visual space.This technology can not only enhance users’ understanding and perception of the real environment,but also provide users with natural and expanded ability to interact with the real environment.In recent years,mixed reality technology has been widely used in social entertainment,education,games,medical treatment,and other fields.With the expansion of application scenarios and the increase of the number of users,the research focus of mixed reality has shifted to multi-user collaboration and cross-device interaction.The interaction demand of multi-user multi-device collaboration puts forward higher requirements for human-computer interaction technology and interaction model.At present,the research on multi-user multi-device collaborative interaction in mixed reality still faces many problems,such as the lack of a unified and effective top-level interaction model,the application of multi-user interaction system and the research of heterogeneous hardware device mixing are not mature,and the lack of comprehensive user research on system evaluation.Therefore,based on the interaction technology and theory in mixed reality,this thesis proposes a four-element model and implements a prototype system of multi-user multi-device collaborative interaction in mixed reality environment.In the prototype system,three kinds of user interfaces are designed according to the interaction characteristics of different devices.Finally,the usability of the prototype system and user interface design is evaluated through user experiments.The main research contents of this thesis are as follows:(1)We studied the framework of multi-user multi-device collaborative interaction in mixed reality,including interaction technology,interaction equipment,interaction theory,collaborative interaction design concept and evaluation method of interaction system.According to the interaction characteristics of multi-user multi-device in the mixed reality environment,we summarized six design principles and proposed a collaborative interaction model of multi-user multi-device,namely the four-element interaction model of user-resource-interaction-task.(2)Based on the four-element interaction model,this thesis designed and implemented a multi-user multi-device collaborative interaction prototype system.Meanwhile,we designed three kinds of user interfaces in the system: multi-touch user interface,3D user interface and hybrid user interface.In order to maintain a stable interaction environment and the consistency of interaction scenarios,this thesis built an asynchronous network framework with low latency,high performance and compatibility with multi-platform devices.(3)We took the chemical experiment scene in middle school as an example,and then demonstrate the usability and effectiveness of the system through user experiments.We evaluated the three user interfaces from four aspects: user presence,interaction satisfaction,user preference,and post-experiment interviews.The hybrid user interface is better than the other two user interfaces in terms of interaction efficiency,immersion and interaction comfort.Hybrid user interface is more favored by users in terms of use preference and it will be widely used in human-computer interaction in the future.