Human-Computer Interaction Research And Design Of Hardware And Software System On Mixed Reality

Human-computer interaction technology is a hot research topic in the field of computer, seeking for a more natural, flexible way of interaction is the constant pursuit goals. In recent years, there are vast number of consumers and developers have shown the constant attention for interactive multi-touch technology, and recently the commercial products show that the application trend of multi-touch technology is everywhere. In the human-computer interaction area, mixed reality technology breaks through the traditional display technology in time and space limit, let the audience obtain novel and interesting and in-depth comprehensive interactive experience through a variety of different ways of interaction. Therefore mixed reality multi-touch interactive platform will have a larger market space and user groups.In the field of multi-touch technology, the multi-touch system designed by the optical principle which is an active branch of research currently, and some mature technology and products have been come out. In the field of multi-touch, the multi-touch system design based on the principle of induction is currently more active branches of research, and a few mature technology and application in the product. Although multi-touch platform simplifies the user’s manipulation of the process, but because lack of real physical touch pure virtual interaction platform also bring certain problems for the user. Compared with that, the traditional operation controllers such as keyboard, mouse, have good physical touch, without watching user can also operate smoothly. So this paper puts forward Hardware and Software System on Mixed Reality. Research and design a set of new recognition algorithm and interactive software platform, not only can feedback to the finger touch and can identify mixed reality multi-touch physical controls MTW (Multi-Touch Widget). On this basis, developed multi-touch interactive platform mixed practical characteristics based on three different optical touch technology. This paper has following main research:1) The design of IRS recognition algorithm in the multi-touch technologyThe recognition algorithm of Multi-touch technology is the foundation of this platform,with stable and reliable recognition algorithm, interactive software can get accurate, gestures and mixed reality multi-touch finger object control information data. In this section, introduce the design of recognition algorithm, including architecture design of multi-touch image recognition algorithm,the design of target monitoring algorithm and the design of the target tracking algorithm.And expounds the design of mixed real multi-touch controller MTW (Multi-Touch Widget), the recognition method of IRS for the MTW. The IRS can not only identify the finger but also the MTW for touch definition.2) The research and design of UMOT human-computer interaction software platform based on the IRS recognition systemIn this section, introduced the research and design of UMOT human-computer interaction software platform based on the IRS recognition algorithm identifying fingers and MTW touch information.And describes the architecture design of software platform, design of engine architecture and its function in detail.3) The research and design of mixed reality human-computer interaction the hardware platformA stable and high performance human-computer interaction hardware platform is quite important for IRS recognition algorithm and UMOT interactive software platform to deploy. This paper focuses on three different optical multi-touch technology, research and design these hardware platform. In this section, introduce the research and design of interactive multi-touch hardware platform based on three different multi-touch technology and UMOT software platform.The three kinds of multi-touch technology are laser plane respectively multi-touch technology, optical multi-touch box and FTIR multi-touch technology. 4) SummarizeFinally, the tests of this system and how to improve are discussed. The next step of the work is also summed deeply.