The New Eye Mouth Manipulation Of Man-machine Interaction Pattern Research And Practice

In recent years, Human have more and more demand for the develepment of the New Human-Computer Interaction with the the rapid development of computer technology. The reason is that the New Human-Computer Interaction plays a important role when the traditional way of input such as mouse, keyboard is difficult to implement or cannot be achieved. To make the communication of huamn and computer more natural,intutive and effective is the purpose of all the New Human-Computer Interaction.Among them, the human-computer interaction based on vision has more and more researchers’ attention and has achieved fruitful results,especially when the user in the condition such as temporarily lose sports ability or disability, this will be one of the most direct and effective way of human-computer interaction.In order to improve the human-computer interaction technology that based on vision, Eye and Mouth control is proposed in this paper as a new type of human-computer interaction way, for those who are not convenient to use traditional input tools conveniently.First, we improve the method of detecting the state of mouth and eye and designe the critical state template that as the basis of detecting the state of mouth and eye,which both simplify thealgorithm and processof detecting the eye and mouth ’s state and ensure the recognition accuracy and credibility.Second, we design eight kinds of instruction based on the eye and mouth state,and map the eight kinds of instruction to some commonly interactive deveices such as the mouse, keyboard, body feeling game devices, to achive the purpose of using eye and mouth can control any movement in the virtual scene, making the interaction more simple and direct.Last,we design some virtual scene and finished a system using the eye and mouth to control the object’s movement. At the same time,we do experiments to prove our system work well.Our method can be applied to intelligent control, robot, movies, medical, military and other areas, it will bring great breakthrough for the development of human-computer interaction technology.