Research On Matural Human-Computer Interaction For Children

In today’s society, with the increasingly sophisticated technology of human-computer interaction, multi-modal human-computer interaction has become the mainstream design because of its powerful function; however the interaction design for children rarely used this kind of mainstream; not only does most children’s software at home and abroad still uses the traditional means of interaction, like mouse and keyboard, but also the graphical user interfaces are full of metaphor icons, which is not suitable for children to interact with the computer; thus bringing to children some negative impacts in terms of the physical and cognitive development, let alone to achieve the purpose of natural interaction between humans and computers.In this thesis, we first analyze the advantages and disadvantages of the existing interactive systems for children; then from the perspective of design psychology and cognitive psychology, we propose child-centered principles for interaction design, based on which NIPad,a multi-modal human-computer interaction system for children, has been designed and implemented to evaluate the feasibility of our principles and system framework. NIPad consists of three modules:gesture recognition module, tangible user interface module and3D game module, which is implemented by using Microsoft kinect and Open NI framework, RFID and Unity3D respectively. The gesture input and tangible input data are integrated by finite-state machine based semantic fusion, and a kind of multi-dimensional interactive task is generated to control Avatar. In NIPad, children can use gestures and tangible user interfaces to control Avatar interaction; therefore, NIPad can achieve the purpose of what you get from what you see.Finally, we elaborate the key technologies of NIPad from the perspective of system implementation. Our system test shows that NIPad is feasible; thus it theoretically can help children interact with computers naturally.