Enhanced Reality System In 3d User Interface Design And Implementation

As the communicational interface between human and computer, User interface denotes the specific modality of HCI which is directly related to a HCI system's success or not. AR is a kind of 3DUI technologies which can realize the user's series of interaction in a mixed, syncretic, united world of physical world and virtual world owns a wide application foreground and becomes an important pattern of the next generational UCD user interface. However, AR also takes new problems about interaction manner, interface metaphor, usability and so on which are completely different from that in 2D user interface technology. So, the keypoint of AR system is to research 3D user interface suited to very application background under 3D mixed environment.Being aim to improve user's realistic visualization and three dimensional interaction under equipment maintenance background and by the academic direction of usability engineering based on ergonomics and psychology, it implements requirement and task analysis which would export characters of interface elements, interaction technologies and blue print of system. The main idea of this paper is designing 3D user interface in 3D mixed environment which make use of interface metaphor, computer graphics'algorithms and gesture interaction technology. Finally, it presents two kinds of 3D user interface which are appropriate and reasonable in AR system, as follows:The first one is a 3D user interface based on improved graphic user interface. The interface's entity module adopts idea of desktop metaphor of GUI. And the virtual module makes the best of many techniques from graphic drawing and rendering technologies. It also researches and realizes exact registration between virtual module and real scene which can achieve alliance between virtual world and real world.The other one is a 3D user interface based on gesture recognition technology. The tracking part of gesture recognition system is a way of visual tracking method by help of markers which avoids complicated algorithms and request of dear tracking devices. The template matching part based on gestures collection endows every gesture with syntax which then drives interaction in practicable applications.When UI is finished, this paper builds two practicable examples and adopts methods in usability principles to perform experiential evaluation. The result shows that interfaces are feasible in which concepts are clear, virtual information's expression is diversification. Gestures interaction part can realize direct natural interaction without mediate media between gestures and real ones which implements basic technologies of TUI contributes a lot to UI's usability. By comparison to the former system's UI, new user interfaces'interaction efficiency is improved and user's perception and cognition are coherent preferable.