| Human-computer interaction is a subject that studies the interactive relationship between human and computer,and user interface is an important medium to realize the exchange of information between human and computer.At present,with the continuous development of virtual reality technology and interactive graphics,the traditional two-dimensional human-computer interaction based on mouse and keyboard has been unable to meet people's interaction needs for the digital world,and the three-dimensional field of interaction technology,interaction mode and user interface has gradually become a hot topic for scholars to study.In the field of three-dimensional interaction,large-scale and complex interaction scenes,as well as multi-dimensional interaction channels,have brought huge workload to the development of user interface,and the interfaces,protocols and data formats of various interactive devices are not exactly the same.In the secondary development using the existing interactive devices and interfaces,the workload of the secondary development is almost the same as that of the initial development,because the data of the interactive devices are numerous and the interfaces are complex.At the same time,3D user interfaces do not have the same design style and development tools as 2D WIMP interfaces.When 3D interactive equipment is applied to medical treatment,education,military and other fields,workers in different professional directions usually do not have the foundation of the underlying code development in the field of 3D interaction.According to the above problem,this article in the independent research and development of three-dimensional multichannel device on the basis of large space pen interaction,developed a highly efficient development can help users three-dimensional three-dimensional multimodal user interface to the user interface tools,the reuse of 3D user interface is more convenient,also provide 3D user interface development and application of new ideas.The main research contents and innovations of this paper are as follows:(1)A description method of user interface in 3D multi-channel environment is proposed.In view of the possible interaction behavior of users and the analysis of the interface content,the 3D multi-channel user interface is described at different levels,and based on the declarative mark-up language-XML,with the structured description document as the core,the 3D user interface generation tool is developed.The user does not need to have the skilled 3D interface program development experience,and the professional 3D computer graphics knowledge,can quickly build the user interface.(2)In this paper,a three-dimensional multimodal interaction technology set,the pen type modular,gestures,voice,and other interactive technology,and encapsulated in a reusable library,the user when interacting with the interface at the same time may produce the interaction of the abstraction of the unified description,and build a visual interface,to provide users with simple and convenient interface,to make it through the interactive technology development user interface,do not need to fully grasp the method to realize the interactive technology,only need to design a specific interactive logic,so as to improve the efficiency of interface development.(3)Based on the user interface generation tool responsible for developing the content of interface components and the 3D multi-channel interaction technology set responsible for developing interface interaction functions,a 3D multi-channel user interface tool for rapid user interface development is formed with the help of a commercial 3D development engine.Based on the three-dimensional multi-channel large-space pen interactive device,the application software of multi-channel teaching of human body structure in the field of medical education is developed by using interface tools.The usability of 3D multi-channel user interface tools is verified by evaluating the efficiency of interface development and the usability of tools. |
PDF Full Text Request