A Research On The Influence Of Integration Of GUI And AUI Based On Synesthesia To Software Usability

The maturity of Internet technology has promoted the rapid growth of mo bile intelligent terminal market,which gave impetus to the rapid development of application software.To adapt to this,the focus design moves to the impr ovement of the user experience of Internet product gradually.However,there are still many problems in the current mode of human-computer interaction.T he information communicating between human and computer is still relies on the single sensory(vision)too much,causing the high pressure of visual chann el,low efficiency of information acquisition and usability of products.Psychol ogical studies have shown that the way of multi-sensory information exchange can improve the quality of completing specific task effectively.Hearing,as a sensory which is second to visual,can be a good complement.Besides,sound can increase the amount of information it gets or reduce the d ependence on visual.Software usability experiment found that the integration of auditory user interface and visual user interface has a significant improvem ent of reducing the time to complete task,wrong operating rate and workload.The key element becomes how to establish the relationship of these two sens ory from the perspective of user's cognition.This paper starts from the desig n language of current visual user interface and the constituent elements of au ditory user interface,and extracts the basic interface elements(color and earc on).Therefore,it is necessary to explore the relationship between the color a nd the earcon to build the association.The base for establishing integration user interface is to know the relationship between the different physical elements of color and earcon.From the concept of synesthesia,this paper explores the correlation between color and sound by designing psychology experiment.An actual design project where different timbre systems are added to specific color is used as a platform for single-factor test experiment.This experiment treats the elements of measuring the software usability as the experimental indicators to test the accuracy of the research conclusion,and then research the effect of audio-visual integration on the usability.In this paper,the main innovations include:summarize the main functions of color in current user interface style,and propose that color plays an important role in improving the usability of product;find the relationship between color and timbre which can broaden the scope of psychology and diversify the kind of interface design;the conclusion of the relationship between sound and color provide a new way to establish a unified interface;The combination of visual user interface and auditory user interface can effectively improve the usability of software.