Research On Construction Of The Design Rules Of The Integration Of Educational Image And Text

With the advances in science and technology and the accelerated pace of people’s life,the current society is entering into the so-called "visual culture" and"image era".Image expansion has become an indisputable fact in the field of life and education,and the strong stimulation of rapid overload brings about a series of negative effects such as shallow reading and word retardation.In fact,both image and text are the main ways to convey information and represent the world,and the two are an important part of human languages.In the context of modern digital communication,image-text representation embodies openness,interactivity,non-linearity and many other new features.How to make the logical relationship between the image and text be effectively linked to help learners to think deeply and improve their cognitive level has become the most essential problem in the design of multimedia information.The paper takes the construction of the design rules of the integration of the image and text as the basic goal,combined with the needs of the study,reviewing and commenting on the three aspects of multimedia learning,image and text research and visualization for promoting thinking.In recent years,related researches and practices show that the rules of multimedia design should focus on how to guide or promote learners to think better;the concept of the integration of the image and text is the best design direction,whose purpose is to make the two together and allow their synergy to play the maximum effectiveness;visual thinking should be based on the visualization of knowledge,exploring the characteristics of knowledge and the law of thinking behind it.The paper includes the investigation and research on the current problems existing in multimedia design and application,from which to understand the students and teachers’ general needs of multimedia design.Combined with experts’ interview on the "promoting cognition in multimedia design" and by the way of logical and critical thinking under the theoretical framework of Linguistics for Multimedia Design,the paper has deduced the fusion design model of educational image and text(the theoretical design version and the design process version)and also has found out the working mechanism of the fusion design model.The model contains the design logic,which makes the complex design activities become more stable and orderly.The model points out the basic way of the integration of the educational image and text that establishing the mapping between the images and text from four aspects of"image-text correlation","semantic schema","interaction" and "clues".Based on the basic way of the integration of educational image and text,a series of eye movement experiments are carried out in the thesis.And by observing and studying the eye movement behavior and learning effect of subjects,the design rules of the integration of educational image and text are found out.The results of eye movement experiments are summarized as follows:(1)In the study of image and text,the effect of learning is closely related to the relevance of image and text,and it increases in pace with the improvement of the relevance;high correlation to some extent can help learners to integrate the information of image and text,and reduce the cognitive burden.(2)Using propositional semantic network diagram to present declarative knowledge and using generative semantic diagram to present procedural knowledge is helpful for learning;Adding semantic diagram corresponding to text reduces the cognitive load of learners although the amount of information increases;The semantic diagram changes the attention allocation of the learners in the learning of the picture,but after all the text reading is the dominant;By building semantic diagram has a certain effect on learning,but it will increase the cognitive load and change learners’ reading mode;Semantic diagram also has played a certain role in promoting learning,while the precondition is that its organization structure should match the knowledge structure;The structure of the semantic diagram will change the learner’s attention allocation,and the matching structure will make the learners pay more attention;(3)Interaction can promote the construction of knowledge,but at the same time it will occupy more cognitive resources;Interaction has a significant role in promoting the transfer performance of learning the materials with a high level of abstraction;To a certain extent,Interaction can give learners a better user experience;Interaction helps to inspire learners to allocate attention as needed;(4)Clues can promote the effect of shallow learning,but in deep learning the conclusions are different;Clues can increase the attractiveness of the key parts of the image and the depth of the image processing;In image and text reading,the image and text related clues allow learners to accurately and quickly process a specific area,which will increase the learners’ attention to the clues;Compared with the static images,the clues in the dynamic picture can not enhance the deep processing of the picture area or the text area to the learners,and to some extent it reduces the effectiveness of the clues.The paper makes an in-depth analysis of the eye movement experiment data,discovering the four design rules of the integration of educational image and text such as the rules of image and text related,the rules of semantic diagram,the rules of interaction,and the rules of related clues,all the rules including sixteen design rules.In addition,the paper makes a test of the feasibility of the design rules in the real design practice and the existing problems.The test results show that in general,the design rules summarized by eye movement experiments are feasible.