A Comparative Study On The Effect Of Response Formats On Reading Test Score Under Online And Offline Modes

This study,based on Bachman’s test method facets theoretical framework,aims to explore the effects of paper-based and computer-based modes and three common response formats(i.e.,multiple-choice question,gap-filling question,and short-answer question)on EFL learners’ reading test scores as well as the impact of the interaction between the test mode and response format on the test results.Forty-eight freshmen English majors from two parallel classes in a university in northeast China participated in this experiment.Each class was subject to a relevant reading test in two test modes.Each reading test paper contains three passages,and each one tests one type of format.The online data collection in the study was done with the help of Rain Classroom software and the sources of data include students’ test scores under different test modes and a follow-up questionnaire.By comparing the effects of different test modes and response formats on the participants’ reading comprehension scores,we found that different test modes and response formats have different effects on students’ reading test scores.Among them,the score of paper-based tests is higher than that of computer-based tests.Whether under the paper-based or computer-based test,the correct rate of multiple-choice questions is the highest,and the gap-filling question is relatively low.In the paper-based mode,multiple-choice and gap-filling questions can better differentiate students’ reading comprehension.In the computer-based mode,the combination of multiple-choice and gap-filling questions or multiple-choice and short-answer questions significantly impacts students’ test scores.Finally,although both test mode and response format significantly affect L2 learners’ reading test scores,the interaction between the two variables is not significant.That is,the influence of the test modes on the test score does not change due to the change of the response formats and the influence of the response formats on the test score does not change due to the change of the test modes.This study may provide some valuable insights into foreign language teaching and foreign language testing.Teachers can design the test papers reasonably by understanding the testing effect of different response formats.The research can also provide reference for teachers to better respond to the increasing normalization of the online testing.