| The focus of this study was the design of an interactive instrument for assessing levels of use of a pedagogical and technological innovation. Objectives were to: (a) report instrument development efforts and issues; (b) investigate reliability, validity, and usability of the instrument; (c) use the data obtained, if the instrument were shown valid, to assess change efforts; and (d) describe the process of conducting research in a program evaluation setting. Quantitative and qualitative methods were used to evaluate findings and explore the diversity of behavior in teaching with technology.;The development of the instrument built on an established method of measuring levels of use of an innovation. The Concerns Based Adoption Model dimension of Levels of Use (Loucks, Newlove, & Hall, 1975) formed the foundation for the interactive web-based tool for educational program evaluation. This self-administered questionnaire was designed and tested in the context of a project promoting the use of computer hardware and software as well as constructivist, brain-based, cooperative, and collaborative learning techniques.;At its current stage of development, the instrument showed acceptable reliability, validity, and usability in measuring Levels of Use of technology and innovative teaching strategies. In addition, the web-based questionnaire recorded behavioral data effectively and efficiently. It is hoped that this instrument will become a valuable tool with established psychometric properties for program evaluation as well as research. |
