THE RELIABILITY OF THE INSTRUMENTS AND PROCEDURES OF A NATIONAL ACCREDITATION SYSTEM FOR EARLY CHILDHOOD PROGRAMS. (VOLUMES I AND II)

The purpose of this study was to examine the reliability of the instruments and procedures developed for use in a national, voluntary accreditation system for early childhood programs, sponsored by the National Association for the Education of Young Children. This study tested the reliability of the Early Childhood Classroom Observation instrument, used by program personnel and outside observers to evaluate the program's compliance with the accreditation criteria. This study also tested the reliability of the procedures whereby the program's report of their compliance with the criteria is verified by outside observers, called validators. Finally, this study examined the level of accuracy of program personnel in reporting their compliance.;Data for this study were collected in 31 early childhood programs in four states--California, Florida, Minnesota and Texas. To test the reliability of the verification process, 23 of the 31 programs received two independent verification visits.;The reliability of the Observation instrument was analyzed by correlating the ratings of different observers--teachers, directors, and validators--coding the same classroom on different occasions. The results indicated moderate but significant correlation coefficients on the total score and most of the individual items. The internal consistency of the instrument was analyzed using item analysis and factor analysis. The results of the item analysis indicated that the most discriminating items were those related to preschool curriculum and staff-child interactions. The factor analysis yielded three strong and stable factors within the instrument defined as: Preschool Curriculum, Positive Interactions Among Staff and Children, and Balanced Schedule of Activities.;The reliability of the verification process was tested by comparing the results of the two independent visits of 23 centers. The comparison resulted in a moderate, but significant correlation on total score between the two visits. Analysis of the frequency with which the center's report of their compliance was verified by outside observers indicated that program personnel were accurate evaluators of their programs.;The results of this study were used to revise and refine the instruments and procedures prior to national implementation of the accreditation system and to identify content for training of on-site visitors.