Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Research and Evaluation
    • Technical Assistance
  • Our Experts
  • News & Events

You are here

  • Home
30 Dec 2017
Report

Scientific Evidence for the Validity of the New Mexico Kindergarten Observation Tool

Katie Dahlke, Rui Yang, Carmen Martinez, Suzette Chavez, Alejandra Martin, and Laura Hawkinson
Joseph Shields, Marshall Garland, and Jill Carle, Gibson Consulting Group

The New Mexico Public Education Department developed the Kindergarten Observation Tool (KOT) as a multidimensional observational measure of students’ knowledge and skills at kindergarten entry. The primary purpose of the KOT is to inform instruction, so that kindergarten teachers can use the information about their students’ knowledge and skills from the KOT to inform their curricular and pedagogical decisions. Stakeholders also are interested in using data from the KOT for other purposes, such as assessing student readiness for school statewide and identifying disparities in students’ readiness for school across the state.

This study examined the construct validity of the KOT to determine whether data from a field test supported using the KOT to measure six school readiness domains and, if not, what domain structure the data best supported.

Key Findings

  • Construct validity analyses supported an overall general school readiness score and two domain scores: a cognitive school readiness domain score and a noncognitive school readiness domain score. The analyses did not support the six domain scores identified by the developer.
  • KOT domain scores were moderately correlated with scores from an established measure of early literacy skills, and the correlation patterns support the conclusion that the KOT domains measure distinct dimensions of school readiness.
  • Rating categories were distinct (that is, no category was redundant) and ordered appropriately (that is, teachers used higher rating categories for students with higher overall ability).
  • Substantial classroom-level variation was found for KOT domain scores and item ratings. Such variation is not uncommon among observational measures or indirect assessments, but it raises questions about the extent to which scores measure students’ true abilities.
PDF icon Scientific Evidence for the Validity of the New Mexico Kindergarten Observation Tool (PDF)

Further Reading

  • Children’s Knowledge and Skills at Kindergarten Entry in Illinois
  • AIR Study Finds California’s Transitional Kindergarten Gives English Learner Students Advantage for Kindergarten
  • American Institutes for Research Experts to Present About Education and Workforce at National Public Policy Conference
  • Three Decades of Education Reform: Are We Still "A Nation at Risk?"
  • Impact of California's Transitional Kindergarten Program, 2013-14
Share

Contact

Image of Katie Dahlke

Katie Dahlke

Principal Researcher

Topic

Education
Early Childhood and Child Development

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

Education
Health
International
Workforce

Client Services

Research and Evaluation
Technical Assistance

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1400 Crystal Drive, 10th Floor
Arlington, VA 22202-3289
Call: (202) 403-5000
Fax: (202) 403-5000

Copyright © 2021 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap