Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • AIR Assessment
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Student Assessment
    • Research and Evaluation
    • Policy, Practice, and Systems Change
  • Our Experts
  • News & Events

You are here

  • Home
30 Dec 2017
Report

Scientific Evidence for the Validity of the New Mexico Kindergarten Observation Tool

Katie Dahlke, Rui Yang, Carmen Martinez, Suzette Chavez, Alejandra Martin, and Laura Hawkinson
Joseph Shields, Marshall Garland, and Jill Carle, Gibson Consulting Group

The New Mexico Public Education Department developed the Kindergarten Observation Tool (KOT) as a multidimensional observational measure of students’ knowledge and skills at kindergarten entry. The primary purpose of the KOT is to inform instruction, so that kindergarten teachers can use the information about their students’ knowledge and skills from the KOT to inform their curricular and pedagogical decisions. Stakeholders also are interested in using data from the KOT for other purposes, such as assessing student readiness for school statewide and identifying disparities in students’ readiness for school across the state.

This study examined the construct validity of the KOT to determine whether data from a field test supported using the KOT to measure six school readiness domains and, if not, what domain structure the data best supported.

Key Findings

  • Construct validity analyses supported an overall general school readiness score and two domain scores: a cognitive school readiness domain score and a noncognitive school readiness domain score. The analyses did not support the six domain scores identified by the developer.
  • KOT domain scores were moderately correlated with scores from an established measure of early literacy skills, and the correlation patterns support the conclusion that the KOT domains measure distinct dimensions of school readiness.
  • Rating categories were distinct (that is, no category was redundant) and ordered appropriately (that is, teachers used higher rating categories for students with higher overall ability).
  • Substantial classroom-level variation was found for KOT domain scores and item ratings. Such variation is not uncommon among observational measures or indirect assessments, but it raises questions about the extent to which scores measure students’ true abilities.
PDF icon Scientific Evidence for the Validity of the New Mexico Kindergarten Observation Tool (PDF)

Further Reading

  • Children’s Knowledge and Skills at Kindergarten Entry in Illinois
  • American Institutes for Research Experts to Present About Education and Workforce at National Public Policy Conference
  • AIR Study Finds California’s Transitional Kindergarten Gives English Learner Students Advantage for Kindergarten
  • AIR Research Experts to Present at the Spring 2018 Conference of the Society for Research on Educational Effectiveness
  • Focusing on Mathematical Knowledge: The Impact of Content-Intensive Teacher Professional Development
Share

Contact

Image of Katie Dahlke

Katie Dahlke

Principal Researcher
Rui Yang

Rui Yang

Senior Researcher

Topic

Education
Early Childhood and Child Development

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

AIR Assessment
Education
Health
International
Workforce

Client Services

Student Assessment
Research and Evaluation
Policy, Practice, and
Systems Change

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1000 Thomas Jefferson Street, NW
Washington, DC 20007
Call: (202) 403-5000
Fax: (855) 459-6213

Copyright © 2019 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap