Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Research and Evaluation
    • Technical Assistance
  • Our Experts
  • News & Events

You are here

  • Home
30 Aug 2013
Report

A Validity Study of the NAEP Full Population Estimates

Victor Bandeira de Mello (AIR) and Larry V. Hedges (Northwestern University)

This paper documents research into the validity of imputation procedures used to calculate NAEP scores for excluded students and used to provide adjusted or full population estimates (FPEs) for NAEP assessments. The research used data from two special inclusion studies conducted in conjunction with the 2011 NAEP Mathematics Assessment in which operationally excluded students were assessed by offering them either a calculator accommodation or a test booklet made up of Knowledge and Skill Appropriate blocks that were easier than standard NAEP blocks.

By comparing actual test results (i.e., plausible values) and full population estimates for these operationally excluded students, the study was able to evaluate the extent of bias in the FPEs. Limitations of the study included the relatively small sample sizes yielded by the special inclusion studies, and the fact that the special inclusion samples were primarily from the higher end of the distribution of all excluded students.

The National Assessment of Educational Progress (NAEP) is the only nationally representative and continuing assessment of what America's students know and can do in various subject areas.

PDF icon A Validity Study of the NAEP Full Population Estimates

Related Projects

Project

NAEP Validity Studies (NVS) Panel

AIR formed the NAEP Validity Studies Panel in 1995 under contract with the National Center for Education Statistics. The panel provides a technical review of NAEP plans and products and identifies technical concerns and promising techniques worthy of further study and research.

Further Reading

  • NAEP Validity Studies (NVS) Panel
  • Using State Assessments to Impute Achievement of Students Absent from NAEP: An Empirical Study in Four States
  • Study of the Feasibility of a NAEP Mathematics Accessible Block Alternative
  • Assigning Adaptive NAEP Booklets Based on State Assessment Scores: A Simulation Study of the Impact on Standard Errors
  • Mapping State Proficiency Standards (NAEP)
Share

Contact

Larry Hedges

Larry V. Hedges

Institute Fellow

Topic

Education
NAEP

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

Education
Health
International
Workforce

Client Services

Research and Evaluation
Technical Assistance

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1400 Crystal Drive, 10th Floor
Arlington, VA 22202-3289
Call: (202) 403-5000
Fax: (202) 403-5000

Copyright © 2021 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap