Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Research and Evaluation
    • Technical Assistance
  • Our Experts
  • News & Events

You are here

  • Home
1 May 2004
Report

Assigning Adaptive NAEP Booklets Based on State Assessment Scores: A Simulation Study of the Impact on Standard Errors

The purpose of this simulation was to assess the improvements in standard errors of estimates that could be expected if students participating in NAEP were pre-assigned to test booklets that were adapted to their level of performance based on their state assessment scores. The simulation assumed that students in extreme quartiles would receive one regular NAEP block and one block adapted to their performance quartile. Students in the middle two quartiles would receive a second "regular" NAEP block. Also considered was an alternative scenario in which adapted blocks were assigned only to the top and bottom deciles of students, rather than to full quartiles. Results from the simulations indicated that assigning low-performing students "easier" test blocks based on their prior test performance could reduce standard errors in measuring these students' ability levels. The reverse, however, was found to be true for "harder" booklets; in this simulation, assigning "harder" test blocks to higher performing students actually increased standard errors. Results were consistent across the four states included in the study.

PDF icon Assigning Adaptive NAEP Booklets Based on State Assessment Scores: A Simulation Study of the Impact on Standard Errors

Related Projects

Project

NAEP Validity Studies (NVS) Panel

AIR formed the NAEP Validity Studies Panel in 1995 under contract with the National Center for Education Statistics. The panel provides a technical review of NAEP plans and products and identifies technical concerns and promising techniques worthy of further study and research.

Further Reading

  • Using State Assessments to Assign Booklets to NAEP Students to Minimize Measurement Error: An Empirical Study in Four States
  • NAEP Validity Studies (NVS) Panel
  • A Validity Study of the NAEP Full Population Estimates
  • Using State Assessments to Impute Achievement of Students Absent from NAEP: An Empirical Study in Four States
  • Evaluation of Bias Correction Methods for “Worst-case” Selective Non-participation in NAEP
Share

Topic

Education
NAEP

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

Education
Health
International
Workforce

Client Services

Research and Evaluation
Technical Assistance

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1400 Crystal Drive, 10th Floor
Arlington, VA 22202-3289
Call: (202) 403-5000
Fax: (202) 403-5000

Copyright © 2021 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap