Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Research and Evaluation
    • Technical Assistance
  • Our Experts
  • News & Events

You are here

  • Home
1 May 2004
Report

Evaluation of Bias Correction Methods for “Worst-case” Selective Non-participation in NAEP

Random non-participation introduces random error into NAEP estimates. More worrisome is the possibility of selective non-participation at the top or bottom of the ability distribution, which would introduce a bias into statewide mean scores. Selective non-participation could be an unintended consequence of NAEP’s new role under No Child Left Behind. In anticipation of such an outcome, this study estimated the potential bias from "worst-case" scenarios of selective non-participation and examined the extent to which statistical methods can correct for that bias. Correction for non-participation bias using information about students’ state test scores was found to be partially effective, eliminating roughly half of the bias when a linear equating method was used. A useful finding was that exact state test scores could be replaced with state test score quartiles in these non-participation bias corrections without serious degradation of results.

PDF icon Evaluation of Bias Correction Methods for “Worst-case” Selective Non-participation in NAEP

Related Projects

Project

NAEP Validity Studies (NVS) Panel

AIR formed the NAEP Validity Studies Panel in 1995 under contract with the National Center for Education Statistics. The panel provides a technical review of NAEP plans and products and identifies technical concerns and promising techniques worthy of further study and research.

Further Reading

  • Estimating Effects of Non-Participation on State NAEP Scores Using Empirical Methods
  • NAEP Validity Studies (NVS) Panel
  • Using State Assessments to Impute Achievement of Students Absent from NAEP: An Empirical Study in Four States
  • Stronger, Smarter, Bolder: Girls Take the Lead
  • Evaluation of the Join-in Circuit (JIC) on AIDS, Love, and Sexuality Program in Zambia
Share

Topic

Education
NAEP

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

Education
Health
International
Workforce

Client Services

Research and Evaluation
Technical Assistance

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1400 Crystal Drive, 10th Floor
Arlington, VA 22202-3289
Call: (202) 403-5000
Fax: (202) 403-5000

Copyright © 2021 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap