Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • AIR Assessment
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Student Assessment
    • Research and Evaluation
    • Policy, Practice, and Systems Change
  • Our Experts
  • News & Events

You are here

  • Home
1 Feb 2005
Report

Using State Assessments to Impute Achievement of Students Absent from NAEP: An Empirical Study in Four States

Donald H. McLaughlin, Beth A. Scarloss, Frances B. Stancavage, and Charles D. Blankenship

In preparing estimates for state-level statistics, NAEP has employed different standard procedures in dealing with missing data for absent and excluded students. To adjust for estimates of achievement for absent students, a basis is needed for imputing plausible achievement scores for those students. Ideally, one would use scores on a parallel test; in lieu of available test scores, NAEP has used demographic proxies for achievement. Demographic proxies are clearly less accurate than actual achievement scores on a related test, but until now, achievement test scores have not been systematically available for students selected for NAEP.

The purpose of this study is to estimate the extent to which state assessment scores can be used to improve the adjustments of NAEP data to remove the biases due to absences. A simulation study was conducted to explore the potential of state assessment scores to improve adjustments for nonparticipation (McLaughlin, Gallagher, and Stancavage, 2004). That study found that state assessment scores could potentially be more effective than demographic information in removing the bias related to absences. The present study aims to extend that simulation by empirically assessing the potential for using state assessment scores to impute achievement for NAEP absent students in four states. In these four states, state assessment scores were acquired for students selected to participate in the NAEP reading and mathematics assessments in 2003.

Four research questions have guided the course of this study:

  1. How well do state assessment scores cover absent students?
  2. Do state assessment scores follow the patterns of NAEP scores?
  3. How do results of adjustments for absences based on state test data compare to current demographic adjustments for absences?
  4. Is the use of state assessment data for this purpose feasible?
PDF icon Using State Assessments to Impute Achievement of Students Absent from NAEP: An Empirical Study in Four States

Related Projects

Project

NAEP Validity Studies (NVS) Panel

AIR formed the NAEP Validity Studies Panel in 1995 under contract with the National Center for Education Statistics. The panel provides a technical review of NAEP plans and products and identifies technical concerns and promising techniques worthy of further study and research.

Further Reading

  • NAEP Validity Studies (NVS) Panel
  • Using State Assessments to Assign Booklets to NAEP Students to Minimize Measurement Error: An Empirical Study in Four States
  • Estimating Effects of Non-Participation on State NAEP Scores Using Empirical Methods
  • A Validity Study of the NAEP Full Population Estimates
  • Study of the Alignment of the 2015 NAEP Mathematics Items at Grades 4 and 8 to the Common Core State Standards (CCSS) for Mathematics
Share

Topic

Education
NAEP

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

AIR Assessment
Education
Health
International
Workforce

Client Services

Student Assessment
Research and Evaluation
Policy, Practice, and
Systems Change

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1000 Thomas Jefferson Street, NW
Washington, DC 20007
Call: (202) 403-5000
Fax: (855) 459-6213

Copyright © 2019 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap