Skip to main content
  • About Us
  • Careers
  • Contact

Search form

American Institutes for Research

  • Our Work
    • Education
    • Health
    • International
    • Workforce
    • ALL TOPICS >
  • Our Services
    • Research and Evaluation
    • Technical Assistance
  • Our Experts
  • News & Events

You are here

  • Home
  • NAEP Data in Focus: Examining the Research
29 Jan 2016
Report

Computer Familiarity and Its Relationship to Performance in Three NAEP Digital-Based Assessments

AIR-NAEP Working Paper #01-2016

Ting Zhang, Qingshu Xie, Bitnara Jasmine Park, Young Yee Kim, Markus Broer, and George Bohrnstedt

The National Assessment of Educational Progress (NAEP) is the largest nationally representative and continuing assessment of what America's students know and can do in various subject areas. The NAEP program has been developing new digital-based assessments (DBAs) and plans to transition additional assessments from a paper-and-pencil administration to a technology-based assessment beginning in 2017. In light of these changes, it is important to consider how students’ experience of using technology and technological devices may impact their performance on a technology-based assessment.

The current study aims to examine factor structures underlying NAEP student contextual questionnaire items designed to measure computer familiarity (as reflected by computer access and use measures). The study also aims to investigate how these computer familiarity factors relate to eighth-grade public school students’ achievement in three recent NAEP DBAs: (1) the 2011 grade 8 Writing Computer-Based Assessment, (2) the 2011 grade 8 Mathematics Computer-Based Study, and (3) the 2013 grade 8 Technology and Engineering Literacy pilot assessment.

Key Findings

Across all three assessments, the results indicate that less than 7 percent of eighth-grade students in public schools across the nation lived in homes without a computer. However, more students who were eligible for the National School Lunch Program (NSLP) did not have a computer at home than did those who were not eligible. Similarly, more Black and Hispanic students than White students did not have computer access at home. No gender difference was identified in home computer access across the three assessments.

Home computer access was found to be positively related to student performance in all three DBAs. This relationship holds even after taking into account students’ NSLP status, race/ethnicity, gender, and computer use. While there was a positive overall effect in the TEL pilot assessment, the effect functions differently for students who are NSLP eligible and for students who are not eligible. The achievement gap between those with and those without home computer access was wider for students who were not eligible for the NSLP than for students who were eligible.

PDF icon Computer Familiarity and Its Relationship to Performance in Three NAEP Digital-Based Assessments (PDF)

Related Work

1 Feb 2021
Spotlight

NAEP Data in Focus: Examining the Research

The NAEP Data in Focus working papers combine AIR’s expertise and experience not only with the National Assessment of Educational Progress (NAEP), but with other large-scale assessments and survey-based longitudinal studies.
Share

Topic

Education
NAEP

Related Projects

NAEP Validity Studies Panel

NAEP Achievement Gaps

Mapping State Proficiency Standards

RESEARCH. EVALUATION. APPLICATION. IMPACT.

About Us

About AIR
Board of Directors
Leadership
Experts
Clients
Contracting with AIR
Contact Us

Our Work

Education
Health
International
Workforce

Client Services

Research and Evaluation
Technical Assistance

News & Events

Careers at AIR


Search form


 

Connecting

FacebookTwitterLinkedinYouTubeInstagram

American Institutes for Research

1400 Crystal Drive, 10th Floor
Arlington, VA 22202-3289
Call: (202) 403-5000
Fax: (202) 403-5000

Copyright © 2021 American Institutes for Research®.  All rights reserved.

  • Privacy Policy
  • Sitemap