Evaluating the SMASH Summer Academy: A Rigorous Study of Computer Science Pathways for High School Students

Image

Increasing participation in the computer science (CS) workforce is critical to meeting the nation’s growing demand for a well-prepared and diverse CS talent pipeline. Prior research consistently finds that early and sustained exposure to high-quality CS learning opportunities is associated with greater student confidence, interest, and persistence in CS pathways. 

Yet relatively few U.S. schools offer rigorous CS coursework for all students, and many students and families lack access to the social, academic, and professional networks that support successful navigation of postsecondary CS education and careers.
 

About the SMASH Academy

For more than a decade, SMASH Academy has provided an immersive, residential computer science experience for rising 11th- and 12th-grade students who have expressed interest in pursuing CS-related careers. Students participate in a three-week summer program facilitated by instructors and near-peer resident advisors at five university campuses. 

The program also provides ongoing academic and socioemotional support during the subsequent school year through a digital learning platform. Program goals include increasing students’ understanding of the college application process, strengthening peer and industry-connected networks, and supporting students’ confidence, motivation, and persistence in postsecondary CS pathways.
 

AIR's Evaluation of the SMASH Summer Program

With support from an Education and Innovation Research (EIR) grant from the U.S. Department of Education, AIR is partnering with SMASH Academy to conduct a rigorous quasi-experimental evaluation of the implementation and impact of the SMASH Summer Program. AIR brings decades of experience conducting large-scale education research and evaluation across K–12, postsecondary, and workforce settings, with a particular focus on evidence-based program design and continuous improvement that address diverse student needs.

To examine both implementation fidelity and student outcomes, AIR is conducting a student-level matched quasi-experimental comparison study that includes approximately 500 SMASH participants and 500 applicants who were not selected to attend the program across all five university sites. AIR’s mixed-methods approach combines interviews and focus groups—used to provide formative feedback and support continuous program improvement—with quantitative analyses of student outcomes. 

The study will assess the extent to which core program components are delivered as intended and estimate the impact of program participation on students’ CS attitudes, academic trajectories, and persistence in postsecondary CS pathways. Throughout the study, AIR applies established quality assurance procedures to ensure methodological rigor, transparency, and the responsible use of evidence to inform program refinement and decision-making at scale.