All Reports
-
Saturday, February 28, 2004
Highlights from the 2003 Oklahoma State Assessment of Adult Literacy
This report summarizes key findings from the 2003 Oklahoma State Assessment of Adult Literacy.
-
Sunday, February 1, 2004
Workforce Contingent Financial Aid: How States Link Financial Aid to Employment
To date, AIR has written the only report detailing the scope of loan forgiveness and loan repayment financial aid initiatives at the state level. These programs either provide students with loans that can be “forgiven” or repay existing loans if recipients work in designated employment areas upon graduation.
-
Friday, January 16, 2004
Exploring Assignments, Student Work, and Teacher Feedback in Reforming High Schools Report
AIR researchers and leaders at the Bill and Melinda Gates Foundation began a nationwide study of teaching and learning in foundation-supported schools with a pilot study in Washington State.
-
Thursday, December 18, 2003
Campbell Collaboration Bibliography of CRTs currently in C2-SPECTR
Bibliography prepared for the Campbell Collaboration Briefing Conference on Place Randomized Trials in Education, Crime, Social Welfare, and Health.
-
Monday, October 20, 2003
Medical Teamwork and Patient Safety
This report reviews the empirical evidence concerning the relation between teamwork and patient safety.
-
Thursday, October 16, 2003
Post-Training Feedback: The Relative Effectiveness of Team- Versus Instructor-Led Debriefs
The purpose of this study was to assess the relative effectiveness of different approaches to debriefing team performance: team debrief with videotape, team debrief without videotape, instructor debrief with videotape, and instructor debrief without videotape. We hypothesized that the four approaches would not be equally effective. However, the lack of consensus in the literature made it impossible to hypothesize whether team- vs. instructor-led debriefs would be more effective. Based on our personal experience, we hypothesized that debriefings which incorporate videotape would be perceived as more effective than those which did not.
-
Wednesday, October 15, 2003
Team Training in Health Care: A Review of Team Training and a Look Toward The Future
The following discussion compares the purpose, strategy, and effectiveness of two distinct categories of MTT, those that are primarily simulator-based and those that are primarily classroom-based. Data collected from MTT course observations, participant questionnaires, and instructor interviews are reported. Finally, we summarize the state-of-the-science and propose a series of research-based propositions for improving the future of MTT.
-
Wednesday, September 17, 2003
Airline Pilots' Experiences in and Reactions to Their Check Rides: Results from a Nationwide, Representative Survey
The purpose of this study was to assess the relative effectiveness of different approaches to checking pilot performance at the end of training: the maneuver validation (MV) and the Line Operational Evaluation (LOE). Because the LOE provides greater contextual cues and integrates CRM skills with technical skills, it should simulate typical line operations more accurately than a traditional maneuver validation. Therefore, we hypothesized that pilots would rate the LOE as more useful than the MV. The results presented below are part of a much larger survey of airline pilots’ experiences in and reactions to their professional training (Baker et al., 2002).
-
Tuesday, September 16, 2003
Toward a Generalized Human Factors Taxonomy for Classifying ASAP Incident Reports, AQP Performance Ratings, and FOQA Output
Over the years, the FAA has partnered with industry to develop programs for reporting, classifying, and analyzing safety-related data, but none has been able to integrate data from multiple sources. We are developing a generalized Human Factors taxonomy for classifying de-identified ASAP incident reports, AQP performance ratings, and FOQA output. Eventually this taxonomy will be embedded into a series of searchable computer databases that speak a common language, allowing the search for trends.
-
Monday, June 30, 2003
Evaluation Study of the Immediate Intervention/Underperforming Schools Program and the High Achieving/Improving Schools Program of the Public Schools
AIR, in partnership with Policy Analysis for California Education (PACE) and EdSource, conducted the legislatively mandated independent evaluation of the Immediate Intervention/Underperforming Schools Program (II/USP) and the High Achieving/Improving Schools Program (HA/ISP) of the Public Schools Accountability Act (PSAA) of 1999.
-
Wednesday, June 4, 2003
Improving the Construct Validity of Line Operational Simulation (LOS) Ratings: Lessons Learned from the Assessment Center
Because poor LOS construct validity can have real-world effects on pilot training and performance, assessing and improving the construct validity of Line Operational Simulations is more than just an academic or scientific issue. It is also a practical and political issue in that it involves multiple stakeholders who may have competing concerns. These include safety, justice/fairness, technical feasibility, and cost-effectiveness (Austin, Klimoski, & Hunt, 1996). Therefore, we recommend that all potential stakeholder groups be involved in identifying and improving the construct validity of Line Operational Simulations. These groups may include pilot unions, training staff, flight standards staff, and officials from the regional FAA offices. Moreover, all groups must be prepared to compromise some of their own goals/needs to achieve a balanced solution. In the end, only by working together can industry address the issue of LOS construct validity, and by extension, the quality of pilot crew training and evaluation.
-
Wednesday, June 4, 2003
Random Assignment in Program Evaluation and Intervention Research: Questions and Answers
This project was supported under contract number ED-01-C0-0039 (0002), as administered by the Institute of Education Sciences, U.S. Department of Education.
-
Saturday, April 12, 2003
Charting a Course: Evaluation Design of the National School District and Network Grants Program
This paper describes the framework underlying our evaluation design of a large-scale, multifaceted school reform initiative and to identify some of the methodological challenges inherent in work of this kind.
-
Thursday, October 24, 2002
A Review of Selected Aviation Human Factors Taxonomies, Accident/Incident Reporting Systems, and Data Reporting Tools
This review—which summarizes the state-of-the art in aviation error reporting, classification, and analysis—serves as the foundation for our future taxonomic research.
-
Tuesday, October 1, 2002
An Agenda for NAEP Validity Research
This report resulted from the systematic analysis undertaken by the NAEP Validity Studies Panel in 2001 to consider the domain of validity threats to NAEP and to identify the most urgent validity research priorities as that time.
