A project of the Afterschool Alliance.

Staying On Track: Testing Higher Achievement’s Long-Term Impact on Academic Outcomes and High School Choice

Year Published: 2013

A comprehensive, multiyear evaluation of Higher Achievement, an intensive year-round afterschool program located across the Mid-Atlantic region. The evaluation sought to understand the program’s impact on participants’ academic performance, attitudes and behaviors, and enrollment in competitive high schools. The evaluation uses a randomized control design, comparing students who were selected via lottery to participate in Higher Achievement to students who were not selected through the lottery. Key findings from the evaluation include that, after two years in the program, Higher Achievement students performed better on standardized tests in math problem-solving and reading comprehension when compared to their non-participating peers. Furthermore, program participants were more likely to apply to, be accepted to, attend, and matriculate through private schools and competitive magnet or charter schools than non-participants.

Program Name: Higher Achievement

Program Description: Higher Achievement is a summer and afterschool program started in 1999 in Washington, D.C. Higher Achievement provides middle school students with up to 650 hours of academic instruction per year, as well as enrichment activities and targeted, academic mentoring to help prepare students for high school and close the opportunity gap. Today, there are sites in Washington, D.C., Alexandria, VA; Richmond, VA; Pittsburgh, PA; and Baltimore, MD. This evaluation includes sites from the Washington and Alexandria areas.

Scope of the Evaluation: Local

Program Type: Summer, Afterschool

Location: Today there are sites in Washington, D.C., Alexandria, VA; Richmond, VA; Pittsburgh, PA; and Baltimore, MD. This evaluation includes sites from the Washington D.C. and Alexandria areas.

Community Type: Urban

Grade level: Middle School

Program Demographics: Seventy-five percent of students were African-American, 13 percent were Latino. Roughly 60 percent were eligible for free or reduced-price lunch.

Program Website: https://higherachievement.org/

Evaluator: Herrera, C., Grossman, J. B., & Linden, L. L. Public/Private Ventures.

Evaluation Methods: Data was collected on a total of 952 youth entering 5th and 6th grade through standardized tests, student surveys, and parent surveys. Half of the participants, all of whom had to meet Higher Achievement’s admission criteria and complete a standardized test, were selected to participate in Higher Achievement via a randomized lottery, and half were not. Throughout the next four years (2007 - 2011), students and parents from both groups were re-surveyed a total of four times, with students taking standardized tests as well. Surveys measured attitudes, behavior, and participation in a range of activities. Standardized tests evaluated reading comprehension and math problem-solving skills.

Evaluation Type: Experimental

Summary of Outcomes: The evaluation found that, after two years in the program, students performed better on standardized tests in math problem-solving and reading comprehension, compared to non-attendees. At the fourth-year follow-up (when half the participants had already graduated the program), participants continued to outperform non-participants in math. Additionally, program participants were more likely to apply to, be accepted to, attend, and matriculate through private schools and competitive magnet or charter schools than non-participants.