Learn more about the basics of evaluation, as well as how to find an evaluator for your program.
View Afterschool Alliance resources, including a glossary of terms used in the database, evaluation-related blogs, webinars and more.
Our list of evaluation resources from other organizations, including how to collect and work with data.
Want to find what we know about afterschool programs more broadly, not just individual programs? Head to our Afterschool Research page!
Year Published: 2013
A comprehensive, multiyear evaluation of Higher Achievement, an intensive year-round afterschool program located across the Mid-Atlantic region. The evaluation sought to understand the program’s impact on participants’ academic performance, attitudes and behaviors, and enrollment in competitive high schools. The evaluation uses a randomized control design, comparing students who were selected via lottery to participate in Higher Achievement to students who were not selected through the lottery. Key findings from the evaluation include that, after two years in the program, Higher Achievement students performed better on standardized tests in math problem-solving and reading comprehension when compared to their non-participating peers. Furthermore, program participants were more likely to apply to, be accepted to, attend, and matriculate through private schools and competitive magnet or charter schools than non-participants.
Program Name: Higher Achievement
Program Description: Higher Achievement is a summer and afterschool program started in 1999 in Washington, D.C. Higher Achievement provides middle school students with up to 650 hours of academic instruction per year, as well as enrichment activities and targeted, academic mentoring to help prepare students for high school and close the opportunity gap. Today, there are sites in Washington, D.C., Alexandria, VA; Richmond, VA; Pittsburgh, PA; and Baltimore, MD. This evaluation includes sites from the Washington and Alexandria areas.
Scope of the Evaluation: Local
Program Type: Summer, Afterschool
Location: Today there are sites in Washington, D.C., Alexandria, VA; Richmond, VA; Pittsburgh, PA; and Baltimore, MD. This evaluation includes sites from the Washington D.C. and Alexandria areas.
Community Type: Urban
Grade level: Middle School
Program Demographics: Seventy-five percent of students were African-American, 13 percent were Latino. Roughly 60 percent were eligible for free or reduced-price lunch.
Program Website: https://higherachievement.org/
Evaluator: Herrera, C., Grossman, J. B., & Linden, L. L. Public/Private Ventures.
Evaluation Methods: Data was collected on a total of 952 youth entering 5th and 6th grade through standardized tests, student surveys, and parent surveys. Half of the participants, all of whom had to meet Higher Achievement’s admission criteria and complete a standardized test, were selected to participate in Higher Achievement via a randomized lottery, and half were not. Throughout the next four years (2007 - 2011), students and parents from both groups were re-surveyed a total of four times, with students taking standardized tests as well. Surveys measured attitudes, behavior, and participation in a range of activities. Standardized tests evaluated reading comprehension and math problem-solving skills.
Evaluation Type: Experimental
Summary of Outcomes: The evaluation found that, after two years in the program, students performed better on standardized tests in math problem-solving and reading comprehension, compared to non-attendees. At the fourth-year follow-up (when half the participants had already graduated the program), participants continued to outperform non-participants in math. Additionally, program participants were more likely to apply to, be accepted to, attend, and matriculate through private schools and competitive magnet or charter schools than non-participants.
Associated Evaluation: http://www.mdrc.org/sites/default/files/staying_on_track_testing_higher_achievement.pdf
Date Added: September 26, 2016