Afterschool Impacts Database
Evaluation 101
Learn more about the basics of evaluation, as well as how to find an evaluator for your program.
Afterschool Evaluation
View Afterschool Alliance resources, including a glossary of terms used in the database, evaluation-related blogs, webinars and more.
Additional Resources
Our list of evaluation resources from other organizations, including how to collect and work with data.
Afterschool Research
Want to find what we know about afterschool programs more broadly, not just individual programs? Head to our Afterschool Research page!
Hawaii Statewide Evaluation of the 21st Century Community Learning Centers Program: School Year 2015-16 Evaluation Report
Year Published: 2017
A statewide evaluation of Hawaii’s 21st Century Community Learning Center (21st CCLC) programs during the 2015-16 school year examined outcomes related to participants’ academic performance, engagement, and behavior. The evaluation found improvements in homework completion, classroom participation, and classroom behavior among students regularly participating in the program based on teacher surveys. For example, among students who attended the program between 30 and 59 days, between 29 to 76 percent improved turning in their homework on time and participation in class. Of the seven sub-grantees who submitted information, five reported that at least 57 percent of students improved in turning in homework on time and participating in class.
Program Name: Hawaii 21st Century Community Learning Centers
Program Description:
Hawaii’s 21st Century Community Learning Center program—which receives federal support through the 21st CCLC initiative—serves high-needs communities across the state, providing local afterschool and summer programming through 20 sub-grantees operating 50 centers serving 4,354 students during the 2015-16 school year.
Scope of the Evaluation: Statewide
Program Type: Afterschool
Location: Hawaii
Grade level: Elementary School, Middle School, High School
Program Demographics:
All schools served by Hawaii’s 21st CCLC programs are Title I eligible, meaning more than 40 percent of students qualify for Free and Reduced Price Lunch. The percentage of students served by grantees that qualified for the Federal Free or Reduced Price Lunch program ranged from 15 percent to 100 percent, with an overall average of 60.4 percent. Sub-grantees reported serving between no English language learners and serving up to 32 percent ELL students, with an average of 9.44 percent. For students with special needs, the range of students served was 0 percent to 45 percent, with an average of 9.44 percent. Regarding race and ethnicity, grantees reported that 31 percent were Asian, 27 percent of students served were Native Hawaiian, 8 percent were White, 3 percent were Latino, 1 percent were Black, and less than 1 percent were American Indian. All averages are based on Afterschool Alliance calculations of the data provided.
Program Website: http://www.hawaiipublicschools.org/ParentsAndStudents/SupportForStudents/21stCCLC/Pages/default.aspx
Evaluator: Barker, L.T., Rayyes, N., Magill, K., & McLelland, C. IMPAQ International, LLC.
Evaluation Methods:
ata collected included quantitative data from the Annual Performance Reporting (APR) system, which includes teacher-reported data, and a review of the 2015-16 sub-grantee evaluation reports submitted to the Hawaii Department of Education. Teacher-reported data is on students who participate in the program for 30 days or more (regular participants).
Evaluation Type: Non-experimental
Summary of Outcomes:
During the 2015-16 school year, students who regularly attended Hawaii's 21st Century Community Learning Centers program (at least 30 days) showed improvement in homework submission and classroom participation, as well as their classroom behavior. Based on teacher reports, the percentage of students who improved and participated in the program between 30 and 59 days ranged from 29 percent to 82 percent for homework submission and class participation (See Exhibit 8). Of the seven sub-grantees who submitted information, five reported that at least 57 percent of students regularly participating in programs improved in turning in homework on time. Regarding change in classroom participation rates, of the seven sub-grantees who submitted information, five reported that at least 57 percent of regularly participating students improved.
Looking at classroom attendance and behavior, the percentage of students improving their classroom attendance ranged from 9 percent to 78 percent, and the percentage of students improving their behavior in class ranged from 23 percent to 62 percent.
The evaluation reported out on academic indicators. Of the seven sub-grantees reporting academic improvement among students participating in the program between 30 and 59 days, the percent of students improving in English language arts grades ranged from 16 percent to 73 percent and the percent of students improving in math ranged from 24 percent to 78 percent. Among students participating in the program at least 60 days, the percent of students improving in English language arts grades ranged from 27 percent to 83 percent and the percent of students improving in math ranged from 6 percent to 83 percent.
Associated Evaluation: http://www.hawaiipublicschools.org/Reports/21CCLCstate15-16.pdf
">http://www.hawaiipublicschools.org/Reports/21CCLCstate15-16.pdf
Date Added: December 13, 2018
