Evaluator: Resendez, M. & Ray, J., JEM & R, LLC.

Evaluation Methods:

This evaluation uses data collected in the 2021-22 school year. Multiple sources of data were analyzed, including process measures (program attendance, types of activities and student/parent/staff satisfaction surveys) and outcome measures (standardized test scores, attendance records, and teacher ratings of student behavior). Using a mixed methods approach, a participatory evaluation was conducted to address the needs of Montana’s 21st CCLC programs by determining their effectiveness related to meeting goals and objectives and their strengths/areas for improvement. 

Evaluation Type: Non-experimental

Summary of Outcomes:

This evaluation of Montana's 21st CCLC programs during the 2021-22 school year found positive outcomes related to participating students’ academic engagement and behavior, positive relationships, and youth development based on teacher, student, parent, and school day administrator surveys. 

According to teacher surveys, among the 21st CCLC students needing improvement, an average of 85 percent of K-5th grade students improved or maintained their engagement in learning. In addition, teachers reported that nearly half of students saw improvements in their willingness to try new things (49 percent), participation in class (47 percent), and interest in various topics (47 percent). 

According to student and staff survey results, Montana’s 21 CCLC programs are also fostering safe and supportive environments that are aligned with students’ needs and interests. Approximately 9 in 10 students reported that they felt physically and emotionally safe in their program (93 percent), supported by staff (93 percent), and connected to their peers (88 percent). Seventy-nine percent of program staff indicated that they incorporated youth voice and choice, with 80 percent of staff reporting that students are at least occasionally given opportunities to plan activities and 48 percent reporting that students were almost always given a choice in what activities to participate in. Regarding student perspective, 89 percent of K-12 students reported that they were actively engaged in their programs. 

The evaluation results were significant in the areas of positive relationships and youth development.  According to student surveys, 94 percent of students showed improvement in life skills.  Moreover, both K-4th and 5th-12th grade students reported that participation in their 21st CCLC program helped them in a variety of areas, including making good decisions (98 percent and 94 percent, respectively), being responsible (97 percent and 95 percent, respectively), working with others (96 percent and 93 percent, respectively), and handling problems (94 percent and 92 percent, respectively). In addition, 63 percent of students indicated they have utilized positive conflict resolution skills as a result of their 21st CCLC program. Among middle and high school participants, 7 in 10 reported that they had opportunities to further their career plans in the 21st CCLC program.

Parents also reported being satisfied with 21st CCLC programming, as 97 percent of caregivers indicated they felt supported by the programming, 96 percent felt satisfied with the communication they received, and 89 percent were aware of community resources because of 21st CCLC program. Parent satisfaction was also high regarding the academic, social, and emotional supports their child was provided (94 percent, all).

Finally, nearly all school-day administrators and parents surveyed reported that they viewed the 21st CCLC program as valuable (100 percent and 97 percent, respectively). School administrators uniformly agreed that their school’s students benefited from participation in the 21st CCLC program (100 percent) and that the program supported their students’ academic success (99 percent).