The most commonly tracked metric in after-school programs is attendance — who showed up, how often, and for how long. Attendance matters, and it’s worth tracking. But attendance is an input, not an outcome. A program where students show up consistently and learn nothing is not a good program. And a program where students show up less frequently but develop durable skills, confidence, and relationships may be delivering more value than its attendance numbers suggest.
Here’s a practical framework for measuring what actually matters in after-school programs — one that school leaders and program coordinators can implement without a research team or specialized software.
Start With the Right Questions
Before choosing metrics, define what your program is supposed to accomplish. Most after-school programs have an implicit theory of change — “if students participate in this program, they will develop these skills or outcomes” — but rarely make it explicit enough to measure.
Ask: “If this program is working exactly as intended, what will be different about students at the end of the year versus the beginning?” Your answers become your outcome targets. Common outcome categories:
- Academic: Improved performance in specific subjects, homework completion rates, classroom engagement
- Social-emotional: Self-regulation, peer relationships, conflict resolution, sense of belonging
- Domain-specific skills: Coding ability, artistic technique, athletic performance, cooking skills
- Attitudes and identity: Self-efficacy, interest in the program domain, identification as a learner/maker/athlete
- Behavioral: School-day attendance, behavioral referrals, classroom participation
Level 1: What Every Program Should Track
Even programs with minimal evaluation resources should consistently track:
Attendance and Retention
Not just who showed up, but patterns over time. Are students more likely to attend at the beginning of the year than the end? Are specific demographic groups less consistent? Is there a specific week where attendance typically drops? These patterns reveal program design problems that average attendance numbers hide.
Participant Satisfaction
A brief end-of-session “thumbs up / thumbs down” or monthly 3-question survey takes minutes and surfaces dissatisfaction early. The most valuable question: “Would you recommend this program to a friend?” Students who would recommend it are genuinely engaged. Students who wouldn’t are telling you something important.
School-Day Indicators
For programs with access to school-day data, compare after-school participants to non-participants on: attendance rates, behavioral referrals, and teacher-reported engagement. You don’t need experimental design to find signal — even descriptive comparisons reveal whether the program is correlating with positive school-day trends.
Level 2: Skill and Outcome Measurement
Programs that want to measure actual skill development need pre/post assessments. These don’t need to be standardized tests. They need to be designed to capture what the program is actually trying to develop.
Examples by program type:
- Coding: A simple coding challenge at the start and end of the year — same task, assessed on complexity of solution and ability to debug independently
- Arts: Portfolio review comparing early and late work against a simple rubric; student artist statements showing development in vocabulary and self-awareness
- Sports: Skill assessments on specific technique; coach ratings of teamwork, coachability, and sportsmanship
- SEL: Student self-report on specific competencies (“How well can you calm yourself down when you’re upset?”) using a consistent scale at start, mid-year, and end of year
Level 3: Connecting to School-Year Academic Data
The strongest evidence for program impact comes from connecting after-school participation to school-year academic outcomes — test scores, grades, promotion rates. This requires a data-sharing agreement with the school or district and some analytical capacity.
If you have access to this data, the most useful analyses are:
- Year-over-year academic growth for consistent participants versus non-participants
- Attendance rates for after-school participants versus comparable non-participants
- Behavioral referral rates for program participants before and after enrollment
Even simple versions of these analyses — done in a spreadsheet, not a statistical package — produce the kind of evidence that supports funding renewal, program expansion, and advocacy to school and district leadership.
Making Data Useful, Not Just Collected
The most common data failure in after-school programs isn’t the absence of data — it’s collecting data that never gets used. Data should drive decisions: curriculum changes, staffing adjustments, recruitment targeting, program design iterations.
Build one habit: at the midpoint of each program cycle, spend 30 minutes with your team looking at what the data is showing. What does attendance tell you about which activities are most engaging? What does the satisfaction survey reveal about what students value? What do the skill assessments show about where students are getting stuck? Then change something based on what you find.
Programs that use data to improve are the ones that improve. Data that gets filed away produces reports, not results.
Education Unlocked Podcast
Real conversations with superintendents, principals, and district leaders changing what is possible in public education.