After-school enrichment vendor evaluation is one of those tasks that gets scheduled every spring and then compressed into a two-week scramble before contract renewal deadlines hit. Most districts default to the same process: review the vendor’s self-reported outcomes, check that compliance boxes are ticked, and renew if no one has complained loudly enough. That approach leaves real money and real student outcomes on the table. The good news is that your district already has the data to do this better — attendance records, academic indicators, and student perception data that, when analyzed together, give you a much clearer picture of whether a vendor is delivering. This post walks through a practical framework for running that analysis before your next renewal season.
Why the Standard RFP Checklist Falls Short
Request-for-proposal rubrics were designed to evaluate new vendors, not to measure ongoing performance. They assess inputs — staff credentials, curriculum alignment, liability insurance, references — not outcomes. A vendor can score perfectly on an RFP and still run a program where 40 percent of enrolled students stop showing up by November.
The other problem is that vendors control the narrative in traditional reviews. Their end-of-year reports highlight the best numbers and bury the rest. When a program director tells you that 85 percent of participants showed “improved confidence,” you have no way to verify that claim against your own records unless you set up the comparison yourself.
A lightweight internal audit changes the dynamic. Instead of asking vendors to prove their value, you use your own data systems to assess it independently — and then bring those findings into the renewal conversation.
The Three Data Sources You Already Have
Attendance Records
Enrollment in a program is not participation. Districts that track this distinction consistently find that 20 to 35 percent of enrolled after-school students attend fewer than half the scheduled sessions in a given semester. That matters because dosage drives outcomes. Research from the Harvard Family Research Project and subsequent studies has consistently shown that students need a minimum of 30 to 45 hours of program contact to see measurable academic benefits. A student who attends eight sessions out of twenty-four is not getting that dose, and lumping that student’s outcomes in with a student who attended twenty-two sessions masks what the program is actually doing.
Pull your after-school attendance logs for the past two semesters. Calculate the average session attendance rate per vendor and per program type. Flag any program where median attendance drops below 60 percent of scheduled sessions. Then look at attrition over time — are students dropping off after week three, or are they sustaining through the semester? A sharp drop after the first month often signals that the program is not engaging enough to compete with other afternoon alternatives.
Academic Outcome Data
You are not trying to run a randomized controlled trial. What you are trying to do is identify whether students who participated consistently in an enrichment program show different academic patterns than students who enrolled but did not participate — or students who were on a waitlist but never enrolled. This comparison is imperfect, but it is far more informative than a vendor’s self-reported improvement rates.
The most accessible academic indicators for this comparison are semester GPA changes, chronic absenteeism rates, and disciplinary incident rates. In Title I schools specifically, chronic absenteeism is often a more sensitive indicator than test scores because it is reported at the student level, updated in real time, and not confounded by test design factors. If a vendor’s consistent participants are showing lower chronic absenteeism rates than comparable non-participants, that is a meaningful signal. If there is no difference, or if the difference disappears when you control for prior-year attendance, that is worth discussing at the renewal table.
Some districts also have access to interim assessment data — MAP, iReady, or district benchmarks — that can be analyzed by participation group. If your student information system allows you to tag students by program enrollment and run a basic cohort comparison, a data coordinator can typically produce this analysis in under four hours.
Student Survey Results
Survey data is the most underused asset in this process. Many districts collect student climate surveys annually, and several state and federal reporting frameworks — including requirements tied to Title IV-A Student Support and Academic Enrichment grants — ask schools to gather student perception data as part of program evaluation. If you are already collecting it, you are not using it fully if it never informs vendor decisions.
The specific questions that matter most for enrichment vendor evaluation are not about satisfaction. They are about agency, belonging, and skill application. Do students report that the program challenged them? Do they feel the program connected to something they care about? Can they name a specific thing they learned or made or built? Short-form surveys administered mid-semester — not just at the end — give you time to course-correct before the year closes out.
If you are not currently collecting structured student feedback on after-school programs, a simple five-question Likert-scale survey administered in October and March takes less than ten minutes per student and gives you trend data across vendor relationships.
Building a Simple Vendor Scorecard
Once you have pulled these three data sources, the goal is not to create a complex weighted formula. It is to answer four questions for each vendor relationship:
- Are students actually showing up at a rate that makes the program dose-effective?
- Are consistent participants showing better academic or attendance trends than comparable peers?
- Are students reporting that the program is engaging and skill-building — not just entertaining?
- Is the vendor responsive when you flag concerns, and do they adjust?
Rate each question on a simple three-point scale: strong evidence, mixed evidence, or insufficient evidence. Any vendor with two or more “insufficient evidence” ratings should not be automatically renewed. That is not a punitive judgment — it is a prompt to have a direct conversation about what data the vendor can provide and what changes they are willing to make.
How to Structure the Renewal Conversation
Bring your scorecard into the renewal meeting as a starting document, not a verdict. Share the attendance curves, the cohort comparisons, and the survey themes. Ask the vendor to respond to what they see. Quality vendors — the ones worth keeping — will engage with the data seriously. They will point to contextual factors you may have missed, share their own internal metrics, and propose adjustments. Vendors who become defensive or dismiss the data entirely are telling you something important about what the next contract year will look like.
This is also the right moment to align on what success looks like for the coming year. Define it in writing: target attendance rates, specific academic indicators you will track together, and a mid-year check-in date. Vendors who accept vague renewal terms have no accountability mechanism. Vendors who agree to specific benchmarks are investing in the same outcomes you are.
A Note on Funding Alignment
If your enrichment programs are funded through Title I, Title IV-A, 21st Century Community Learning Centers, or state afterschool grants, your funding source almost certainly requires evidence of program effectiveness. Running this internal audit is not extra work — it is documentation your grants coordinator likely needs anyway. Framing the vendor scorecard as part of your required program evaluation can also build buy-in from school board members who need to approve contracts and want to see accountability built into the process.
At Kodely, every school partnership includes transparent reporting on attendance rates, session completion, and student engagement data — organized in the format district administrators can actually use during contract and grant review cycles. That kind of data accountability should be a baseline expectation for any enrichment vendor operating in your buildings.