The single hardest thing about evaluating a California afterschool provider is that almost every vendor’s proposal sounds the same. Everyone claims standards-aligned. Everyone claims quality instructors. Everyone claims full-service. The difference between a partner that will make the block feel like the best hour of a kid’s day and one that will produce an FCMAT finding in year two shows up in the answers to twelve specific questions — the ones vendors do not usually get asked because most district evaluation processes stop at price and geography. Below is a checklist you can walk directly into your next vendor meeting with. For each question there is a short note on what a great answer sounds like and what should make you walk away.
The Twelve Questions
1. What percentage of your instructors return year over year?
Why it matters: the Wallace Foundation’s work on afterschool educators has repeatedly identified staff turnover as the single biggest quality lever in the sector, and California providers report retention rates ranging widely — from well under 40% at the low end to above 80% at strong operators. The provider you pick is one your kids will lose a favorite adult from every year unless the retention story is very different.
Great answer: above 80% return rate, backed by named instructors returning to the same site, with a documented university pipeline supplying the rest.
Walk-away answer: “we work hard on culture” without a specific number, or “we use a substitute pool” for anything more than emergency coverage.
2. Where do you source your instructors, specifically?
Why it matters: the pipeline is the ceiling. Providers sourcing from a strong university pipeline are pulling from the same candidate pool as competitive summer camps and tutoring companies. Providers relying on Craigslist and last-minute agency temps are not.
Great answer: named universities (Cal State system, USC, UCLA, Berkeley, Stanford, or the equivalent regional strong schools) with an active on-campus recruiting relationship.
Walk-away answer: generic “we have a great applicant pool” or heavy reliance on staffing agencies.
3. Who will be at my site the first day of school, and will they still be there in May?
Why it matters: this is the retention question rephrased so it has to be answered specifically. Instructor continuity is what makes the room feel like a place kids belong to.
Great answer: a named site-embedded lead hired for the full school year with a named backup instructor at the same site.
Walk-away answer: “we’ll assign someone once the contract is signed” or “we rotate our team across sites.”
4. What does a typical Tuesday look like from 3:00 to 6:00 PM in your program?
Why it matters: the answer separates operators who run the whole block from operators who drop in for one hour of enrichment.
Great answer: a specific segmented schedule — arrival and snack, instructor-led homework and reading, MVPA that meets the state target, the signature program hour, reflect and close — with a description of what happens in each segment.
Walk-away answer: “we run our coding program from 4 to 5” (that is a one-hour drop-in, not a program) or vague language about “flexible activities.”
5. What does a kid actually make in your program, and what do they take home?
Why it matters: the “artifact question” separates real career and skill-building programs from generic “STEM exploration” language. Kids remember what they built. Parents notice what comes home.
Great answer: named signature tracks with specific artifacts — a rocket from Junior NASA, a moot court brief from Mini Law, a triage certificate from Mini Med, a published podcast episode from Podcast Studio, a lemonade stand P&L from Mini MBA — on a four-week ship cycle.
Walk-away answer: “we do a lot of hands-on activities” without any named end product.
6. How do you tag sessions to California content standards?
Why it matters: LCAP annual updates require standards evidence. Most providers claim standards-aligned. Very few can export session-by-session standards data in a format your services officer can consume.
Great answer: every session tagged (CCSS-ELA, CCSS-M, NGSS, VAPA, ELD, HE, PE), aggregated weekly, exportable in CDE format.
Walk-away answer: “we align to standards” without a demonstrable export or a live dashboard.
7. What do parents receive from your program each week?
Why it matters: LCAP Priority 3 (Parental Involvement) is one of the hardest indicators to move. The single artifact most correlated with lifting it is a weekly family digest — in the family’s language — describing what the kid made and what to ask them at dinner.
Great answer: a one-line-per-kid Friday digest, bilingual where the community needs it, with a clear conversation prompt for the parent.
Walk-away answer: “we send home a monthly newsletter” or “we have a parent portal” (parents in working-family communities do not check portals).
8. When a kid isn’t clicking, what does your playbook actually say to do?
Why it matters: every provider has kids who struggle. The difference is whether the provider has a documented playbook or improvises. Improvisation produces incidents. Playbooks produce outcomes.
Great answer: a written behavioral support ladder starting at the site lead, escalating to a regional coordinator on the second step, and triggering a same-day parent call on the third step — with the willingness to say honestly when the provider is not the right fit for a specific child.
Walk-away answer: “we try to work with every kid” without a documented step-by-step response.
9. Every instructor is cleared TB, Live Scan, and Mandated Reporter?
Why it matters: baseline compliance. Any provider unclear on this question is not ready to be in your building.
Great answer: yes, before day one, with documented records the district can request at any time.
Walk-away answer: “most of our instructors are cleared” or “we work on it in the first month.”
10. If a shipment of materials is delayed, what happens?
Why it matters: materials chaos is the most common weekly failure mode in California afterschool. Providers that plan for it deliver programs. Providers that don’t send kids home.
Great answer: on-site backup kits at every partner school and a documented fallback activity per four-week cycle that runs on the school’s existing supplies.
Walk-away answer: “our materials always arrive on time” (they will not).
11. What does your reporting to my services officer look like?
Why it matters: when the district gets a state visit, the reporting artifact is what stands between a clean review and an audit finding. Weekly narrative paragraphs will not hold up.
Great answer: a live CDE-format dashboard with attendance, standards coverage, program completion, and instructor credentials — exportable at any moment.
Walk-away answer: “we produce end-of-year narrative summaries” or “our reporting is in our LMS.”
12. Which districts have walked away from your program in the last three years, and why?
Why it matters: this is the single most revealing question in the entire evaluation. Every serious provider has districts that decided the fit was wrong. The willingness to talk about them honestly is the tell.
Great answer: a specific named district (or two), an honest description of what did not work, and what the provider did or did not change afterward.
Walk-away answer: “no district has ever left us” (statistically impossible) or a defensive rebuttal that blames the district.
How to Use This Checklist
Send it to your evaluation team before the vendor meetings. Ask every vendor the same twelve questions in the same order. Rate each answer on a 1-3 scale (clear miss, adequate, strong). At the end of the process, the vendor with the most strong answers is almost always the right choice — not the vendor with the lowest price or the glossiest deck.
The other benefit of this checklist is diagnostic. If you finish it and realize your current provider would score under 20 out of 36, that is useful information heading into your 2026-27 RFP cycle. The questions are the same whether you are choosing a new provider or evaluating the one you already have.
What Every Great Provider Should Refuse to Promise
A short list, adapted from the field’s own experience:
- That every kid will love every day.
- That any single provider is the right fit for every school in a district.
- A behavioral or academic miracle in one semester.
- That every signature track lands equally at every age band and every site.
Providers that will not name what they cannot promise are not being modest. They are being unreliable. The willingness to write the second column is one of the most reliable signals a district can look for.
Sources and Further Reading
- Wallace Foundation — The Power of Investing in Afterschool Educators — wallacefoundation.org
- Wallace Foundation — The Cost of Quality Out-of-School-Time Programs — wallacefoundation.org (PDF)
- Forum for Youth Investment / Weikart Center — Youth Program Quality Assessment (PQA) — forumfyi.org/weikartcenter
- CDE Quality Standards for Expanded Learning — cde.ca.gov/ls/ex/qualstandexplearn.asp
- CDE Continuous Quality Improvement Process — cde.ca.gov/ls/ex/cqiforel.asp
- CDE ELO-P Program Information — cde.ca.gov/ls/ex/elopinfo.asp
- California AfterSchool Network — Program Planning & Development — afterschoolnetwork.org
- Policy Analysis for California Education (PACE) — Educator Workforce & Effectiveness — edpolicyinca.org
This piece was published by The Kodely Blog, which covers California expanded learning, TK-8 afterschool programming, ELO-P policy, and district-level program design. Kodely partners with California school districts and independent schools on TK-8 afterschool and summer programs. If you are evaluating providers for 2026-27 and want to walk through the twelve questions with someone who runs programs like this, we are happy to have a conversation.