Our CSR partner reports large beneficiary numbers but limited evidence of outcomes. Should we continue funding the programme?
Zuna Answer
5 ViewsExecutive Summary If your CSR partner is reporting large “beneficiary numbers” but there’s limited evidence of outcomes, I would not decide to “continue as-is.” Instead, continue only under a structured, time-bound improvement plan (or transition funding) based on measurable outcomes, credible verification, and risk controls. Counting beneficiaries alone is not enough—your funding should buy impact, not activity.
Key Recommendations
- Separate “funding decision” from “partner relationship decision”
- Funding: Make it conditional on an outcomes evidence plan and milestones.
- Relationship: If they can’t credibly measure and report outcomes, you may need to restructure, downscale, or exit even if the partnership has been good on intent.
- Use a simple impact test: Are outcomes measurable, attributable, and verified?
Ask the partner (or request from them) for evidence across three layers:
- Activity outputs: what was delivered (training sessions, sessions completed, visits, materials distributed)
- Immediate outcomes (0–3 months): behavior change, skill gain, increased access, adoption, follow-through
- Longer-term outcomes (3–12+ months): employment/income changes, retention, improved health indicators, school completion, reduced losses/recidivism—whatever matches your CSR theory of change
- Require a “Theory of Change + Measurement Plan” before continued funding
You want them to provide (and later implement):
- Clear logic: inputs → activities → outputs → outcomes → impact
- Indicators with targets (e.g., “% of trainees scoring above X,” “% job placements within Y months,” “attendance/retention change”)
- Data sources and method (surveys, pre/post tests, beneficiary records, school/clinic/job data, independent verification)
- Attribution/feasibility approach (at least contribution, not necessarily perfect causality)
- Put funding on milestones with verification
A practical approach:
- Phase 1 (next 60–90 days): deliver baseline data + outcome measurement method + first evidence of early outcomes
- Phase 2 (next 3–6 months): deliver mid-term outcome results with verification
- Phase 3 (next 6–12 months): report outcome and impact trends, compare against targets
Payment structure example (you can adapt):
- 30–40% contingent on establishing measurement + baseline
- 40–50% contingent on achieving outcome targets (not just beneficiary counts)
- 10–20% holdback until independent verification / final outcome report
- Use independent validation for credibility
If evidence is currently limited, add at least one of:
- Sample-based third-party evaluation (survey + field verification)
- Independent audit of beneficiary counts + outcome metrics
- Random spot checks for service delivery quality
This protects your reputation and reduces the risk of “numbers without meaning.”
- If outcomes cannot be evidenced, decide fast: continue with controls or exit
Common “continue only with controls” triggers:
- They can strengthen measurement quickly (within 1–2 quarters)
- Their logic is sound and they can access beneficiary data
- They accept milestone-based payments and independent verification
Common “exit / replace” triggers:
- They refuse baselines/indicator definitions
- Reporting remains exclusively headcount-based
- No credible data collection process exists
- They cannot demonstrate early outcomes even on pilot groups
Business Impact
- If you continue without outcome evidence: you risk poor ROI, reputational exposure, and internal stakeholder dissatisfaction (board/leadership will ask “what changed?”).
- If you move to milestone-based impact funding: you protect capital allocation, improve governance, and make CSR a measurable contributor to your broader ESG and talent/brand objectives.
Risks (and how to mitigate)
- Partner resistance: Mitigate with a structured transition plan + clear funding gates.
- Measurement quality risk: Mitigate by insisting on baseline + standardized indicators + independent verification.
- Attribution risk: Mitigate by focusing on “contribution to outcomes” and consistent outcome tracking over time.
- Operational delays: Mitigate with a short “measurement sprint” before large disbursements.
Immediate Next Steps (next 2–3 weeks)
- Request a 1–2 page Theory of Change + indicator table
- Inputs, activities, outputs, outcomes, timeline, metrics, targets, data sources
- Ask for the last 2 cycles of reporting, but reframe the review
- Reject “beneficiaries served” as the primary measure
- Review for outcome indicators, pre/post data, and evidence types
- Propose a milestone-based contract amendment (or new MOU)
- Include holdbacks, verification method, and defined reporting cadence
- Run an “outcome audit-lite”
- Randomly sample a small set of beneficiaries and validate whether outcomes match reported results (even a modest sample builds credibility quickly)
Three Quick Questions (to decide the right path)
- What is your CSR goal in plain terms (e.g., employability, education retention, health outcomes, women economic empowerment)?
- Over what time horizon do you expect outcomes (0–3 months vs 6–12 months)?
- Does the partner have access to beneficiary records or third-party data that can verify outcomes?
If you need help implementing these recommendations or would like expert guidance tailored to your organization, the team at Zunavish would be happy to assist.