Great question. I don't think I would look for one thing in isolation. Strong outcome evidence matters enormously, but I would also want to understand whether the organization can actually execute, measure what is happening honestly, learn quickly, and improve when things aren't working as expected.
I would probably start relatively small and look for evidence of that learning and execution capacity before making a much larger bet. Cost-effectiveness matters, as do government relationships and verification systems, but I wouldn't expect a small organization to already have everything a much larger organization has built over many years.
One thing I appreciate more now is organizational culture: are people unusually focused on the problem, willing to surface bad news, rigorous about data, able to distinguish activity from results, and constantly looking for ways to improve? A strong intervention can deteriorate a lot through weak implementation, while a strong learning culture can iterate and improve over time.
So I would probably look for some combination of promising evidence, unusually strong execution and learning culture, a plausible path to cost-effectiveness, and enough local knowledge and relationships to operate effectively—and then learn and evolve through actual mistakes and keep doing that when things get tough.
Thanks for these thoughtful questions, and you're right that scaling hasn't been straightforward.
Mellex, thanks for sharing your concerns and questions. Likewise, we appreciate all the work Taimaka does to address malnutrition and have appreciated the lessons your team has shared with us on ORS/zinc distribution!
Vinay, thanks for advocating for this work. One of the most effective tools we've found for addressing misconceptions is consistent, transparent data sharing. Over the past few years, we've invested in equipping our team to share program and household coverage survey data regularly with key stakeholders and implementing partners. Examples can be found here and here. We also share regular updates through our stakeholder newsletter and blog.
On government buy-in: it's accurate that some actors remain skeptical, but we collaborate closely with several arms of the national government, including the logistics division of NPHCDA. We also invest deeply in relationships with state health authorities who oversee primary healthcare. We have found that regularly sharing data and reports with stakeholders across different levels of government has helped us identify blind spots, improve operations, and strengthen a culture of last-mile data use and operational visibility.
Tony, thanks for your kind words!
Simon, thanks for this question. We will soon have new results on this. An RCT of the program found a modest but statistically significant effect on first-time clinic visits: children in treatment areas were 5 percentage points more likely to have ever been taken to a clinic than children in control areas (see page 37). We're now working with our research partner to assess whether our coverage surveys detect a similar pattern in facility visits across the population. That analysis is ongoing and will be published on our website.
Thanks, Toby! And thank you for all you do to cultivate these conversations on the EA Forum.
In Nigeria, we work across 7,000+ public health clinics that already provide childhood immunizations. Embedding our program within existing health infrastructure is essential and wouldn't be feasible in environments without a relatively stable vaccine supply chain and widespread clinic access. Northern Nigeria also has low vaccination coverage, high disease burden, and large birth cohorts, creating substantial room for impact. In higher-coverage contexts, marginal returns may look quite different.
We also invest heavily in addressing vaccine hesitancy: participating in village meetings, discussing questions from fathers, and engaging religious and traditional leaders to mobilize their communities. What that looks like varies considerably by setting.
What I think does generalize is the core logic: small financial incentives that offset practical barriers, such as transportation costs and lost income, can meaningfully shift caregiver behavior around routine health visits. At the same time, the importance of operational visibility and verified delivery at scale feels broadly underappreciated. How those principles are operationalized, at what cost, and through what systems would need to be worked out carefully in each new context.
Honestly, this is something I think about a lot. Our cost-effectiveness has improved significantly over time due to both operational efficiencies and favorable exchange rates, but we recognize that either can shift, and the program’s CEA could change at any time. There are three ways I think about managing this.
First, we are continually trying to simplify systems, reduce low-value operational burden, and identify where additional complexity is no longer improving program quality. We do this both to improve our cost per infant and to build the operational discipline that makes the program resilient to external changes.
Second, we've been investing in making our program genuinely reversible, such as developing the systems and governance to responsibly exit a geography when the evidence indicates it's time to do so, rather than continuing out of inertia.
Third, we're exploring how to improve cost-effectiveness by layering additional interventions onto our existing platform (such as ORS distribution) and testing lower-cost incentive models. The latter could unlock new geographies within Nigeria and beyond, and potentially serve as a graduation model for areas where our current approach is no longer sufficiently cost-effective.
Yes, potentially. This is a real possibility as we are having conversations with implementing partners on deploying in other settings. I would be interested in organizations with deep knowledge of and access to the communities they serve, strong operational leadership, high integrity, good relationships with local health systems and government, and a real willingness to measure results and change course based on what we learn.
I wouldn't necessarily expect a local partner to already have NI's systems or approach. In fact, part of the value of a partnership could be complementary strengths: a community-based organization may understand a population, geography, or reachability constraints far better than we do, while NI may bring useful experience in incentives, measurement, technology, verification, operations, and deploying at scale.
Underserved communities, including displaced populations, could be interesting settings in which to explore adaptations, and we are interested in exploring models for this. We would start with the problem: what is preventing children from being vaccinated, what is the local organization particularly good at solving, and is there a version of the model worth testing together?
For me, the important thing would be not to assume that the current NI model should simply be transplanted somewhere else. We'd want to listen, understand the context, make thoughtful adaptations, measure what happens, and be willing to stop or change course if it isn't working.