Context
Independent evaluation establishes whether a program delivered what it promised, either mid-course, while there is time to correct, or after it closes. (Designing the measurement system that produces the evidence is separate: see MEL Systems, Strategy and Results Advisory.)
Programs, portfolios and trust funds are required to demonstrate results, and the credibility of that demonstration depends on the independence of the reviewer and on methods a donor, a board or an oversight body can re-check step by step. Assignments can be contracted with me as sole evaluator, or as team leader or team member within a firm’s or consortium’s team.
Scope of work
Evaluations designed and delivered to OECD DAC criteria, UNEG Norms and Standards and the commissioning institution’s evaluation policy.
The same methods apply to corporate and foundation programs, including AI-enabled programs and pilots, where the question is whether the system is doing what the business case claimed.
Specialisations
Climate and energy access, gender and jobs measurement, fragile and conflict-affected settings, small island developing states, quality infrastructure investment, digital transformation.
Evaluability assessments
Before an evaluation budget is committed, an evaluability assessment answers three questions: is the program’s logic clear enough to evaluate, does the evidence exist or can it still be collected, and will findings arrive in time to be used. The output is an evaluability report stating what can be evaluated now, what must be fixed first, and the evaluation design I would recommend. It is the lowest-cost point at which to establish whether an evaluation can succeed.
Relevant experience
Fifteen years in international development, fourteen of them with the World Bank Group, ADB and AIIB in their evaluation and results functions, earlier audit experience at Deloitte, and a published independence policy (see Ethics and Independence).
Next step
To scope an evaluation or an evaluability assessment, get in touch or send the TOR.
Selected engagements
- Technical facility for energy access in Africa, qualitative analysis for the annual portfolio review
- ADB Development Effectiveness Review, contributed to the corporate reporting on delivery
- Caribbean reconstruction trust fund, standing results and reporting advisory to the secretariat
Standard deliverables for this service
This service line is delivered as defined outputs. Each runs as the sequence shown, tailored to the assignment's terms of reference.
-
Design
MEL frameworks and evaluability assessments
MEL framework and learning agenda, or evaluation readiness check
- Information needs
- Indicators and learning agenda
- Reporting plan
- MEL framework or evaluability report
-
Evaluate
Independent evaluations
Mid-term and final evaluations of programs, funds and technical assistance
- Inception report
- Data collection
- Emerging findings debrief
- Draft and final report
- Evaluation brief
-
Evaluate
Validation and quality assessment
Peer review of completion reports and decentralised evaluations
- Desk review
- Check of ratings against evidence
- Review note
- Discussion and final comments
-
Evaluate
Evidence synthesis and lessons
Meta-evaluation and thematic lessons across portfolios
- Evidence inventory
- Extraction and screening
- Cross-cutting analysis
- Synthesis report and brief
Already have a TOR? Send it through the contact form and I will respond with a scoped proposal.
Related services: MEL Systems, Strategy and Results Advisory , Strategic Knowledge Products