IPA/J-PAL Executive Education Training: Evaluating Social Programs, Uganda 2018
Program Objectives
From August 6-10, IPA Uganda and J-PAL Africa held a five-day in-person training on why and when researchers and policymakers might choose to conduct randomized evaluations and how randomized evaluations are designed in real-world settings. The course covered basic concepts related to measuring impact through randomized evaluations and discussed technical design choices as well as pragmatic considerations when conducting a randomized study. The training reviewed the benefits and methods of randomization, how to choose an appropriate sample size, and common threats and pitfalls to the validity of an experiment. The course also covered the importance of a needs assessment and a theory of change, and how to measure outcomes effectively—tools that are critical for all program evaluations.
Program Focus
The following key questions and concepts were covered.
- What is an evaluation?
- Why and when is a rigorous evaluation of social impact needed?
- The common pitfalls of evaluations and how randomization helps avoid them.
- The key components of a good randomized evaluation design.
- Alternative techniques for incorporating randomization into project design.
- How do you determine the appropriate sample size, measure outcomes, and manage data?
- Guarding against threats that may undermine the integrity of the results.
- Techniques for the analysis and interpretation of results.
- How to maximize policy impact and test external validity.
- Understanding and using the Theory of Change framework.
Target Audience
The course was designed for directors, managers, officers, and researchers from governments, NGOs/nonprofits, international development organizations, and foundations, as well as trained economists looking to retool.
Former participants say:
“Great opportunity to design and receive feedback on our own evaluations.”
“Really enjoyed the teaching methods. The initial exposure to case studies was then solidified through lectures and small group work. The constant interaction kept students engaged throughout.”
“I enjoyed this training very much and thought the experience was excellent. I still am buzzing whenever I speak about it. There were many wonderful aspects: the working groups, the quality of the other students, the quality of the TAs and the seriousness and dedication of the training effort. It was absolutely first-class.”