Some education policymakers focus on bringing down pupil–teacher ratios. Others argue that resources will have limited impact without systematic reforms to education governance, teacher incentives, and pedagogy. We examine a program under which school committees at randomly selected Kenyan schools were funded to hire an additional teacher on an annual contract renewable conditional on performance, outside normal Ministry of Education civil-service channels, at one-quarter normal compensation levels. For students randomly assigned to stay with existing classes, test scores did not increase significantly, despite a reduction in class size from 82 to 44 on average. In contrast, scores increased for students assigned to be taught by locally-hired contract teachers. One reason may be that contract teachers had low absence rates, while centrally-hired civil-service teachers in schools randomly assigned contract teachers endogenously reduced their effort. Civil-service teachers also captured rents for their families, with approximately 1/3 of contract teacher positions going to relatives of existing teachers. A governance program that empowered parents within school committees reduced both forms of capture. The best contract teachers obtained civil service jobs over time, and we estimate large potential dynamic benefits from supplementing a civil service system with locally-hired contract teachers brought in on a probationary basis and granted tenure conditional on performance.
We study a government program in Uganda designed to help the poor and unemployed become self-employed artisans, increase incomes, and thus promote social stability. Young adults in Uganda’s conflict-affected north were invited to form groups and submit grant proposals for vocational training and business start-up. Funding was randomly assigned among screened and eligible groups. Treatment groups received unsupervised grants of $382 per member. Grant recipients invest some in skills training but most in tools and materials. After four years, half practice a skilled trade. Relative to the control group, the program increases business assets by 57%, work hours by 17%, and earnings by 38%. Many also formalize their enterprises and hire labor. We see no effect, however, on social cohesion, antisocial behavior, or protest. Effects are similar by gender but are qualitatively different for women because they begin poorer (meaning the impact is larger relative to their starting point) and because women’s work and earnings stagnate without the program but take off with it. The patterns we observe are consistent with credit constraints.
Retrospective voting models assume that offering more information to voters about their incumbents’ performance strengthens electoral accountability. However, it is unclear whether incumbent corruption information translates into higher political participation and increased support for challengers. We provide experimental evidence that such information not only decreases incumbent party support in local elections in Mexico, but also decreases voter turnout and support for the challenger party, as well as erodes partisan attachments. While information clearly is necessary to improve accountability, corruption information is not sufficient because voters may respond to it by withdrawing from the political process. We conclude with a discussion of the implications of our findings for studies of voting behavior.
In 2013 IPA celebrated ten years of producing high-quality evidence about what works, and what does not work, to improve the lives of the poor. It was a year of celebration for our accomplishments. More so, it was a time to prepare our organization for the next phase as we continue to pursue our vision of a world with More Evidence and Less Poverty.
View an online version of the report at annualreport.poverty-action.org/2013annualreport/
There is growing interest in using messaging to drive prosocial behaviors, which contribute to investment in public goods. The authors worked with a leading nongovernmental organization in Peru to randomize nine different prorecycling messages that were crafted on the basis of best practices, prior evidence, and theories of behavioral change. Different variants emphasized information on environmental or social benefits, social comparisons, social sanctions, authority, and reminders. None of the messages had significant effects on recycling behavior. However, reducing the cost of ongoing participation by providing a recycling bin significantly increased recycling among enrolled households.
Are minorities treated differently by the legal system? Systematic racial differences in case characteristics, many unobservable, make this a difficult question to answer directly. In this paper, we estimate whether judges differ from each other in how they sentence minorities, avoiding potential bias from unobservable case characteristics by exploiting the random assignment of cases to judges. We measure the between-judge variation in the difference in incarceration rates and sentence lengths between African-American and White defendants. We perform a Monte Carlo simulation in order to explicitly construct the appropriate counterfactual, where race does not influence judicial sentencing. In our data set, which includes felony cases from Cook County, Illinois, we find statistically significant between-judge variation in incarceration rates, although not in sentence lengths.
Despite their importance, there is limited evidence on how institutions can be strengthened. Evaluating the effects of specific reforms is complicated by the lack of exogenous variation in institutions, the difficulty of measuring institutional performance, and the temptation to "cherry pick" estimates from among the large number of indicators required to capture this multifaceted subject. We evaluate one attempt to make local institutions more democratic and egalitarian by imposing participation requirements for marginalized groups (including women) and test for learning-by-doing effects. We exploit the random assignment of a governance program in Sierra Leone, develop innovative real-world outcome measures, and use a preanalysis plan (PAP) to bind our hands against data mining. The intervention studied is a "community-driven development" program, which has become a popular strategy for foreign aid donors. We find positive short-run effects on local public goods and economic outcomes, but no evidence for sustained impacts on collective action, decision making, or the involvement of marginalized groups, suggesting that the intervention did not durably reshape local institutions. We discuss the practical trade-offs faced in implementing a PAP and show how in its absence we could have generated two divergent, equally erroneous interpretations of program impacts on institutions.
Published paper version available here.
A quota system for female village leaders in India changed perceptions of women’s abilities, improved women’s electoral chances, and raised aspirations and educational attainment for adolescent girls.
Can cash transfers promote employment and reduce poverty in rural Africa? Will lower youth unemployment and poverty reduce the risk of social instability? We experimentally evaluate one of Uganda's largest development programs, which provided thousands of young people nearly unconditional, unsupervised cash transfers to pay for vocational training, tools, and business start-up costs. Mid-term results after two years suggest four main findings. First, despite a lack of central monitoring and accountability, most youth invest the transfer in vocational skills and tools. Second, the economic impacts of the transfer are large: hours of non-household employment double and cash earnings increase by nearly 50% relative to the control group. We estimate the transfer yields a real annual return on capital of 35% on average. Third, the evidence suggests that poor access to credit is a major reason youth cannot start these vocations in the absence of aid. Much of the heterogeneity in impacts is unexplained, however, and is unrelated to conventional economic measures of ability, suggesting we have much to learn about the determinants of entrepreneurship. Finally, these economic gains result in modest improvements in social stability. Measures of social cohesion and community support improve mildly, by roughly 5 to 10%, especially among males, most likely because the youth becomes a net giver rather than a net taker in his kin and community network. Most strikingly, we see a 50% fall in interpersonal aggression and disputes among males, but a 50% increase among females. Neither change seems related to economic performance nor does social cohesion - a puzzle to be explored in the next phase of the study. These results suggest that increasing access to credit and capital could stimulate employment growth in rural Africa. In particular, unconditional and unsupervised cash transfers may be a more effective and cost-efficient form of large-scale aid than commonly believed. A second stage of data collection in 2012 will collect longitudinal economic impacts, additional data on political violence and behavior, and explore alternative theoretical mechanisms.
To the extent that students benefit from high-achieving peers, tracking will help strong students and hurt weak ones. However, all students may benefit if tracking allows teachers to better tailor their instruction level. Lower-achieving pupils are particularly likely to benefit from tracking when teachers have incentives to teach to the top of the distribution. We propose a simple model nesting these effects and test its implications in a randomized tracking experiment conducted with 121 primary schools in Kenya. While the direct effect of high-achieving peers is positive, tracking benefited lower-achieving pupils indirectly by allowing teachers to teach to their level.
How can new democracies and societies emerging from conflict encourage tolerance and dialogue, strengthen conflict resolution systems, and increase understanding of human rights?
The World Bank and other donors dedicate sizeable portions of their portfolios to community driven development (CDD) projects, yet until recently there has been little rigorous evidence regarding the efficacy of this approach. By emphasizing local participation in and control over project implementation, CDD has come to be seen as an efficient and accountable mechanism to deliver local public goods. But CDD aims to do much more than this. Through intensive, long term facilitation, CDD aims to strengthen local institutions, make them more democratic and inclusive of marginalized groups, and enhance the capacity of communities to engage in collective action. This evaluation tests the extent to which CDD achieved these goals in Sierra Leone.
Following the 2011 elections, one of the most pressing challenges for the President, government ministries and international organizations is boosting youth incomes and employment, especially those of high-risk youth. What kinds of programs can boost employment and incomes and reduce the risk of social instability? This report details findings from an impact evaluation of a reintegration and agricultural livelihoods program for high-risk Liberian youth, and draws out lessons for employment policies in 2012 and beyond.
This paper draws lessons from an original randomized experiment in Malawi. In order to understand why roads in relatively good condition in rural areas may not be used by buses, a minibus service was subsidized over a six-month period over a distance of 20 kilometers to serve five villages. Using randomly allocated prices for use of the bus, this experiment demonstrates that at very low prices, bus usage is high. Bus usage decreases rapidly with increased prices. However, based on the results on take-up and minibus provider surveys, the experiment demonstrates that at any price, low (with high usage) or high (with low usage), a bus service provider never breaks even on this road. This can contribute to explain why walking or cycling is so widespread on most rural roads in Sub-Saharan Africa. In terms of policy implications, this experiment explains that motorized services need to be subsidized; otherwise a road in good condition will most probably not lead to provision of service at an affordable price for the local population.
Little is known about the impacts of military service on human capital and labor market outcomes due to an absence of data as well as sample selection: recruits are self-selected, screened, and selectively survive. We examine the case of Uganda, where rebel recruitment methods provide exogenous variation in conscription. Economic and educational impacts are widespread and persistent: schooling falls by nearly a year, skilled employment halves, and earnings drop by a third. Military service seems to be a poor substitute for schooling. Psychological distress is evident among those exposed to severe war violence and is not limited to ex-combatants.