Accumulating evidence suggests that pay-for-performance (P4P) contracts can elicit greater effort from incumbent civil servants, but less is known about how these contracts affect the composition of the public sector workforce. We provide the first experimental evidence of the impact of P4P on both the compositional and effort margins. In partnership with the Government of Rwanda, we implemented a ‘pay-for-percentile’ scheme (Barlevy and Neal 2012) in a novel two-tier experimental design. In the first tier, we randomly assigned teacher labor markets to either P4P or equivalent fixed-wage contracts. In the second tier, we implemented a ‘surprise’, school-level re-randomization, allowing us to separately identify the compositional effects of advertised P4P contracts and the effort effects of experienced P4P contracts. Our pre-analysis plan sets out a theoretical framework that helps to define a set of hypotheses, and conducts simulations on blinded data to develop high-powered tests. We find that P4P contracts did change the composition of the teaching workforce, drawing in individuals who were more money-oriented, as measured by a framed Dictator Game. But these recruits were not less effective teachers—if anything the reverse. On the effort margin, we observe substantial and statistically significant gains in teacher value added, mirrored in positive effects on teacher presence and observed pedagogy in the classroom. In Year 2, we estimate the total effect of P4P, across compositional and effort margins, to be 0.21 standard deviations of pupil learning. One quarter of this impact can be attributed to selection at the recruitment stage, with the remaining three-quarters arising from increased effort.
In Ghana, we have continued our global tradition of rigorous, applicable research by building foundational research capacity and conducting evaluations in areas of pressing national concern. Examples of our work in this brief offer promising insights into everyday issues that affect the lives of the Ghanaian poor.
This paper examines the effects of a government-sponsored apprenticeship training program designed to address high levels of youth unemployment in Ghana. The study exploits randomized access to the program to examine the short-run effects of apprenticeship training on labor market outcomes. The results show that apprenticeships shift youth out of wage work and into self-employment. However, the loss of wage income is not offset by increases in self-employment profits in the short run. In addition, the study uses the randomized match between apprentices and training providers to examine the causal effect of characteristics of trainers on outcomes for apprentices. Participants who trained with the most experienced trainers or the most profitable ones had higher earnings. These increases more than offset the program’s negative treatment effect on earnings. This suggests that training programs can be made more effective through better recruitment of trainers.
We assessed the impacts of a teacher professional development program for public and private kindergartens in the Greater Accra Region of Ghana. We examined impacts on teacher professional well-being, classroom quality, and children’s readiness during one school year. This cluster-randomized trial included 240 schools (teachers N = 444; children N = 3,345, Mage = 5.2) randomly assigned to one of three conditions: teacher training (TT), teacher training plus parental-awareness meetings (TTPA), and controls. The programs incorporated workshops and in-classroom coaching for teachers and video-based discussion groups for parents. Moderate impacts were found on some dimensions of professional well-being (reduced burnout in the TT and TTPA conditions, reduced turnover in the TT condition), classroom quality (increased emotional support/behavior management in the TT and TTPA conditions, support for student expression in the TT condition), and small impacts on multiple domains of children’s school readiness (in the TT condition). The parental-awareness meetings had counteracting effects on child school readiness outcomes. Implications for policy and practice are discussed for Ghana and for early childhood education in low- and middle-income countries.
In Rwanda, we have continued our global tradition of rigorous, applicable research by building foundational research capacity and conducting evaluations in areas of pressing national concern. Examples of our work below offer promising insights into everyday issues that affect the lives of the Rwandan poor.
Children and parents sometimes make ill-informed educational choices, resulting in unrealized educational goals, children dropping out of school, and children joining the labor force. In partnership with Innovations for Poverty Action and the Ministry of Education in Peru, researchers designed and rigorously evaluated two interventions intended to improve decision-making about education and time-use by providing schoolchildren and their families with information about the returns to education.
- Students’ and parents’ perceptions of the financial benefits to education increased. Accessing information about the social and financial returns to education via videos and an interactive tablet application corrected misconceptions about the benefits of education.
- Dropout rates fell. Information had a significant negative effect on dropout rates in both rural and urban areas.
- Child labor effects were mixed. Videos decreased child labor for girls in urban areas, but did not affect child labor in rural areas. The tablet application reduced child labor among 6th graders in rural areas, but not among other groups.
- The Ministry of Education in Peru is continuing the intervention in 2,001 secondary schools. The marginal cost of the video campaign was less than US$0.05 per student (not including the fixed costs of producing the video). Given the low cost and promising results, the Ministry of Education is scaling the use of these videos in after school programs.
* These results are preliminary and may change after further data collection and analysis.
We present results from a large-scale randomized experiment across 350 schools in Tanzania that studied the impact of providing schools with (a) unconditional grants, (b) teacher incentives based on student performance, and (c) both of the above. After two years, we find (a) no impact on student test scores from providing school grants, (b) some evidence of positive effects from teacher incentives, and (c) significant positive effects from providing both programs. Most importantly, we find strong evidence of complementarities between the two programs, with the effect of joint provision being significantly greater than the sum of the individual effects. Our results suggest that combining spending on school inputs (which is the default policy) with improved teacher incentives could substantially increase the cost-effectiveness of public spending on education.
A pesar de la importancia del desarrollo de habilidades en ciencias y resolución de problemas para educadores, padres, y estudiantes, la evidencia rigurosa sobre el aprendizaje y enseñanza de ciencias en edades tempranas es escasa. Innovations for Poverty Action (IPA) se encargó de evaluar una intervención que fue implementada como resultado de una colaboración entre el Ministerio de Educación y Ciencias (MEC), el Banco Interamericano de Desarrollo (BID), la Asociación de Utilidad Pública Juntos por la Educación, y Agencia Internacional de Cooperación del Japón (JICA). La intervención es una pedagogía bilingüe (guaraní-español) basada en el enfoque de la indagación para la enseñanza de ciencias guiada a través de audio-grabaciones.
Rates of participation in early childhood education (ECE) programs are on the rise globally, including in sub-Saharan Africa. Yet little evidence exists on the quality of these programs and on the role of classroom quality in predicting learning for young children across diverse contexts. This study uses data from the Greater Accra Region of Ghana (N = 3,407; Mage = 5.8 years; 49.5% female) to examine how changes in four culturally-validated dimensions of ECE classroom quality predict children’s growth in early academic and social-emotional skills from the beginning to the end of one academic year. We find that improvements in domains of classroom instructional quality are related to small, positive gains in children’s early academic and social-emotional outcomes over the school year, and that these improvements are generally larger for children and classrooms with higher baseline proficiency and quality levels. Associations between changes in social-emotional aspects of classroom quality and child outcomes were mixed. These results extend the knowledge base on ECE quality to a new and under-represented context while also providing important information regarding the contexts and children for whom teacher training and other quality-focused improvement efforts may be most needed.
This study examines how parent socioeconomic status (SES) directly and indirectly predicts children’s school readiness through pathways of parental investment. Data come from direct assessments with preschool children and surveys with their primary caregivers in Ghana at the start of the 2015–2016 school year (N = 2,137; Mage = 5.2 years). Results revealed SES-related gaps in all parental investment characteristics and child school readiness skills. Preschool involvement served as the primary mediating mechanism in the path from SES to most school readiness skills, though it did not predict executive function. The number of books in the household was marginally positively predictive of early literacy, whereas at-home stimulation was negatively related to motor, literacy, and numeracy skills.
The Strategic Planning Secretariat of the Ministry of Education, with technical assistance from the Abdul Latif Jameel Poverty Action Lab (J-PAL) and Innovations for Poverty Action (IPA), is implementing an education lab for innovations. This Lab is an innovative approach to policymaking, which creates a learning space to design low cost interventions that have the potential to trigger big impacts in learning and implementation outcomes. The proposed interventions will be rigorously tested using the Ministry’s administrative data systems when available, with the aim of scaling those innovations that prove to be effective. The Lab’s combination of low-cost interventions with the use of administrative data offers a highly efficient scheme for innovation and design of public policies based on evidence, both in terms of resources and availability of timely results without interfering with the implementation of the Ministry’s interventions.
Read more about MineduLAB here.
Using a randomized control trial, we examine whether offering adolescent girls nonmaterial resources – specifically, negotiation skills – can improve educational outcomes in a low-income country. In so doing, we provide the first evidence on the effects of an intervention that increased non-cognitive, interpersonal skills during adolescence. Long-run administrative data shows that negotiation training significantly improved educational outcomes over the next three years. The training had greater effects than two alternative treatments (offering girls a safe physical space with female mentors and offering girls information about the returns to education), suggesting that negotiation skills themselves drive the effect. Further evidence from a lab-in-the-field experiment, which simulates parents’ educational investment decisions, and a midline survey suggests that negotiation skills improved girls’ outcomes by moving households’ human capital investments closer to the efficient frontier. This is consistent with an incomplete contracting model, where negotiation allows daughters to strategically cooperate with parents.
Using a randomized-control trial, this study evaluates a program designed to support Ghanaian kindergarten student-teachers during pre-service training through mentorship and in-classroom training. Several potential barriers to improved teaching quality and learning outcomes are examined. Findings show that the program improved knowledge and implementation of the national curriculum for individuals both when they were student-teachers and, the following year, when they became newly qualified teachers (NQTs). There were mixed impacts on professional well-being, increasing personal accomplishment and motivation but decreasing job satisfaction for NQTs. There were mixed impacts on teaching quality, with increases in child-led learning but decreases in some other aspects of quality. There were no impacts on NQTs’ student learning outcomes. The findings highlight system level challenges with both the posting of NQTs and the absence of support in their first teaching year. Implications for global early childhood education policy and teacher education are discussed.
This study uses data from the Health and Literacy Intervention (HALI) program evaluation, an in-service teacher training program focused on early grade literacy instruction for class one teachers. We assess how changes in classroom instructional processes impacted by the HALI teacher training were associated with improved early literacy outcomes for children. We find that experimentally induced increases in exposure to print—measured both through changes to time spent reading in class and through print displayed in the classroom—were associated with improvements in students’ reading fluency and reading comprehension. Implications for global education efforts to improve learning outcomes are discussed.