Improving the Design of Conditional Transfer Programs in Colombia: Evidence from a Randomized Education Experiment

Improving the Design of Conditional Transfer Programs in Colombia: Evidence from a Randomized Education Experiment

Template G Content Blocks
Sub Editor

Abstract

Conditional cash transfer (CCT) programs have been proven effective at improving educational attainment in some settings, but there has been little rigorous evaluation of CCT product design. Researchers in Bogotá, Colombia, evaluated whether changing the timing and type of CCTs could lead to greater impact on educational attainment. All CCT variations had similarly positive impacts on school attendance, but transfers conditional on continued education had a greater impact on secondary and tertiary school enrollment, particularly for the most at-risk children.

Policy Issue

Over the past decade many developing countries have expanded primary school access, energized by initiatives such as the United Nations Millennium Development Goals, which call for achieving universal primary education by 2015. High student absenteeism is a considerable challenge, however, since families can face many barriers and opportunity costs in sending their children to school. School enrollment issues are thought to be more pronounced among girls, low income families and older children. Despite the importance of education, academics and policy makers are still far from understanding what determines whether or for how long children are educated. Conditional cash transfer programs have proven effective at improving education outcomes in some settings (notably Mexico's PROGRESA/Oportunidades program); however their impact on other goals and in other environments may be very different.

Context of the Evaluation

Colombia is a relatively typical middle-income, Latin American country. Child mortality is relatively low at 21 per 1,000 births, and only 18 percent of the population lives on less than two dollars a day. Similar to many middle-income countries, school attendance in Colombia is close to 100 percent for younger children, but declines substantially after the age of 13. Average attendance is 92 percent among 15 year olds, 90 percent among 16 year olds, and 80 percent among 17 year olds. The drop is considerably faster for low-income individuals: by age 17 the attendance rate falls to 65 percent in this group. Moreover, in 2003, individuals from the bottom of the Colombian poverty index represented nearly 74 percent of those not properly enrolled in school. The primary reason cited for dropping out is the cost of education. Students must pay to enroll each year and pay for required items like uniforms, books, and supplies. Monthly education costs fluctuate between US$13 and US$22 – a relatively large expense considering that the poorest families in Bogota earn less than US$750 a year.

Details of the Intervention

In 2005, the city of Bogota established the Conditional Subsidies for School Attendance (“Subsidios Condicionados a la Asistencia Escolar”) program in an effort to improve student retention, lower drop-out rates and reduce child labor. Three different incentive structures for a new conditional cash transfer system (Subsidios) were piloted in two localities within the city:
 
Basic model: Participants received US$15 per month, conditional on the child attending school at least 80 percent of the required days that month. The total annual value of the transfer (US$150) is three times more than students’ reported average labor market earnings, and is slightly more than the average annual reported education expenditure (US$125). Students were removed from the program if they failed to reach the next grade twice, failed to meet the attendance target in two successive periods, or were expelled from school.
 
Savings treatment: This variant alters the timing of cash transfers by saving a portion of the monthly stipend on a bank account to be paid out at once. The monthly US$15, which is still conditional on an 80 percent attendance rate, is split into a direct payment of US$10 and a ‘savings’ component of US$5 which is held in a bank account. The accumulated funds are made available to families at the end of the year, just before enrollment for the subsequent grade level. This one-time payment of accumulated savings is unconditional on further attendance rates, i.e. once a child has met the attendance target in one month, the banked US$5 will be paid to the family at the end of the year regardless of attendance in future months. This structure creates a mechanism for families to save money for annual enrollment costs which might otherwise be an obstacle to students’ continuing from one grade level to the next.
 
Tertiary treatment: In addition to providing an incentive to attend school, this treatment provided incentives to graduate and then to matriculate to a higher education institution. Like in the savings treatment, in the short term, the monthly subsidy is reduced from US$15 to $10. However, upon graduating, students earned the right to receive a transfer of US$300, equivalent to 73 percent of the average cost of a year at vocational school, if they enrolled in a higher educational institution within one year.

Results and Policy Lessons

Researchers found that changing the structure of cash transfer programs had significantly different effect on enrollment and attendance rates, as well as graduation, enrollment in secondary school and matriculation to tertiary institutions. The first experiment compared the basic with the savings treatment, while the second experiment evaluated the tertiary treatment.

On average, all of the designs significantly increase attendance, generating gains of 3 to 5 percentage points. Despite the reduced bi-monthly transfers, the savings and tertiary treatments increase attendance rates by at least as much as the basic treatment. However, these two non-standard treatments are superior to a basic cash transfer when considering enrollment rates at both the secondary and tertiary levels. Within secondary school, simply postponing part of the transfer increases re-enrollment by 4 percentage points compared with no significant change for students in the basic treatment. The tertiary treatment increases secondary enrollment by 3.7 percentage points. The savings and tertiary treatments also appear to succeed in increasing the matriculation to tertiary institutions. The savings treatment increases enrollment by 9.4 percentage points while the tertiary treatment proves particularly effective, increasing matriculation by 48.9 percentage points.
 
Moreover, this study identifies the specific groups for which the different interventions have greatest effects. The difference, for example, in performance of the basic and savings treatments is entirely driven by their effects on the most at-risk students. The savings treatment is especially effective at improving enrollment of the lowest income students and students with the lowest participation rates. In comparison, the basic treatment has little effect on these groups of students. The tertiary treatment performs similarly to the savings treatment with a much more significant impact on students unlikely to re-enroll. This suggests that modifications in the structure of these interventions can also help target the program by better meeting the needs of those students most likely to drop out of school.  
There is some evidence that participation in these programs may cause potentially worrisome reallocation of resources within the household. For example, such spillover effects are evident in the finding that siblings (particularly sisters) of treated students work more and attend school less than those in families that received no treatment. Such findings suggest that families may decide to concentrate resources towards the sons and daughters that have become program beneficiaries, and away from those children that did not.
 
Overall, this research shows that experimenting with the design of incentive programs may have substantial benefits in terms of the efficacy of these programs. Simply postponing some of the cash transfers to a large lump-sum paid at the time of re-enrollment increases enrollment in both secondary and tertiary institutions without reducing daily attendance – particularly so for the poorest students and those most at-risk of dropping out. Moreover, incentivizing on graduation rather than on attendance alone has proven to be particularly effective, leading to higher levels of daily attendance and higher levels of enrollment at secondary and tertiary levels.

Sources

Related Papers Citations: 
Barrera-Osorio, Felipe, Marianne Bertrand, Leigh Linden, and Francisco Perez-Calle. 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia." American Economic Journal: Applied Economics. 3(April): 167-95.

 

March 12, 2015