Policy Research Working Paper 10471 Do Public Works Programs Have Sustained Impacts? A Review of Experimental Studies from LMICs Aanchal Bagga Marcus Holmlund Nausheen Khan Subha Mani Eric Mvukiyehe Patrick Premand Development Economics Development Impact Evaluation Group June 2023 Policy Research Working Paper 10471 Abstract Many low- and middle-income countries (LMICs) have investments in self-employment activities are also observed. introduced public works programs that offer temporary Importantly, the estimated impacts on earnings are much cash-for-work opportunities to poor individuals. This paper lower than planned transfer amounts due to forgone earn- reviews experimental evidence on the impacts of public ings, raising questions about cost-effectiveness. There is also works programs on participants over the short and medium little evidence of public works programs improving food run, providing new insights on whether they have sustained consumption expenditure. The review finds evidence of impacts. The findings show that public works mainly improvements in psychological well-being and women’s increase employment and earnings during the program. empowerment in some cases, but not systematically, and Short-term positive effects tend to fade in the medium run, with limitations in measurement. The paper concludes by except in a few cases in which large impacts on savings or outlining directions for future research. This paper is a product of the Development Impact Evaluation Group, Development Economics. It is part of a larger effort by the World Bank to provide open access to its research and make a contribution to development policy discussions around the world. Policy Research Working Papers are also posted on the Web at http://www.worldbank.org/prwp. The authors may be contacted at smani@fordham.edu and ppremand@worldbank.org. The Policy Research Working Paper Series disseminates the findings of work in progress to encourage the exchange of ideas about development issues. An objective of the series is to get the findings out quickly, even if the presentations are less than fully polished. The papers carry the names of the authors and should be cited accordingly. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the International Bank for Reconstruction and Development/World Bank and its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent. Produced by the Research Support Team Do Public Works Programs Have Sustained Impacts? A Review of Experimental Studies from LMICs* Aanchal Bagga, Tufts University** Marcus Holmlund, DIME, The World Bank Nausheen Khan, DIME, The World Bank Subha Mani, Fordham University and IZA Eric Mvukiyehe, Duke University Patrick Premand, DIME, The World Bank Keywords: Public works programs, Experimental evidence, Low- and middle-income countries, Sustainability, Social protection, Safety nets, Employment. JEL codes: H41, C93, O12, J22, I38 *We thank the authors of the various studies reviewed in this paper, as well as Samih Ferrah, Christelle Tchoupe, Jules Gazeaud, Oliver Sterck, Raphael Cottin, Issa Kiemtore, Brooke Hill, and Horacio Vera Cossio for their excellent research assistance during the implementation of the public works studies across countries. We specifically thank Girum Abebe, Ugo Gentilini, Samuel Kembou Nzale, Elizaveta Perova, Hrishikesh Tirumala Madabushi, Michael Weber, and an anonymous reviewer from DIME for detailed comments and suggestions on an earlier draft. Funding from the World Bank Jobs, UFGE and i2i Trust Funds is gratefully acknowledged. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the World Bank and its affiliated organizations, the Executive Directors of the World Bank, or the governments they represent. **Aanchal Bagga (email: Aanchal.Bagga@tufts.edu), Marcus Holmlund (email: mholmlund@worldbank.org), Nausheen Khan (email: nkhan8@worldbank.org), Subha Mani, Corresponding author (email: smani@fordham.edu), Eric Mvukiyehe (email: eric.mvukiyehe@duke.edu), and Patrick Premand (email: ppremand@worldbank.org). 1. Introduction There is growing emphasis on expanding social protection around the world. The United Nations Sustainable Development Goals call upon countries to “implement nationally appropriate social protection systems for all” (United Nations, 2018). Cash transfers and public works are among the most widely used and debated social protection programs in low- and middle-income countries (LMICs) (e.g., World Bank, 2018; Banerjee, 2022). 1 Both types of programs provide cash for consumption support and poverty alleviation in the short run and offer promise for medium-run improvements in living standards facilitated by investments in human capital and productive assets. The experimental literature on cash transfers goes back nearly 20 years, and their effectiveness is well-established (e.g., Fiszbein and Schady, 2009; Baird et al., 2014, Millań et al., 2019; Kondylis and Loeser, 2021). While the experimental evidence on public works has been much thinner, several new studies have been completed in the past five years. This paper reviews experimental evaluations of public works programs from LMICs. As such, we extend the scope of earlier reviews by Subbarao et al. (2013) and Gehrke and Hartwig (2018), which rely mostly on quasi-experimental evidence. We examine the impacts of public works on participants’ short-term employment and earnings, and whether effects are sustained over the medium run. We also discuss effects on consumption, savings, assets, women’s empowerment, and psychological well-being. There are various types of public works programs, and their objectives link to both social protection and employment policies. For instance, several large-scale public works programs in low- and middle-income countries, such as those in Ethiopia or India, were established to address climatic shocks. 2 Humanitarian organizations like the World Food Programme also routinely deploy policy instruments with features of public works programs in response to shocks or seasonality (World Food Programme, 2016). Some public works programs in Latin America were implemented in response to severe macroeconomic instability and crisis, for instance, in Argentina. 3 Public works programs have also been adopted in fragile settings to respond to economic instability induced by conflict and spur post-conflict recovery, such as in the Central African Republic, Comoros, Côte d’Ivoire, Democratic Republic of Congo (DRC), and Sierra Leone. In these cases, they aim to provide public goods or rebuild community infrastructure destroyed during the 1 For instance, around 60 low- and middle-income countries are implementing workfare programs (World Bank, 2018). 2 In 2005, Ethiopia introduced the Productive Safety Net Program (PSNP) to address chronic food insecurity arising from drought shocks (Tesfay et al., 2017). Similarly, in the 1990s, one state in India, Maharashtra offered India’s first public works program in response to a massive drought. Much later India introduced the world’s largest public works program as a ‘right to work’, the Mahatma Gandhi National Rural Employment Guarantee Act (MGNREGA), which guarantees 100 days of temporary employment per year to every household residing in a rural district in India (Imbert and Papp, 2015; Mani et al., 2020). 3 The currency crisis in the 1990s led Argentina to introduce the Trabajar “To Work” program that provided short-term work to the poor (Ravallion and Jalan, 1999), but the deepening of the financial crisis in 2002 led to the expansion of the program to Jefes De Hogar (Galasso and Ravallion, 2004) wherein all unemployed heads of household became eligible to participate in the workfare program. In some cases, the workers were also required or encouraged to save some of their wage earnings. 2 conflict and improve economic security and employment opportunities for individuals in conflict-affected regions. 4 Increasingly, the focus of public works programs is to improve medium-run employability, assets, and resilience to future shocks (Gehrke and Hartwig, 2018). Besides providing short-term employment or income support, these programs also aim to open pathways to productive employment after participants exit the program. This is often done by combining the public works experience with additional interventions, such as vocational training or micro-entrepreneurship support. 5 This paper reviews experimental evidence on public works programs, including a wave of recent studies, and provides directions for future research. We use a meta-analysis model to estimate the average impact of public works programs on individuals’ earnings and employment. We use data from all countries for which a published paper, working paper, or project report was either publicly available or made available by the authors as of December 2021. As such, the review is based on 11 randomized control trials across 9 countries––Comoros (Gazeaud et al., 2019), Côte d’Ivoire (Bertrand et al., 2021), DRC (Brandily-Snyers et al., 2021; Mani and Mvukiyehe, 2021), Djibouti (Devoto et al., 2017), the Arab Republic of Egypt (World Bank, DECRG; Croke et al., 2023), Ethiopia (Abebe et al., 2021), the Lao People’s Democratic Republic (World Bank, EAPGIL, 2020), Sierra Leone (Rosas and Sabharwal 2016), and Tunisia (Leight and Mvukiyehe, 2022) – see Appendix Table A1 for details. 6 We complement earlier work by Subbarao et al. (2013) and Gehrke and Hartwig (2018) in several important ways. First, we focus on public works experiments. Recent experimental studies provide causal evidence on the impacts of public works programs on individual participants and their households in diverse contexts, thus offering both greater internal and external validity. In contrast, existing reviews of public work programs are mostly based on quasi-experimental studies. This is a potential concern, as there are significant differences in findings generated by experimental and non-experimental evaluation methods (LaLonde, 1986; Smith and Todd, 2005; McKenzie, 2017; Card et al., 2018; Millán et al., 2019). The issue may be particularly salient for public works programs 4 Comoros rolled out a Social Safety Net Project (SSNP) that provided public works opportunities to poor households (Gazeaud et al., 2019). Public works programs in Sierra Leone, Côte d’Ivoire, DRC, and the Central African Republic were also introduced to facilitate post-conflict recovery (Rosas and Sabharwal, 2016; Bertrand et al., 2021; Brandily-Snyers et al., 2021; Mani and Mvukiyehe, 2021; Alik-Lagrange et al., 2023). 5 To achieve these broader objectives of transitioning workers from workfare to regular employment, during 1998-2000, Argentina’s Proempleo experiment provided specialized training or vouchers that entitled employers of workfare participants to a sizable wage subsidy (Galasso et al., 2004). The public works in Côte d’Ivoire included complementary micro-entrepreneurship or job search skills training (Bertrand et al., 2021). In Urban DRC, the public works program was complemented with incentivized savings and skills training (Brandily-Snyers et al., 2021). Similarly, the World Food Programme increasingly implements food-for- assets interventions that seek to put a greater emphasis on asset creation and environmental outcomes, together with providing complementary market access or livelihood support (World Food Programme, 2016). In recent innovations, digital public works have been piloted to also foster digital skill acquisitions. 6 A study from Malawi (Beegle et al., 2017) was not used, as it did not report results on employment and earnings in ways that are readily comparable to the other studies. A study from the Central African Republic did not have a report available at the time of the review, although it was recently published (Alik-Lagrange et al., 2023). 3 that rely on participants’ self-selection (Bertrand et al., 2021; Banerjee et al., 2022). Second, we review evidence from studies that document impacts on outcomes at various points in time where impacts measured during program (4 studies) are classified as “short run,” and post-program impacts (11 studies) are classified as “medium run.” 4 of these 11 studies track respondents over two rounds. Overall, this allows us to assess not just the short-run effects of the public works programs, but also their medium-run effects, which remain underexplored in the literature until recently. Importantly, we pay close attention to some of the intermediary outcomes (e.g., asset accumulation, savings) that relate to mechanisms that may drive sustained program impacts over the medium run. Third, we draw lessons from programs targeting different types of public works participants (e.g., youth; urban and rural populations; women), as well as from diverse cultural and institutional contexts. Lastly, while we focus our discussion on economic outcomes, we also examine impacts on women’s empowerment and psychological well-being, which remain understudied in the literature. There are a few caveats to this review. First, we focus on documenting the impact on participants’ outcomes. We are unable to comment on the general equilibrium effects or externalities of public works programs. This is not to suggest that these are not important, especially for programs that have a strong focus on the provision of public goods (e.g., roads, irrigation systems), the improvement of environmental outcomes (e.g., reforestation), or the generation of social externalities (e.g., social cohesion in post-conflict settings). However, only a few studies to date have been designed to identify general equilibrium effects or measure externalities (Abebe et al., 2021; Muralidharan et al., 2021; Leight and Mvukiyehe, 2022; Croke et al., 2023). Second, we are unable to directly compare the cost-effectiveness of the programs we study, as only two studies provide detailed cost data and cost-effectiveness analysis (Rosas et al., 2016; Bertrand et al., 2021). Third, while comparing across countries is helpful for external validity, the body of experimental evidence is largely concentrated in Sub-Saharan and North Africa, highlighting the need for additional evidence from other regions. Lastly, it is beyond the scope of this review to comment on the data quality or limitations of specific studies, though we provide information on attrition or take-up that is relevant to interpret some of the country-specific findings. The review documents substantial variation in the impacts of public works between studies and over time, but also highlights some consistent patterns and policy implications. First, public works tend to significantly improve participants’ employment and earnings during their participation in the program. Second, these short-term effects fade in the medium run, except in a few cases with particularly large short-term impacts on savings or investments in self-employment activities. Third, observed impacts on earnings are much lower than planned transfer amounts due to forgone earnings, which raises questions about cost-effectiveness. Fourth, there is little evidence of public works programs improving food consumption expenditure. Lastly, there is evidence of improvements in psychological well- 4 being and women’s empowerment in some cases, but it is not systematic, and measurement of these dimensions remains at times rather narrow. 2. Conceptual framework This section outlines various channels through which public works may impact participants’ outcomes in the short to medium runs. While it provides an overview of a broad range of mechanisms (including general equilibrium effects and externalities), the results section will later focus on a narrower set of outcomes and impacts for participants that are measured in the studies included in our review. Public works programs can impact individual and household-level outcomes through a combination of short-run income and substitution effects. Access to a public works program in a community is likely to attract unemployed as well as underemployed individuals, giving them an opportunity to move away from low-paid farm and off-farm work (Subbarao et al., 2013; Filmer and Fox, 2014). This, in turn, may increase both temporary employment and income for participants. The income effect may also increase households’ demand for food and non-food items (and hence consumption expenditures) in the short run (Ravi and Engler, 2015; Liu and Deininger, 2013; Azam, 2012). However, if program participants (or other members of their households) substitute other forms of employment (e.g., self-employment or low-paying wage jobs) to access public works jobs, then participation in public works could have little to no effect on overall household income and consumption due to forgone earnings from these other occupations (Bertrand et al., 2021; Brandily-Snyers et al., 2021). Depending on the type of labor substitution and the frequency of individuals’ earnings from each occupation, it could even have a (temporary) negative effect on participants’ household income and consumption, for instance, if public works payments are made less frequently or later than other income sources. The availability of short-term employment through public works may also allow households to smooth consumption expenditure and food security during the lean season when agricultural productivity is low (Zimmermann, 2014; Ravi and Engler, 2015; Beegle et al., 2017). Since unemployment or underemployment is known to be positively correlated with poor mental health and unhappiness (Clark and Oswald, 1994; Farré et al., 2018), public works opportunities may improve an individual’s psychological well-being (Bertrand et al., 2021, Hussam et al., 2021). At the same time, these opportunities might also create social stigma for participants (Ravallion, 2019). Several public works programs are specifically designed to encourage women’s participation in the workforce (Afridi et al., 2016; Devoto et al., 2017; World Food Programme, 2021). The ability to earn income, which may otherwise be restricted or even unavailable to women in low-and middle- income countries, has the potential to improve economic empowerment and autonomy. This may, in turn, reduce domestic violence (Buller et al., 2018; Bhalotra et al., 2021), though, in some contexts, greater autonomy may increase gender-based violence (Hidrobo and Fernald, 2013). 5 Public works programs may also increase household income and consumption expenditure through savings, investment, and skill accumulation in the medium run, that is, after participation in the program ends. Income from public works used for savings and productive investments like the purchase of inputs (e.g., fertilizers) or assets (livestock, smartphones, etc.) may lead to subsequent improvements in household income and consumption expenditure (Bertrand et al., 2021; Mani and Mvukiyehe, 2021). On-the-job learning and soft skills accumulation facilitated by participation in public works programs could also increase employment and earnings for participants, although there is currently little empirical evidence to support this (Alik-Lagrange et al., 2017; Bertrand et al., 2021). Public works programs may have broader externalities or general equilibrium effects that affect program participants or non-participants and can occur both in the short and medium runs. While the empirical analysis in this review does not consider these effects (as mentioned above), we briefly discuss them here. General equilibrium effects may operate via changes in private sector wages, public good creation in the community, or other social externalities. For example, public works programs may crowd out private sector employment and increase private sector wages, which in turn can increase household earnings and consumption expenditures among participants and non-participants alike (Azam, 2012; Imbert and Papp, 2015; Abebe et al., 2021; Muralidharan et al., 2021). The increase in local wage rates may also increase the overall price of goods, as such affecting the demand for food and non-food items. 7 Theoretically, the increase in private sector wages can also reduce the demand for labor among non-participants in the private sector. Further, public works programs often involve the construction or maintenance of public infrastructure that can spur economic opportunities for both participant and non- participant households. For instance, public works programs may improve environmental outcomes and assets by planting trees or rehabilitating degraded lands (Adjognon et al., 2020). In drought-prone regions, the construction of canals and irrigation systems can increase returns on agricultural investments and activities (Subbarao et al., 2013). Similarly, the construction or rehabilitation of roads can provide access to markets and better prices for agricultural commodities (Asher and Novasad, 2020). Lastly, public works programs may also produce social externalities by facilitating positive interactions between participants and could reduce crime and other risky behaviors through shifting time use toward public works and increasing income (Fetzer, 2020; Bertrand et al., 2021). Increased intra-group contact in ethnically diverse communities could potentially contribute to social cohesion outcomes. 3. Program features 7 The increase in price of goods is likely to come from firms in the private sector passing on the increase in the cost of production to the consumer, though this effect can vary across market structures. 6 There is substantial variation in key design elements across the 11 public works programs included in our study. Below (and in Table 1), we summarize the following features: duration of employment, targeting, wages, maximum earnings, and type of work. Overall, the public works programs included in this review are qualitatively like those from other low- and middle-income countries described in Subbarao et al. (2013), except for those that allow for repeated participation every year, like India's Mahatma Gandhi National Rural Employment Guarantee Act (MGNREGA) or the Ethiopia rural Productive Safety Net Programme (PSNP), which are not represented here. Duration of employment. Public works programs are designed to offer employment for a limited duration: the median participant is offered the equivalent of approximately 4 months of work. The maximum duration is 2.5 months in Djibouti and up to 18 months in the Egypt Community program. The programs can provide consecutive months of employment, though some spread days worked within one year or over longer periods. For instance, the two programs in Comoros and Ethiopia offer a total of 9 months of work, but for 3 months per year over 3 years. The program in Lao PDR offers employment during specific times in the agricultural cycle, spreading 75 days (~3.75 months) of employment over two full rainy seasons (~1.5 years). 8 The maximum duration of employment for all programs included in our review is summarized in Table 1. Targeting. All programs applied some form of geographic targeting. Four programs focused on urban areas, four on rural areas, and three covered both (Table 1). All programs used self-targeting, whereby the program is advertised, and individuals are invited to apply if they are interested. Many targeted specific groups such as youth (in Côte d’Ivoire and Sierra Leone), or women (in Djibouti, the Egypt Community program, and Lao PDR). Wages. Daily wages differ widely, ranging from $2.5 in Sierra Leone to $14.7 in the Egypt Community program, with a median of $9.60 (see Table 1). 9 Setting a wage for a public works program involves trade-offs (Bertrand et al., 2021). On the one hand, setting a low wage can facilitate self-targeting by discouraging individuals who already work and have higher earnings from leaving their occupation to join the program. On the other hand, setting a higher wage can enhance take-up as well as lead to larger impacts on earnings among individuals most in need. Five of the 11 programs set wages within 20% of the minimum wage, with 2 programs further below and 2 programs further above the minimum wage (see Table 1 and additional details in Table A2). This again shows substantial variation between programs. In practice, however, it is not always clear that the minimum wage is an appropriate benchmark, because a large share of workers in low-income 8 There is some variation in the number of days offered within some programs. For instance, the Sierra Leone program offered 50-75 days of work and the Egypt Infrastructure program offered 1 week to 3 months of work. In these instances, we have used the maximum days allowed in the program in the calculations, since the average time worked is not always available. In the Egypt Community program, the duration of participation was set between 12-18 months; however, on average, individuals work up to 11.7 months. 9 All wages are converted to US dollars using the 2021 PPP conversion factor from the World Bank’s International Comparison Program (https://data.worldbank.org/indicator/PA.NUS.PPP). 7 economies are self-employed or engaged in informal wage employment for which minimum wages are not binding. 10 Maximum program earnings. Since both the duration of employment and the daily wages vary, there is also substantial variation in maximum earnings. Figure 1 shows the maximum monthly-equivalent value of earnings from the public works program by program duration in months. The total maximum monthly equivalent earnings are calculated assuming only 20 days of work is available in a month. For instance, the public works program in Comoros was offered for 60 days per year for three years, which means the maximum duration of the program was nine months (60/20 = 3 months x 3 years = 9 months). The potential value increases with the total number of workdays offered by the program. Median maximum earnings are US$96.5 per month of work, but maximum earnings range from as low as US$27 in Comoros to as high as US$294.70 in Egypt Community (an outlier both in total value and duration of participation). Figure 1: Maximum earnings by maximum program duration Notes: The x-axis shows the maximum duration of the public works program in months. The y-axis shows the maximum per month earnings (in USD PPP 2021) possible from participating in the public works program. Type of work. Programs in urban areas include activities like street cleaning and garbage collection. In rural areas, work often contributes to larger infrastructure projects such as irrigation, afforestation, reforestation, or road construction and maintenance. Some 10 Several issues make the relevance of the minimum wage questionable as a benchmark in the study settings. First, the share of workers for which the minimum wage applies is very low, for instance in Sub-Saharan Africa or low-income economies where self-employment is prevalent but formal wage employment is rare (Bhorat et al., 2017; Filmer et al. 2014). Second, low-income countries (with the lower share of formal wage jobs) tend to set relatively higher minimum wages than middle- or upper-income countries (with a higher share of formal wage jobs) (Bhorat et al., 2017). Third, many countries have several minimum wages applying to different sectors, making it difficult to identify the right comparison (Bhorat et al., 2017). Lastly, minimum wage data are not documented consistently for all countries and years. 8 programs explicitly tailor activities to their target population. For example, the Egypt Community program mainly targeted women and focused on activities that were not considered physically strenuous, such as cleanliness and environmental awareness campaigns, early childhood education, and literacy promotion. Similarly, in Djibouti, the program targeted only women and included light community works such as street rehabilitation or small artisanal projects. Take-up: Program take-up is high in most studies, as shown in Table 1. Take-up rates were above 90 percent in Djibouti, Côte d’Ivoire, and Ethiopia. The lowest take-up rates occur in the Egypt infrastructure program (40 percent) and the Urban DRC program (56 percent). 9 Table 1: Program features Comoros Côte Djibouti Urban DRC Rural DRC Egypt, Arab Egypt, Arab Ethiopia Lao PDR Sierra Tunisia d'Ivoire Rep. Rep. Leone Community Infrastructure Duration of 9 months 7 months 2.5 months 4 months 4 months 18 months 3 months 9 months 3.75 months 3.75 months 3 months employment Daily wages (Value in 2021 $5.41 $10.34 $9.64 $4.83 $4.83 $26.95 $14.75 $4.23 $21.03 $2.52 $14.50 PPP US dollars) Ratio of program wage to minimum 0.4 0.8 NA 2.1 0.5 1.2 1.2 NA 1.1 6.3 0.9 wage Take-up rate 84% 93% 95.9% 56% 73% 79% 40% 97% n/a n/a 73% Geographic Urban/ Urban Urban Urban Rural Rural Urban/ Urban Rural Urban/ Rural targeting Rural Rural Rural Notes: Duration of employment presents the maximum length of program available in a year except in Lao PDR where it’s computed over 1.5 years. Further, in Comoros and Ethiopia, the program is offered for a few months every year for three consecutive years. In converting maximum days available on a public works project to months we assume that only 20 days of work is available in a month. See Table A2 for the calculation of the ratio of daily program wage to daily minimum wage. 10 4. Overview of experimental studies designs 4.1 Experimental designs Table 2 summarizes the experimental design and sample for the 11 studies included in this review. Of the 11 studies, five use individual or household-level randomized designs (Djibouti, Côte d’Ivoire, Lao PDR, and the two studies in DRC), two use cluster-level randomized designs with randomization at the community level (Sierra Leone and Ethiopia 11), and four use a two-stage cluster randomized designs (Comoros, 12 both studies in Egypt, and Tunisia). 13 In the two-stage cluster RCTs, communities were first randomized into treatment (receives the public works programs) and control (does not receive the public works programs); in the second stage, within the treated communities, individuals/households were further randomized into treatment (eligible to work in the public works program) and control (ineligible to work in the public works program). The goal of the two-stage designs was to assess spillover effects, which we do not discuss here. 14 Two of the public works experiments included multiple treatment arms to isolate the impact of the work component from complementary interventions that were designed to facilitate post-program transition to other forms of employment that generate more sustained impacts. In Urban DRC, these complementary features included incentivized savings and skills training (Brandily-Snyers et al., 2021). In Côte d’Ivoire, random subsets of participants were offered either additional entrepreneurship training to facilitate self- employment or training in job search skills to facilitate wage employment (Bertrand et al., 2021). Since only these two studies contain multiple treatments, we do not attempt to draw more general conclusions on complementary program design features in this paper. 4.2 Evaluation sample The median study sample size is 2,126. Individual-level randomized designs have a sample size ranging from 952 to 6,014. Cluster randomized designs have larger samples ranging from 1,017 to 19,442 with at least 30 clusters per treatment arm across studies. The median sample size per cluster is 31, comparable to the median sample size per cluster of 26 noted in Muralidharan and Niehaus (2017). 15 11 In Ethiopia, clusters were randomized into treatment and control, and, within treatment clusters, the participants were selected by local Ketena committees. 12 In Comoros the design varied the treatment intensity, 40 percent of eligible households received the intervention in treatment clusters and 20 percent of eligible households received the intervention in control clusters. 13 A few studies also offer public works opportunities to the control group in the post-evaluation period in a randomized phase-in design, namely, Egypt infrastructure, Sierra Leone, Ethiopia, and Djibouti. 14 In Comoros, a third level of randomization was carried out: in every treatment household, the gender of the participant was further randomly chosen within the household. 15 All individual level randomized experiments can detect at least a $1.50 improvement in consumption expenditure and earnings, assuming a standard deviation of $8 with 5 percent type I error rate and 80 percent power. Among the cluster RCTs, there is an improvement in consumption and earnings––the Egypt studies can detect at least a $1.40 improvement, Comoros $2.10, Ethiopia $1.70, Sierra Leone $1.00, and Tunisia $1.90. These are computed using the country specific cluster sizes noted in Table 2 and assuming a standard deviation of $8, intra-cluster correlation of 0.10, 5 percent type I error rate and 80 percent power. All these calculations also assume 100 percent take-up. In practice, however most programs did not have 100 percent take-up. Particularly low take-up rates in Urban DRC (56 percent) and Egypt infrastructure (40 percent) will reduce the power to detect significant effects substantially. 11 Follow-up survey attrition rates are generally small to modest in size. One exception is the study on the Egypt Community program, where attrition was 23 percent due to an administrative issue and not because of migration (Croke et al., 2023). Attrition in the Urban DRC (17.2 percent) and Djibouti (11.4 percent) studies was also relatively high, perhaps because of the urban contexts where mobility tends to be higher. Finally, the Tunisia study also had a high attrition rate of 19.6 percent between the first and second follow-up surveys, plausibly explained by the long-time gap between rounds (about four years). The studies in Comoros, Côte d’Ivoire, and Ethiopia reported very low attrition rates of 4.00 percent, 6.20 percent at endline (2.60 percent at midline), and 2.94 percent, respectively. Table 3 summarizes the key demographic characteristics of study participants. The median age of the participants is 33.2 years old (programs in Sierra Leone, Côte d’Ivoire, and the Egypt Community program explicitly targeted youth). The average household size varies between 3.9 and 6.9, and the median household size is 6.1. Except in Djibouti and Lao PDR, where the program targets only women, both men and women participate in most programs, but women account for less than half of participants in several countries, such as Comoros, Rural DRC, and Sierra Leone. In nine of the ten studies that report it, the median number of participants with no education is 33 percent. 12 Table 2: Evaluation Design Comoros Côte Djibouti Urban DRC Rural DRC Egypt, Arab Egypt, Ethiopia Lao Sierra Tunisia d’Ivoire Rep. Arab Rep. PDR Leona Community Infrastruct ure Level of Three levels: Individual Household Individual Individual Two levels: Two levels: Community Individu Community Two levels: randomization community; community; village; al Community; household; individual individual individual recipient’s gender Multiple treatment arms No Yes No Yes No No No No No No No (to test additional features) Total number 62 n/a n/a n/a n/a 196 260 90 n/a 276 80 of clusters Sample size 2,181 2,958 (short 952 (short 6,014 2043 1,017 (short 1,844 19,442 1099 5,486 2,126 (short run) run) run) run) 1,748 (medium 340 (medium run) run) 13 3,934 897 (medium) (medium run run) Attrition 4.0% 6.2% 11.4% 17.2% n/a 23% n/a 2.94% 3.0% n/a 19.6% Notes: Attrition rates are reported for the latest survey round. Sample size noted in the table reflects the no. of observations used for estimating the ITT effect of the public works programs on employment outcomes. 14 Table 3: Sample descriptive statistics Mean Proportion Proportion Mean Proportion Age Women with Household Living in an no Size Urban Area (%) Education (%) (%) (1) (2) (3) (4) (5) Comoros 29.6 36 22 6.6 n/a Côte d’Ivoire 24.7 42 49.0 6.1 93 Djibouti 33.4 100 82.4 6.9 100 Urban DRC 32.6 42.7 n/a 6 100 Rural DRC 34.2 38.1 26.1 6.6 0 Egypt, Arab 27.6 82.2 1.5 n/a n/a Rep. Community Egypt, Arab n/a 0.43 25.1 4.5 25 Rep. Infrastructure Ethiopia 33 57.6 24.9 3.9 100 Lao PDR 33.3 100 41 5.9 n/a Sierra Leone 27 33 52 n/a 49.6 Tunisia 41.5 49.8 60 n/a n/a Notes: Most of these characteristics are obtained using the control sample at baseline (except Sierra Leone, where we use the information from program participants). Tunisia and Egypt do not have a regular baseline and hence we used data from the control group in the 1st follow-up survey. The Urban DRC study reports median household size. n/a – not available. 4.3 Follow-up surveys and key outcomes All studies administered at least one follow-up survey after the start of the intervention to collect detailed data across the treatment and control groups. Four studies (Comoros, Côte d’Ivoire, Djibouti, Lao PDR) fielded follow-up surveys to measure impacts during the public works intervention. All studies, except Comoros, conducted at least one post-intervention follow-up survey to estimate impacts after the program ended. However, there is substantial variation in the timing of the post-program follow-up surveys, ranging from 1 month after the program in the Egypt Community and Sierra Leone programs to 66 months in the Tunisia program. Only four studies (Côte d’Ivoire, Djibouti, Egypt Community, and Tunisia) fielded two follow-up surveys to examine the evolution 15 of impacts over time. Figure 2 summarizes the timeline of the various interventions and follow-up surveys. Figure 2: Timeline – Public works programs and surveys We focus on five primary outcome variables that are measured consistently across studies. These outcomes allow us to document the impact of public works programs on individual employment, earnings, household food consumption expenditure, savings, and assets. Table 4 provides the definitions. We also compare findings on two secondary outcomes – psychological well-being and women’s empowerment. These outcomes are measured less consistently across studies, see Appendix Table A3 for their definition in each case. Table 4: Primary outcomes and definitions Variable name Definition Employment =1 if the individual works in any wage job or self-employed income-generating activity in the month before the survey. Monthly Sum of all the individual respondent’s earnings across all earnings occupations in the past 30 days measured in USD PPP 2021. Food Sum of all household expenditures on food items over the last 30 consumption days measured in USD PPP 2021. expenditure Savings =1 if the individual respondent has saved any money in the last 12 months. Asset index Constructed using PCA where the list of physical assets (like lamps, air conditioners, TV, etc.), movable assets (like bikes, motorbikes, etc.), and durable assets varies country-by-country. 16 5. Results––Impact estimates from 11 RCTs of Public Works Programs We now present the intent-to-treat (ITT) estimates of public works interventions on key outcomes. ITT estimates are based on the initial assignment to treatment status, regardless of whether individuals participated in the public works program. In most cases, governments or other parties that introduce programs can make them available to their target population, but they cannot mandate take-up, hence the ITT estimate is arguably the most policy-relevant parameter as it estimates the benefit of providing access to a program. The ITT estimate is computed as the difference in average outcomes in the treatment group (randomly chosen public works participants, from within the population targeted by the program) and average outcomes in the control group (randomly chosen non-participants from within the same population). 16 We report results separately for each outcome, study, and, when applicable, follow- up survey. In addition, we aggregate results across studies and follow-up surveys using a random effects REML model (like the approach in McKenzie, 2021). The meta-analysis takes as inputs the point estimates and standard errors from each study. Higher weight is given to studies that have smaller standard errors. 5.1 Employment Since public works programs offer cash in exchange of work, we first present their impacts on participants’ employment. In Figure 3, we document the estimated impacts on individuals’ employment from the different studies, along with the control mean for each case. The figure displays results by the timing of the survey with respect to program completion, with short-run impacts measured before individuals exit the program at the top (4 to 0 months before program completion), followed by impacts measured after individuals have exited the program in the medium run (from 1 to 66 months after program completion). Lastly, we also present estimates from a random-effects meta-analysis regression model that captures the short run, medium run, and overall impact of public works on employment. Short-run treatment effects during the program are positive and significant in Comoros, Côte d’Ivoire, and Djibouti. In Lao PDR, they are positive but marginally not significant. The probability of participants being employed increases by 14 to 54.5 percentage points during the program, with an average effect of 29.3 percentage points (95 percent CI:10.8, 47.8) across the four studies. These effects correspond to very large increases in relative terms in Comoros (263 percent) and in Djibouti (256 percent), where small shares of the control group are otherwise employed (11.9 percent and 21.3 percent, respectively). The relative effects are much smaller in Côte d’Ivoire (16 percent), where 16 All cluster randomized controlled trials included in this review, except the study on the Egypt Community program, compare randomly chosen participants in treatment clusters to non-participants in control clusters. In some cases, the sampling strategy used to sample non-participants in control clusters might differ from the sampling strategy used to sample participants in treatment clusters (e.g., Leight and Mvukiyehe, 2022). 17 85 percent of the control group has an occupation (in most cases working in informal jobs or self-employment). Even though the effect is not statistically significant in Lao PDR, the point estimate is non-negligible, suggesting a 15.5 percentage points increase, or 46 percent, relative to the control group. 17 Next, we examine the effects measured after individuals exited the public works program. These post-program effects remain substantial in Sierra Leone at 1 month (11.2 percentage points, or 34 percent relative to the control mean), Egypt Community at 1 month (21 percentage points, or 65 percent relative to the control mean), though not significant in Egypt Infrastructure at 4 months (1 percentage points; 1 percent relative to the control mean). Three studies continue to document positive employment effects at 12 months (Rural DRC and Tunisia) and at 25 months (Urban DRC). Four studies, however, find effects that are not statistically significant (Djibouti at 9 months, Côte d’Ivoire at 12 months, Ethiopia at 12 months, and Egypt Community at 27 months) and one study finds negative impacts (Tunisia at 66 months). Overall, the medium-run treatment effects are not significantly different from zero at 3.4 percentage points (95 percent CI: -1.2, 7.9) and decline with length of time since program completion. A fading-out of effects over time is observed across studies and is also observed within studies that include two follow-up surveys (Côte d’Ivoire, Djibouti, Egypt Community, and Tunisia). The positive effects on employment are primarily obtained in studies with low levels of baseline employment. The largest relative effects are observed in Comoros (263 percent), Djibouti (256 percent) and Tunisia (87 percent), where employment in the control group is relatively low (11.9 percent, 21.3 percent, and 9 percent, respectively). These large relative effects can be driven by the specific groups that are targeted in these cases, such as youth or women who are more likely to be unemployed or outside the labor force. They might also be explained by differences in the structure of the labor market across settings. For instance, underemployment is more widespread in less formalized economies, where many individuals are engaged in low-paying occupations and few are formally unemployed. The average effect on the likelihood of employment also hides substitution between occupations. In Côte d’Ivoire, a substantial share of treated youth substituted out of informal wage jobs and self-employment to take public works jobs, limiting the net effects on employment. In Ethiopia, the program increased employment in public works by 4.6 percentage points but also decreased employment in the private sector by 4.7 percentage points, resulting in an overall null result. 17 The authors also note that in an alternative specification there is a 16 percentage points increase in the likelihood of working in paid work. There is also an increase in being a ‘regular earner’. 18 Both Urban and Rural DRC and Tunisia (at 12 months) are the only studies that find employment effects beyond 1-month post-intervention. In all three, there is an increase in the ownership of productive assets among participants (in the form of purchased land in Urban DRC, livestock in Rural DRC, and movable assets, livestock, and electronic equipment in Tunisia) that could explain the medium-run effects on employment (Brandily-Snyers et al., 2021; Mani and Mvukiyehe, 2021; Leight and Mvukiyehe, 2022). There is only one study, Tunisia, that registers negative effects on employment measured 5.5 years after program completion. The authors speculate that the negative results on employment could be due to the program increasing wage expectations or increasing employment in informal occupations in the short-term, which may have limited improvements in employment outcomes over the longer-term. Figure 3: Estimates of the impact of public works programs on employment Notes: This figure presents the intent-to-treat effects on employment obtained from each study and follow- up survey. The effect size is the change in employment (in percentage points). Timing indicates the timing of the survey in months before/after program completion, where 0 indicates the time when the program was completed. The diamond shows the random effects meta-analysis estimate. The weight is from the random effects meta-analysis, with studies with smaller standard errors given larger weight. 19 Overall, the effects of public works on participants’ employment are mixed. On the one hand, they seem promising as most of the studies (8 out of 11) find positive and significant effects on employment at some point in time. Consequently, the overall impact of public works programs on employment is 9.8 percentage points (95 percent CI: 1.9, 17.8). On the other hand, the average employment impacts during the program are 29.3 percentage points. This can be seen as quite low: it means that, for every 100 individuals taking on jobs, 71 would have also worked in the absence of the program. As such, while public works programs do increase the share of individuals employed in the short run, their net effect on the number of participants employed is smaller than the number of positions they offer. In addition, the evidence shows that public works programs do not produce much sustained impacts on employment: the overall impact after the programs end is small (3.4 percentage points) and not significant (p=0.14), with only three of the nine point estimates beyond one-month post-intervention revealing a positive impact. 5.2 Earnings Figure 4 presents the effects of public works programs on monthly earnings for each study and follow-up survey. We find a positive and significant increase in earnings in at least one point in time in 10 of the 11 studies. Increases in earnings are observed in all cases with an increase in employment, except for the Urban DRC program. Similarly, no effect on earnings is found when there is no corresponding effect on employment, except in Côte d’Ivoire at 12 months, when a small impact on earnings is observed, and in Ethiopia, where the public works opportunity fully crowds out employment in the private sector. 18 Positive effects on earnings are found in all studies measuring impacts during the program, with an average increase of 51.3 USD (95 percent CI: 7.1, 95.4); this is sizable compared to the unweighted control mean of 55.5 USD. The positive effects on earnings are also found to persist up to 12 months after the program, except for Egypt Infrastructure (measured at 4 months) and Djibouti (measured at 9 months). However, positive impacts on earnings are not found for the three studies with follow-up surveys beyond 12 months post-intervention. The overall medium-run (i.e., post-program) effect is an increase of 7.8 USD (95 percent CI: -1.3, 16.8), which is significant at the 10 percent level (p=0.09). Whether a study shows significant earnings gains after the program seems associated with participants’ ability to acquire savings or productive assets for self-employment or business activities, which we will discuss further below. 18 In Ethiopia, and as mentioned earlier, the intervention increases public employment by 4.6 percentage points and reduced private employment by 4.7 percentage points. Hence the net effect on employment is zero. 20 Figure 4: Estimates of the impact of public works programs on monthly earnings Notes: This figure presents the intent-to-treat effects on monthly earnings obtained from each study and follow-up survey. The effect size is the change in monthly earnings (in USD PPP 2021). Timing indicates the timing of the survey in months before/after program completion, where 0 indicates the time when the program was completed. The control mean is the mean of the study control group. The diamond shows the random effects meta-analysis estimate. The weight is from the random effects meta-analysis, with studies with smaller standard errors given larger weight. From Figure 4, we can also examine the effect on monthly earnings relative to the monthly maximum possible value of earnings in the public works programs. The magnitude of forgone earnings is key for examining the cost-effectiveness of public works programs (e.g., Bertrand et al., 2021). At one extreme, if there are no forgone earnings, we would expect the program impacts on individuals’ earnings during the program to be 100 percent of the value of public works wages. At the other extreme, if individuals fully substitute income from other sources for public works earnings, we expect impacts on individuals’ earnings to be 0 during the program. As discussed above and documented in Figure 4, we see positive impacts on earnings in most cases during the program, ruling out a full substitution of income sources. However, Figure 5 below shows that the impacts on 21 earnings are substantially below the maximum possible value of monthly earnings during the program, which points to large forgone earnings for participants. The ratio of impacts on earnings relative to the maximum potential monthly earnings during the program is 23 percent in Comoros, 54 percent in Côte d’Ivoire, 70 percent in Lao PDR, and 36 percent in Djibouti. On average, impacts on earnings are 46 percent of maximum potential program earnings, pointing to substantial forgone earnings. 19 The impacts on earnings relative to the maximum potential program earnings also decline over time and are low after the program, with an average of 7 percent (significant at the 10 percent level, p=0.09). While lower impacts on earnings relative to the value of program earnings are expected after the program, the rate at which impacts decay is key for calculating cost-effectiveness, because this affects the net present value of program impacts on earnings over time. Overall, the fact that effects on earnings are much smaller than the maximum possible earnings from public works during the program and quickly fade over time raises questions about the overall cost-effectiveness of public works programs. The results also suggest variations between programs, though few studies, aside from those in Côte d’Ivoire and Sierra Leone, provide the detailed information on program costs sufficient to conduct a full cost-effectiveness analysis. Overall, the results show that the public works programs do lead to changes in earnings in the short run, but that these effects tend to fade in the medium run. In addition, the effects on earnings are small relative to the transfer amounts during the program, raising questions about cost-effectiveness. 19 Note that Figure 5 shows ratios with respect to maximum potential earnings, not average earnings. Imperfect take-up and participants working less than the allowed time partly explain why the ratios are smaller than 1, though most of the difference is explained by forgone earnings. For instance, in Côte d’Ivoire, impacts on earnings during the program are 63 percent of average earnings (purely explained by forgone earnings), and 54 percent of maximum earnings (explained by both forgone earnings and imperfect take-up). Average earnings cannot be estimated for each study, which is why we report results for maximum potential earnings. 22 Figure 5: ITT effects on monthly earnings relative to maximum monthly earnings Notes: This figure presents the intent-to-treat effects on monthly earnings expressed relative to the monthly maximum possible earnings from the public works program. Timing indicates the timing of the survey in months before/after program completion, where 0 indicates the time when the program was completed. Control mean is the mean of the study control group. The diamond shows the random effects meta-analysis estimate. The weight is from the random effects meta-analysis, with studies with smaller standard errors given larger weight. 5.3 Food consumption expenditure Public works programs are often conceived as a safety net intervention that can provide income support and facilitate consumption smoothing for poor households, particularly in the short run during program participation. Hence, we examine if the increases in earnings for participating individuals are associated with improvements in household food consumption expenditure. Figure 6 presents the estimated effects on household food expenditure for each study and follow-up survey for which it is available. 20 Of the seven studies that measure this outcome, only two (Tunisia and Rural DRC) find a positive and 20 There is some variation in the recall period used to measure consumption across studies. 23 statistically significant effect on consumption. 21 The public works programs increase food expenditure by 18.4 USD in Rural DRC (about 50 percent of the control mean), by 8.2 USD in Tunisia at 12 months, and by 15.1 USD (about 25 percent of the control mean) in Tunisia at 66 months. In general, the overall effects on food expenditures are small at 3.7 USD (95 percent CI: -2.1, 9.4) and not different from zero (p=0.21. The point estimates point to a slight decrease of 2.54 USD (95 percent CI: -4.5, -0.6) during the program and a small increase of 5.7 USD (95 percent CI: -1.3, 12.7) in the medium run, though they are not statistically different from each other. These overall results are also in line with previous work in Malawi, where the authors find no effects on food security for a public works program (Beegle et al., 2017). The null result on food consumption, despite the positive effects on employment and earnings, could mean that households are using the earnings to save or make productive investments, or that effects on individual participants’ earnings are not sufficient to improve household-level welfare outcomes. Figure 6: Estimates of the impact of public works programs on food consumption expenditure Notes: This figure presents the intent-to-treat effects on monthly food expenditure obtained from the different papers. The effect size is the change in monthly food consumption expenditure (in USD PPP 2021). Timing indicates the timing of the survey in months before/after program completion, where 0 indicates the time when the program was completed. Control mean is the mean of the study control group. The diamond shows the random effects meta-analysis estimate. The weight is from the random effects meta-analysis, with studies with smaller standard errors given larger weight. In Sierra Leone, the point estimate is 7.4 USD, representing an 8 percent increase relative to the control 21 mean, but with a 95 percent confidence interval of [-0.3;15.1]. 24 5.4 Savings and assets In Figures 7 and 8, we present the estimated effects of public works programs on the probability of having any savings in the 12 months prior to the survey and a household asset index, respectively. 22 Savings and assets can be used to smooth consumption in case of a shock or to facilitate investments and increase income from agricultural and self- employment activities. They are both important mechanisms through which the effects of the public works program could sustain in the medium run. The observed increases in earnings 12 months after program completion (shown in Figure 4) are associated with a higher incidence of savings 23 (Rural DRC, Tunisia, and Côte d’Ivoire) and higher assets (Rural DRC and Tunisia). The short-run increase in earnings in Côte d’Ivoire stems from higher wages from the public works program. However, the impacts 12 months post-program are due to higher profits from self- employment activities. Public works wages were paid into a bank account, leading to a substantial increase in savings during the program that were partly used to invest in capital for these small business activities (Bertrand, et al., 2021). Similarly, in Rural DRC, the 12- month impacts are associated with an increase in self-employment (by 8.5 percentage points), number of total hours worked (increase of almost 25 percent relative to the control mean), and increased ownership of productive assets such as livestock and physical assets such as refrigerators, televisions, air conditions, and motorbikes, that increased by 50 percentage points and 43.2 percentage points, respectively (Mani and Mvukiyehe, 2021). Even though the Ethiopia study does not report any information on the likelihood of saving, households in Ethiopia also used the earnings from public works to save, with eligible households doubling their savings post-program. Overall, the probability of having savings increases by 5.9 percentage points (95 percent CI: 0.60, 11.20), and the household asset index increases by 0.21 standard deviations (95 percent CI: 0.04, 0.37). 22 Note that, compared to employment and earnings, we slightly have less consistent measures on savings and assets across studies. 23 An increase in the amount of savings was also documented in Côte d’Ivoire and Ethiopia. 25 Figure 7: Estimates of the impact of public works programs on probability of savings Note: This figure presents the intent-to-treat effects on savings obtained from the different papers. The effect size is the change in the proportion of individual respondents reporting any savings in the past 12 months (in percentage points). Timing indicates the timing of the survey in months before/after program completion, where 0 indicates the time when the program was completed. Control mean is the mean of the study control group. The diamond shows the random effects meta-analysis estimate. The weight is from the random effects meta-analysis, with studies with smaller standard errors given larger weight. 26 Figure 8: Estimates of the impact of public works programs on a household asset index Note: This figure presents the intent-to-treat effects on a household asset index obtained from the different papers. The effect size is the change in the asset index (in standard deviation units). Timing indicates the timing of the survey in months before/after program completion, where 0 indicates the time when the program was completed. Control mean is the mean of the study control group. The diamond shows the random effects meta-analysis estimate. The weight is from the random effects meta-analysis, with studies with smaller standard errors given larger weight. 6. Impacts on women’s empowerment and psychological well-being 6.1 Women’s empowerment Participation in public works can increase women’s earned income, which is often limited in the study settings, and thus may improve women’s autonomy and empowerment more broadly. The Egypt Community program and the programs in Lao PDR and Djibouti were specifically designed to encourage women’s participation. They did so by either targeting only women (Djibouti and Lao PDR) or adjusting jobs to cater to women’s comparative advantages or the needs of their families (Egypt Community). For instance, in Djibouti, the program targeted households with pregnant women and mothers with children less than two years old. The sub-projects under the Egypt Community program and Lao PDR entailed tasks that were not considered to be physically strenuous. Seven of the 11 studies (or 9 of the 15 follow-up surveys) measure impacts on women’s empowerment (see Table 5) in the form of increased economic engagement or 27 decision-making in the household. 24 The measures vary across countries and tend to be relatively narrow, and only three of the 9 point estimates document a positive increase (Lao PDR during the program, Egypt Community at one-month post-program, and Tunisia at 12 months). In Lao PDR, impacts were found on measures such as intra-household decision- making and community participation. The increase in women’s empowerment in Tunisia is driven by a large relative increase in the probability that women respondents have an income-generating activity. The Egypt Community study finds an increase in women’s control over household resources 1-month post-program, but this effect does not persist and there is a reduction (which is not statistically significant) in women’s control over household economic resources in the medium-run. In Comoros and Rural DRC, there is no evidence that the program had any effect on women’s empowerment. The Côte d’Ivoire program targeted youths, and impacts were much larger for women compared to men, but dedicated measures of empowerment were not collected. Overall, evidence shows that public works programs can improve women’s empowerment, but they do not do so systematically. While the uneven evidence may in part be due to limitations in measurement, open questions remain on how to design public works programs to achieve consistent improvements in this dimension. 25 6.2 Psychological well-being Public works jobs can provide a sense of purpose and improve psychological well-being among participants, in particular for youth or otherwise underemployed populations. Eight of the 11 studies we review (or 12 of the 15 point estimates) analyze impacts on some form of psychological or subjective well-being measure. Given variations in these measures, we do not attempt to aggregate them. Still, four of the 12 point estimates, or three of the 11 studies (Tunisia, Egypt Infrastructure, and Côte d’Ivoire) find that the public works programs positively affected participants' psychological well-being. Individuals in the treatment group were significantly less likely to report distressing thoughts/memories, feel sad or depressed, or feel irritable as compared to those in the control group. Evidence from Côte d’Ivoire shows that effects on psychological well-being can persist beyond the short- run, though there are signs of decay between short-run impacts (0.20 standard deviations) and medium-run impacts (0.11 standard deviations). Overall, results show that public works can improve psychological well-being, but these effects are not observed systematically, at least based on the measures available to date across studies. 24 The Rural and Urban DRC studies also measure views on women’s access to power and on gender-based violence and, in Comoros, the study measures women’s experiences of physical, emotional, or economic violence in their household. None of these studies, however, finds significant impacts on women’s empowerment. In a spin-off study in Lao PDR, no effect was found on gender-based violence (including no evidence of a backlash effect (Perova et al., 2021). 25 There is active research on the topic. For instance, Christian et al. (forthcoming) investigate whether public works can improve women’s empowerment when designed specifically to increase women’s access to earned income and use a much broader measure of women’s empowerment than the studies included in this paper. 28 Table 5: Directional impacts of public works programs on women’s empowerment and psychological well-being Survey Women’s Psychological Timing Empowerment Well-being (1) (2) (3) Comoros -4m 0 0 Côte d’Ivoire -3m NA + Lao PDR -2m + NA Djibouti 0m NA 0 Sierra Leone 1m NA NA Egypt, Arab Rep., 1m + 0 Community Egypt, Arab Rep., 4m NA + Infrastructure Djibouti 9m 0 0 Tunisia 12m + + Rural DRC 12m 0 0 Ethiopia 12m NA NA Côte d’Ivoire 12m NA + Urban DRC 25m 0 0 Egypt, Arab Rep., 27m 0 0 Community Tunisia 66m 0 0 Notes: These results are shown to reflect the sign of estimates instead of coefficient estimates or effect sizes because of differences in measurement. Point estimates that are not statistically significant are coded as 0. Countries are ordered by survey timing with respect to program completion, i.e., we first present countries that measure impacts during the program, followed by countries that measure 1 to 66 months post-program impacts. The Egypt Community study refers to psychological well-being as subjective well-being. See Appendix Table A3 for country specific variable definitions on women’s empowerment and psychological wellbeing. 7. Conclusion: Lessons for policy and directions for future research Public works programs in low-and middle-income countries are designed to offer short- run employment and earnings opportunities to poor households and are often introduced to facilitate recovery from shocks (e.g., drought, conflict). These programs frequently also aim to sustainably raise living standards via, for example, improvements in assets, self- employment, savings, and community infrastructure. This paper reviews experimental evidence from 11 public works programs that together offer both internal and external validity across diverse settings. Some important conclusions and policy lessons emerge from the review. 29 First, public works programs generate short-run improvements in employment and earnings. In some cases, the magnitude of impacts on participants’ employment during the program can be large (such as in Comoros or Djibouti). Still, impacts on earnings tend to be small relative to the total program earnings, even during the program, raising questions about program cost-effectiveness. Second, increases in employment and earnings generally fade and do not persist much after individuals have exited the program. A few notable exceptions are found for programs that generate impacts on savings or productive investments linked to self-employment activities (such as in Rural DRC or Côte d’Ivoire). Third, and perhaps surprisingly, there is little evidence of public works programs increasing food consumption expenditures across the studies we review. Finally, there is some evidence of improvements in women’s empowerment and psychological well-being, though these are not found consistently, perhaps due to limitations in measurement. Overall, the stylized message from the review is that public works programs have been relatively more successful in delivering on their short-run objectives to raise individuals’ employment and earnings, rather than in achieving medium-run impacts on participants’ economic outcomes or broader effects on household-level outcomes. These results also raise questions on how to design programs to achieve more robust impacts on outcomes related to broader policy objectives, for instance women’s empowerment or psychosocial well-being. Despite the rapid increase in public works experiments in low-and middle-income countries, much remains to be learned. First, we need better data to accurately measure program participation (ideally from administrative information systems) and outcomes at multiple points in time. None of the existing studies measures program take-up and participation and outcomes related to employment, consumption, assets, psychological well-being, and women’s empowerment in the short-run (during the program) and after the program. Second, the duration of program participation and the level of wages vary widely across countries. It is unclear what the optimal program length or wage should be, but these parameters can affect impacts on short-run earnings, consumption, savings and investments, and those may in turn affect outcomes in the medium term. Third, it would be valuable to identify effective “public works plus” interventions that can facilitate transitions from temporary public works programs to more steady forms of employment, including in self-employment. Currently, there is very little evidence on the value-added of skills training or savings intervention in facilitating the transition from public works. In particular, given the recent success of multi-faceted economic inclusion programs (e.g., Banerjee et al., 2015, Bedoya et al., 2019; Bossuroy et al., 2022) in poor settings, it would be useful for future studies to experiment with different modalities and bundles of savings facilitation, capital transfers, or skills interventions (e.g., vocational, socioemotional, or 30 business training) as complements to the public works program. 26 Fourth, additional research using broader measures of women’s empowerment is also critical to better understand intra-household dynamics, such as the conditions under which improvements in women participants’ individual earnings improve household consumption and their decision-making power. Fifth, there is a need for more rigorous cost-effectiveness analysis. Only two studies in the literature offer detailed cost-effectiveness analysis (Bertrand et al., 2021 and Rosas et al., 2016). Future experiments in this area must pay close attention to collecting cost data to allow for a clear comparison between marginal benefits and marginal costs of the intervention. Lastly, while our review has not focused on general equilibrium effects, the value of public goods provided, or other social externalities from public works programs, are also first-order questions on which more evidence would be needed across settings. 26 In Côte d’Ivoire the basic public works program induced substantial savings, possibly facilitated by the payment of wages into bank accounts. Some participants were also offered a complementary basic entrepreneurship training to facilitate the transition to self-employment activities after their exit from the program, and other participants were offered a wage employment sensitization training to help them prepare and apply for wage jobs. Post-program impacts on being employed, total earnings, and the number of hours worked were not statistically different across the different treatment arms. Overall, the changes in skills and practices were small in magnitude and did not generate earnings beyond those induced by the basic public works program, suggesting limited value-added of the complementary interventions. In contrast, in Urban DRC, participants that received a combined package of public works programs, incentivized savings, and hard skills training experienced large impacts on savings and investment, indicative of medium-run improvements. Thus, the results suggest that a multifaceted approach may be most effective in supporting livelihoods in Urban DRC, where participation in the public works program alone did not significantly improve economic welfare outcomes in the medium run. 31 References Smith, A. J., & Todd, E. P. (2005). Does matching overcome LaLonde’s critique of nonexperimental estimators? Journal of Econometrics, 125(1-2), 305-353. Abebe, G., Franklin, S., Imbert, C., & Mejia-Mantilla, C. (2021). Urban Public Works in Spatial Equilibrium: Experimental Evidence from Ethiopia. CEPR Discussion Paper No. DP16691. Adjognon, G. S., van Soest, D., & Guthoff, J. (2020). Reducing Hunger with Payments for Environmental Services (PES): Experimental Evidence from Burkina Faso. American Journal of Agricultural Economics 103(3), 831-857. Afridi, F., Mukhopadhyay, A., and Sahoo, S. (2016). Female Labor Force Participation and Child Education in India: Evidence from the National Rural Employment Guarantee Scheme. IZA Journal of Labor and Development 5(1), 7. Alik-Lagrange, A., Attanasio, O., Meghir, C., Polanía-Reyes, S., & Vera-Hernández, M. (2017). Work Pays: Different Benefits of a Workfare Program in Colombia. Mimeo. Alik-Lagrange, A., Buehren, N., Goldstein, M., & Hoogeveen, J. (2023). Welfare impacts of public works in fragile and conflict affected economies: The Londö public works in the Central African Republic. Labour Economics, 801, 102293. Asher, S., & Novasad, P. (2020). Rural Roads and Local Economic Development. American Economic Review, 110(3), 797-823. Azam, M. (2012). The Impact of Indian Job Guarantee Scheme on Labor Market Outcomes: Evidence from a Natural Experiment. SSRN Working Paper. Baird, S., Ferreira, F.H.G., Özler, B., & Woolcock, M. (2014). Conditional, unconditional and everything in between: a systematic review of the effects of cash transfer programmes on schooling outcomes. Journal of Development Effectiveness, 6(1), 1-43. Banerjee, A., Duflo, E., Goldberg, N., Karlan, D., Osei, R., Pariente, Pariente, W., Shapiro, J., Thuysbaert, B., & Udry, C. (2015, May 14). A multifaceted program causes lasting progress for the very poor: Evidence from six countries. Science, 348(6236). Banerjee, A., Hanna, R., Olken, B., & Sverdlin-Lisker, D. (2022). Social Protection in the Developing World. Mimeo. Bedoya, G., Coville, A., Haushofer, J., Isaqzadeh, M., & Shapiro, J. (2019). No Household Left Behind: Afghanistan Targeting the Ultra Poor Impact Evaluation. NBER Working Paper No. 25981. Beegle, K., Galasso, E., & Goldberg, J. (2017). Direct and indirect effects of Malawi's public works program on food security. Journal of Development Economics, 128, 1-23. Bertrand, M., Crepon, B., Marguerie, A., & Premand, P. (2021). Do Workfare Programs Live Up to Their Promises? Experimental Evidence from Côte d’Ivoire. World Bank Policy Research Working Paper No. 9611. Bhalotra, S., G. C. Britto, D., Pinotti, P., & Sampia, B. (2021, July 1). Job Displacement, Unemployment Benefits and Domestic Violence. SSRN Working Paper. Bhalotra, S., Kambhamati, U., Rawlings, S., & Siddique, Z. (2021). Intimate Partner Violence: The Influence of Job Opportunities for Men and Women. The World Bank Economic Review, 35(2), 461-479. Bhorat, H., Kanbur, R., & Stanwix, B. (2017). Minimum Wages in Sub-Saharan Africa: A Primer. World Bank Research Observer, 32(1), 21-74. 32 Bossuroy, T., Goldstein, M., Karimou, B., Karlan, D., Kazianga, H., Premand, P., Thomas, C. C., Udry, C., Parienté, W., Vaillant, J., & Wright K. (2022). Tackling psychosocial and capital constraints to alleviate poverty. Nature 605(7909), 291-297. Brandily-Snyers, P., Windt, P., Verpoorten, M., Mvukiyehe, E., & Smets, L. (2021). From Workfare to Welfare and Well-Being? Evidence From a Randomized Control Trial with the Urban Poor in Eastern DRC. Mimeo. Buller, A. M., Peterman, A., Ranganathan, M., Bleile, A., Hidrobo, M., & Heise, L. (2018). A mixed-method review of cash transfers and intimate partner violence in low- and middle- income countries. The World Bank Research Observer 33(2), 218–58. Card, D., Kluve, J., & Weber, A. (2018). What Works? A Meta-Analysis of Recent Active Labor Market Program Evaluations, Journal of the European Economic Association, 16(3), 894–931. Christian, P., et al. (2022). Gender gaps in earnings and economic empowerment: Experimental evidence from 6 countries. AEA RCT Registry. Clark, A. E., & Oswald, A. J. (1994). Unhappiness and Unemployment. The Economic Journal 104(424), 648-659. Croke, K., Quattrochi, J., & Mvukiyehe, E. (2023). From Workfare to Welfare and Well- being? Evidence on Short- and Long-run Impacts from a Randomization Controlled Trial in Egypt. Mimeo. Deininger, K., & Liu, Y. (2013). Economic and Social Impacts of an Innovative Self-Help Group Model in India. World Development 43, 149–63. Devoto, F., Galasso, E., & Broadmann, S. (2017). Women at work: evidence from a randomized experiment in urban Djibouti. Mimeo. Farré, L., Francesco F., & Mueller, H. (2018). Feeling Useless: The Effect of Unemployment on Mental Health in the Great Recession. IZA Journal of Labor Economics 7(1), 8. Fetzer, T. (2020). Can Workfare Programs Moderate Conflict? Evidence from India. Journal of the European Economics Association, 18(6), 3337-3375. Filmer, D., & Fox, L. (2014). Youth Employment in Sub-Saharan Africa. Africa Development Forum. Washington, DC: World Bank and Agence Française de Développement. Fiszbein, A., Schady, N., Ferreira, F. H.G., Grosh, M., Keleher, N., Olinto, P., & Skoufias, E. (2009). Conditional Cash Transfers: Reducing Present and Future Poverty. World Bank Policy Research Report. Washington, DC: World Bank. Galasso, E., & Ravallion, M. (2004). Social Protection in a Crisis: Argentina's Plan Jefes Y Jefas. The World Bank Economic Review, 18, 367-399. Gazeaud, J., Mvukiyehe, E., & Sterck, O. (2019). Public Works and Welfare: A Randomized Control Trial of the Comoros Social Safety Net Project. Washington D.C.: The World Bank. Gazeaud, J., Mvukiyehe, E., & Sterck, O. (2021). Cash Transfers and Migration: Theory and Evidence from a Randomized Controlled Trial. The Review of Economics and Statistics, 1-45. Gehrke, E., & Hartwig, R. (2018). Productive effects of public works programs: What do we know? What should we know? World Development, 107, 111-124. https://doi.org/10.1016/j.worlddev.2018.0 33 Hidrobo, M., & Fernald, L. (2013). Cash transfers and domestic violence. Journal of Health Economics. 32(1), 304-319. Hussam, R., Rabbani, A., Reggiani, G., & Rigol, N. (2021). Rational Habit Formation: Experimental Evidence from Handwashing in India. American Economic Journal: Applied Economics, 14, 1-41. Imbert C., & Papp J. (2015). Labor Market Effects of Social Programs: Evidence from India's Employment Guarantee. American Economic Journal: Applied Economics, 7(2), 233-63. International Labor Organization. (2021). ILO Monitor: COVID-19 and the world of work. Seventh edition. Geneva: International Labor Organization. Jalan, J., & Ravallion, M. (1999). Income Gains to the Poor from Workfare: Estimates for Argentina's Trabajar Program. World Bank Policy Research Working Paper No. 2149. Kondylis, F., & Loeser, J. (2021). Intervention Size and Persistence. World Bank Policy Research Working Paper No. 9769 LaLonde, R. J. (1986). Evaluating the Econometric Evaluations of Training Programs with Experimental Data. American Economic Review, 76(4), 604–620. Leight, J., & Mvukiyehe, E. (2022). Short-term and long-term effects of cash for work: Evidence from a randomized controlled trial in Tunisia. Mimeo. Mani, S., Behrman, J., Galab, S., & Reddy, P. (2019). Impact of the NREGS on Children’s Intellectual Human Capital. The Journal of Development Studies, 56(5), 929-945. Mani, S., & Mvukiyehe, E. (2021). Finding and Lifting Up the Poor and Vulnerable: A Field Experiment on Targeting Mechanisms and Effects of a Public Works Program in Rural DRC. Mimeo. McKenzie, D. (2017). How Effective Are Active Labor Market Policies in Developing Countries? A Critical Review of Recent Evidence. The World Bank Research Observer, 32(2), 127-154. McKenzie, D. (2021). Small business training to improve management practices in developing countries: re-assessing the evidence for “training doesn’t work”. Oxford Review of Economic Policy, 37(2), 276-301. Millán, T., Barham, T., Macours, K., Maluccio, J., & Stampini, M. (2019). Long-Term Impacts of Conditional Cash Transfers: Review of the Evidence, The World Bank Research Observer, 34(1), 119–159. Muralidharan, K., Niehaus, P., & Sukhtankar, S. (2017). General Equilibrium Effects of (Improving) Public Employment Programs: Experimental Evidence from India. NBER Working Paper No. 23838. Perova, E., Johnson, E., Mannava, A., Reynolds, S., Teman, A. (2021). Public Work Programs and Gender-Based Violence: Evidence from Lao PDR. World Bank Policy Research Working Paper No. 9691. Ravallion, M. (2019). Guaranteed employment or guaranteed income? World Development, 115, 209-221. Ravi, S., & Monika E. (2015). Workfare as an Effective Way to Fight Poverty: The Case of India’s NREGS. World Development 67, 57–71. Rosas, N., & Sabharwal, S. (2016). Can You Work it? Evidence on the Productive Potential of Public Works from a Youth Employment Program in Sierra Leone. World Bank Policy Research Working Paper 7580. 34 Subbarao, K., Del Ninno, C., Andrews, C., & Rodríguez-Alas, C. (2013). Public Works as a Safety Net: Design, Evidence, and Implementation. Washington D.C.: The World Bank. Tesfay, G.B., Hoddinott, J., & Kumar, N. (2017, February 3). The Impact of Ethiopia's Productive Safety Net Programme on the Nutritional Status of Children: 2008–2012. United Nations. (2018). The 2030 Agenda and the Sustainable Development Goals: An opportunity for Latin America and the Caribbean. Santiago. World Bank, Development Research Group. (2017). Public Works and Welfare: A Randomized Control Trial of a Labor-Intensive Public Works Program focusing on Community Infrastructure in a Lower Middle-Income Country. Washington D.C. The World Bank. World Bank. (2018). The State of Social Safety Nets 2018. Washington, DC: World Bank World Bank. (2020). Poverty and Shared Prosperity 2020: Reversals of Fortune. Washington, DC: World Bank. World Bank, East Asia and Pacific Innovation Gender Lab. (2020). Impact Evaluation of Laos Road Maintenance Groups Program. Washington D.C.: The World Bank. World Food Programme. (2016). Food Assistance for Assets (FFA) for Zero Hunger and Resilient Livelihoods: A Programme Guidance Manual. Rome: World Food Programme. World Food Programme. (2021) Does combining cash-based transfers with food assistance for assets support women’s autonomy? Rome: World Food Programme. Zimmermann, L. (2014). Public Works Programs in Developing Countries Have the Potential to Reduce Poverty. IZA World of Labor. 35 Appendix Table A1: Studies Reviewed Studies Reviewed/Country Authors Reference Link Comoros Jules Gazeaud Report Eric Mvukiyehe Olivier Sterck Côte d’Ivoire Marianne Bertrand Working paper Bruno Crépon Alicia Marguerie Patrick Premand Djibouti Emanuela Galasso Draft Working Florencia Devoto Paper Stefanie Brodmann Rural Democratic Republic of Subha Mani Draft Report Congo Eric Mvukiyehe Urban Democratic Republic of Paul Brandily-Snyers Draft Working Congo Eric Mvukiyehe paper Lodewijk Smets Peter van der Windt Marijke Verpoooten Egypt, Arab Rep., Community Kevin Croke Draft Working Eric Mvukiyehe paper John Quattrochi Egypt, Arab Rep., Infrastructure World Bank’s Development Research Report Group (DECRG) Impact Evaluation Unit (DECIE) Ethiopia Girum Abebe Working paper Simon Franklin Carolina Mejia-Mantilla Clément Imbert Lao PDR World Bank (East Asia Report and Pacific Gender Innovation Lab) Sierra Leone Nina Rosas Working paper Shwetlana Sabarwal Tunisia Jessica Leight Working paper Eric Mvukieyehe 36 Table A2: Ratio of Daily Minimum Wage to Daily Program Wage (in USD PPP 2021) Project Year with Daily Daily Ratio of Period minimum Minimum Program program wage data Wage Wage wage to (USD PPP (USD PPP minimum 2021) 2021) wage (1) (2) (3) (4) (5) Comoros 2016-2018 2018 14.2 5.4 0.4 Côte d’Ivoire 2013-2014 2014 12.4 10.3 0.8 Djibouti 2014-2015 2015 NA 9.6 NA Urban Democratic 2016-2018 2017 2.2 4.8 2.1 Republic of Congo* Rural Democratic 2017-2020 2020 9.4 4.8 0.5 Republic of Congo Egypt, Arab Rep., 2015-2017 2017 12.6 14.7 1.2 Community Egypt, Arab Rep., 2015-2017 2017 12.6 14.7 1.2 Infrastructure Ethiopia 2017-2018 2011 NA 4.2 NA Lao PDR 2018-2020 2020 19.3 21.0 1.1 Sierra Leone 2012-2012 2012 0.4 2.5 6.3 Tunisia 2015-2015 2015 15.2 14.5 0.9 Notes: Official monthly minimum wages were retrieved from ILO database, “Statutory nominal gross monthly minimum wage | Annual” here. To calculate daily minimum wage, monthly minimum wage was divided by 20, i.e. average number of working days per month (except for Côte d’Ivoire which had 24 working days). The conversion from nominal wage to USD PPP 2021 used the World Bank conversion rate from the “PPP conversion factor, GDP (LCU per international $)” database here. The nominal daily program wage rate was provided in the public works papers. 37 Table A3: Secondary outcomes and definitions in each country Variable name Country Definition Women’s Comoros Index constructed from responses to empowerment questions on (1) women’s decision- and agency making, (2) employment, (3) earnings, attitudes, and (4) experiences of physical, emotional, or economic violence within their household. Djibouti Index constructed using two measures of women’s participation in household decisions: (1) whether women make decisions alone and (2) whether women make decisions jointly with other members. Egypt, Arab Rep., In the first follow-up, women are Community asked: Did you alone decide how to use the money you earn? In the second follow-up, the question changes to: In your household, did you alone decide how to use the money you earn? Tunisia Index constructed based on: (1) whether women report any earned income over the past six months, (2) whether women alone decide how income will be used, (3) whether men decide alone how income will be used, and (4) whether women report any income-generating activity. Lao PDR Measured as women’s participation in household decision making and their voice in the communities Urban and Rural Democratic Index constructed based on: (1) Republic of Congo whether, in the household, the woman (also) makes decisions about how to use money; (2) views on women’s access to power as measured by three statements (on the same rights and duties; the same chance to hold socio-administrative positions; and on their eligibility to sit as presidents of local management committees); (3) views on gender-based violence as measured by justification of wife- beating in eight specific situations. 38 Psychological Comoros Index constructed using responses well-being from items included in a (1) depression and anxiety index, (2) a Pearlin index, (3) as well as individual responses on questions related to the quality of family relationships, perception of household acceptance in the community, and perception of individual acceptance in family. Côte d’Ivoire Index constructed using (1) two measures of happiness and pride from a time-use module, (2) the Rosenberg self-esteem scale, (3) the positive affect sub-scale from the Center for Epidemiological Studies Depression (CESD) scale, and (4) the sub-scale of attitude toward the future and the inverted sub-scale of present fatalism from the Zimbardo Time Perspective Inventory (ZTPI) scale. Djibouti Measured using the five-item Mental Health Inventory (MHI-5). Egypt, Arab Rep., Index constructed using responses to Community the following questions: (1) Do you feel that you worry about many things? (2) Do you experience shortness of breath or shaking when you try to rest? (3) Do you have a fear of losing control of yourself or ‘going crazy’? (4) Do you avoid social situations because of feelings of fear? (5) Does the idea of leaving home frighten you? (6) Do you often feel that others are exploiting or deceiving you? (7) Do you prefer solitary activities to group activities? (8) Do you feel uncomfortable in situations where you are not in charge? (9) Are you unwilling to get involved with people unless you are certain of being liked? (10) Have you experienced any life-threatening events? (11) Do you have distressing memories or dreams? Egypt, Arab Rep., Index constructed using responses to Infrastructure a 28-question list on general life satisfaction, relationships, and negative feelings which was collapsed into five main indicators of psychological well-being: (1) anxiety disorder, (2) Personality Disorder Index, (3) PTSD and Depression Index, (4) Anger and Frustration Index, and (5) Trust in family and Relationship Index. 39 Tunisia Index constructed using responses from questions about (1) fear of losing control, (2) fear of being exploited, (3) feeling of uselessness for others, (4) positive relationships between household members, (5) would share with others decision to leave the village, (6) feels accepted within family, (7) feels accepted by other households, (8) feels in control, and (9) feels that goals can be accomplished. 27 Urban Democratic Republic Index based on: (1) positioning on a of Congo 10-step Cantril life satisfaction ladder for the present and for three years from now; (2) the respondent’s score on a 5-statement mental health inventory based on the MHI-5; (3) the extent to which the respondent feels understood by their neighbors and/or treated well; (4) the number of times the respondent had trouble getting along with their neighbors in the past six months; (5) the extent to which the respondents feels part of their neighborhood; and (6) the extent to which they feel an integral part of the household/family. Rural Democratic Republic of Index based on: (1) positioning on a Congo 10-step Cantril life satisfaction ladder for the present and for three years from now; (2) the respondent’s score on a 5-statement mental health inventory based on the MHI-5; (3) an index constructed using responses to a 42-question list on general life satisfaction and negative feelings which was collapsed into four main indicators of psychological well- being: (1) Anxiety Disorder, (2) Personality Disorder Index, (3) PTSD and Depression Index, and (4) Anger and Frustration Index. 27 There were minor differences in the variables reported across two survey rounds. In round 2, 4 variables were not reported: fear of being exploited, a feeling of useless for others, a feeling of acceptance within the household, and a feeling of acceptance by other households. 40