Publication:
How to Improve Education Outcomes Most Efficiently? A Comparison of 150 Interventions Using the New Learning-Adjusted Years of Schooling Metric

Loading...
Thumbnail Image
Files in English
English PDF (3.46 MB)
5,408 downloads
English Text (98.73 KB)
139 downloads
Date
2020-10
ISSN
Published
2020-10
Author(s)
Angrist, Noam
Glennerster, Rachel
Rogers, F. Halsey
Editor(s)
Abstract
Many low- and middle-income countries lag far behind high-income countries in educational access and student learning. Limited resources mean that policymakers must make tough choices about which investments to make to improve education. Although hundreds of education interventions have been rigorously evaluated, making comparisons between the results is challenging. Some studies report changes in years of schooling; others report changes in learning. Standard deviations, the metric typically used to report learning gains, measure gains relative to a local distribution of test scores. This metric makes it hard to judge if the gain is worth the cost in absolute terms. This paper proposes using learning-adjusted years of schooling (LAYS) -- which combines access and quality and compares gains to an absolute, cross-country standard -- as a new metric for reporting gains from education interventions. The paper applies LAYS to compare the effectiveness (and cost-effectiveness, where cost is available) of interventions from 150 impact evaluations across 46 countries. The results show that some of the most cost-effective programs deliver the equivalent of three additional years of high-quality schooling (that is, schooling at quality comparable to the highest-performing education systems) for just $100 per child -- compared with zero years for other classes of interventions.
Link to Data Set
Citation
Angrist, Noam; Evans, David K.; Filmer, Deon; Glennerster, Rachel; Rogers, F. Halsey; Sabarwal, Shwetlena. 2020. How to Improve Education Outcomes Most Efficiently? A Comparison of 150 Interventions Using the New Learning-Adjusted Years of Schooling Metric. Policy Research Working Paper;No. 9450. © World Bank. http://hdl.handle.net/10986/34658 License: CC BY 3.0 IGO.
Associated URLs
Associated content
Report Series
Report Series
Other publications in this report series
  • Publication
    Geopolitics and the World Trading System
    (Washington, DC: World Bank, 2024-12-23) Mattoo, Aaditya; Ruta, Michele; Staiger, Robert W.
    Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.
  • Publication
    The Macroeconomic Implications of Climate Change Impacts and Adaptation Options
    (Washington, DC: World Bank, 2025-05-29) Abalo, Kodzovi; Boehlert, Brent; Bui, Thanh; Burns, Andrew; Castillo, Diego; Chewpreecha, Unnada; Haider, Alexander; Hallegatte, Stephane; Jooste, Charl; McIsaac, Florent; Ruberl, Heather; Smet, Kim; Strzepek, Ken
    Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.
  • Publication
    Global Poverty Revisited Using 2021 PPPs and New Data on Consumption
    (Washington, DC: World Bank, 2025-06-05) Foster, Elizabeth; Jolliffe, Dean Mitchell; Ibarra, Gabriel Lara; Lakner, Christoph; Tettah-Baah, Samuel
    Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
  • Publication
    From Patriarchy to Policy
    (Washington, DC: World Bank, 2025-05-29) Bussolo, Maurizio; Rexer, Jonah M.; Hu, Lynn
    Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
  • Publication
    Global Socio-economic Resilience to Natural Disasters
    (Washington, DC: World Bank, 2025-05-22) Middelanis, Robin; Jafino, Bramka Arga; Hill, Ruth; Nguyen, Minh Cong; Hallegatte, Stephane
    Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.
Journal
Journal Volume
Journal Issue

Related items

Showing items related by metadata.

  • Publication
    Learning-Adjusted Years of Schooling
    (World Bank, Washington, DC, 2018-09) Rogers, Halsey; Filmer, Deon; Angrist, Noam; Sabarwal, Shwetlena
    The standard summary metric of education-based human capital used in macro analyses—the average number of years of schooling in a population—is based only on quantity. But ignoring schooling quality turns out to be a major omission. As recent research shows, students in different countries who have completed the same number of years of school often have vastly different learning outcomes. This paper therefore proposes a new summary measure, Learning-Adjusted Years of Schooling (LAYS), that combines quantity and quality of schooling into a single easy-to-understand metric of progress. The cross-country comparisons produced by this measure are robust to different ways of adjusting for learning (for example, by using different international assessments or different summary learning indicators), and the assumptions and implications of LAYS are consistent with other evidence, including other approaches to quality adjustment. The paper argues that (1) LAYS improves on the standard metric, because it is a better predictor of important outcomes, and it improves incentives for policymakers; and (2) its virtues of simplicity and transparency make it a good candidate summary measure of education.
  • Publication
    Learning-adjusted years of schooling
    (Elsevier, 2020-08-01) Rogers, Halsey; Filmer, Deon; Angrist, Noam; Sabarwal, Shwetlena
    The standard summary metric of education-based human capital used in macro analyses is a quantity-based one: The average number of years of schooling in a population. But as recent research shows, students in different countries who have completed the same number of years of school often have vastly different learning outcomes. We therefore propose a new summary measure, the Learning-Adjusted Years of Schooling (LAYS). This measure combines quantity and quality of schooling into a single easy-to-understand metric of progress, revealing considerably larger cross-country education gaps than the standard metric. We show that the comparisons produced by this measure are robust to different ways of adjusting for learning and that LAYS is consistent with other evidence, including other approaches to quality adjustment. Like other learning measures, LAYS reflects learning, and barriers to learning, both inside and outside of school; also, cross-country comparability of LAYS rests on assumptions related to learning trajectories and the validity, reliability, and comparability of test data. Acknowledging these limitations, we argue that LAYS nonetheless improves on the standard metric in key ways.
  • Publication
    Learning in the Time of COVID-19
    (World Bank, Washington, DC, 2021-03-29) Radhakrishnan, Karthika; Angrist, Noam; Bergman, Peter; Cullen, Claire; Matsheng, Moitshepi; Ramakrishnan, Anusha; Sabarwal, Shwetlena; Sharma, Uttam
    This note discusses the impact of Coronavirus (COVID-19) and related school closures on primary students’ access to learning in Nepal. The primary source of data is a phone-survey with households that have children enrolled in public schools (grades 3-5) collected from November 2020 to February 2021. The authors describe student learning, parental perception of student levels, access to learning during school closures, and families’ emotional health during Coronavirus (COVID-19).
  • Publication
    Remote Learning
    (World Bank, Washington, DC, 2021-07) Radhakrishnan, Karthika; Sabarwal, Shwetlena; Sharma, Uttam; Cullen, Claire; Crossley, Colin; Letsomo, Thato; Angrist, Noam
    This note discusses early results from a distance education program on foundational numeracy for primary school students in Nepal during Coronavirus (COVID-19) evaluated in a randomized trial. The trial included 3,700 households with children in public school (grades 3-5). It provided support for foundational numeracy through mobile phone-based tutoring. The trial tested delivery through public school teachers and also through NGO facilitators. It led to a 30 percent increase in foundational numeracy, with teachers being slightly more effective at producing learning gains than NGO facilitators. These results suggest that instructional support through mobile phones can be a high-access and low-cost approach to providing instruction at scale
  • Publication
    The Permanent Input Hypothesis : The Case of Textbooks and (No) Student Learning in Sierra Leone
    (World Bank Group, Washington, DC, 2014-09) Sabarwal, Shwetlena; Evans, David K.; Marshak, Anastasia
    A textbook provision program in Sierra Leone demonstrates how volatility in the flow of government-provided learning inputs to schools can induce storage of these inputs by school administrators to smooth future consumption. This process in turn leads to low current utilization of inputs for student learning. A randomized trial of a public program providing textbooks to primary schools had modest positive impacts on teacher behavior but no impacts on student performance. In many treatment schools, student access to textbooks did not actually increase because a large majority of the books were stored rather than distributed to students. At the same time, the propensity to save books was positively correlated with uncertainty on the part of head teachers regarding government transfers of books. The evidence suggests that schools that have high uncertainty with respect to future transfers are more likely to store a high proportion of current transfers. These results show that reducing uncertainty in school input flows could result in higher current input use for student learning. For effective program design, public policy programs must take forward-looking behavior among intermediate actors into account.

Users also downloaded

Showing related downloaded files

  • Publication
    Vertical and Regional Integration to Promote African Textiles and Clothing Exports : A Close Knit Family?
    (Washington, DC, 2007-07) World Bank
    Apparel production is especially labor intensive, with low start-up investments and easily transferable technology. Furthermore, the labor requirements can be easily met with low and semi-skilled workers, especially women. As a result, many countries with competitive labor costs, especially in South and East Asia, have captured significant shares in the world market during the last four decades. Despite the potential development benefits and their various sources of comparative advantage, few African countries have managed to establish a presence in the global textiles and apparel markets until recently. As a result, Africa as a whole remains a net importer of textiles and clothing even though it is a net exporter of cotton. The future of apparel exporters in sub-Saharan Africa is, however, rather uncertain as they face two major challenges for their products: i) increased competition from large, low-wage producers such as India, China, Bangladesh and Pakistan following the phase-out of quotas after the expiry of the ATC; and, ii) the expiration of the third-country fabric derogation under AGOA scheduled for 2013. This study explores the potential for regional and vertical integration to overcome these challenges and identifies obstacles to this. Timing is important since both the EU and the US have recently imposed trade restrictions on China (until 2008) to protect their domestic textiles and clothing industries. These safeguards provide a brief opportunity for sub-Saharan African producers to integrate their textiles and clothing industries both domestically and regionally.
  • Publication
    Examining Early Child Development in Low-Income Countries
    (World Bank, Washington, DC, 2009-04-03) Fernald, Lia C. H.; Kariger, Patricia; Engle, Patrice; Raikes, Abbie
    The primary purpose of this toolkit is to provide a resource for researchers from various disciplines interested in planning and evaluating programs or interventions aimed at improving the health and development of infants and young children. The toolkit aims to: provide an overview of issues affecting early development and its measurement; discuss the types of tests typically used with children under five years; provide guidelines for selecting and adapting tests for use in developing countries, and make recommendations for planning successful assessment strategies. The toolkit focuses on children who have not yet entered school, and are thus under six years old. The primary reason we are focusing on this age group is that during the first five years of life, children's language, early understanding of mathematics and reading, and self-control emerge. The extent to which children master these skills during this critical period has implications for success in school (Lerner, 1998), and thus we wanted to focus on children in this pre-school period. The toolkit is essential at this time for the following reasons: children in developing countries are growing up at a disadvantage; assessments of children must expand to include a wider range of outcomes; and no such toolkit exists as present.
  • Publication
    Analysis of Displacement in Somalia
    (Washington, DC, 2014-12-09) World Bank Group
    Development and humanitarian actors currently engaged in Somalia face the challenge of delivering assistance in such a way that it is supportive of peace and state building, addresses the acute vulnerability, and dependence of large shares of the population while operating in a still insecure and changing environment. Forced displacement is a key feature of the current political economy context of Somalia. The necessity of addressing displacement is partly due to the scale and duration of the phenomenon. Displacement dynamics have fundamentally reshaped Somali culture in multiple ways. The purpose of this study is to inform the Bank and other development and humanitarian actors on the scale, characteristics, and political economy dimensions of displacement in Somalia. The study was undertaken between February and June 2013 by a team from the Tana Copenhagen. The conceptual framework for the study was based on one for political economy assessments. In this context the report presents, introduction; history, causes, and characteristics of displacement in Somalia; current internally displaced person (IDP) situation; prospects for return; vulnerabilities and development needs of the displaced; political economy challenges; and development for IDPs - recommendations.
  • Publication
    Returns to Investment in Education
    (Taylor and Francis, 2018-06-07) Psacharopoulos, George; Patrinos, Harry Anthony
    In the 60-plus year history of returns to investment in education estimates, there have been several compilations in the literature. This paper updates Psacharopoulos and Patrinos and reviews the latest trends and patterns based on 1120 estimates in 139 countries from 1950 to 2014. The private average global return to a year of schooling is 9% a year. Private returns to higher education increased, raising issues of financing and equity. Social returns to schooling remain high. Women continue to experience higher average returns to schooling, showing that girls’ education remains a priority.
  • Publication
    Doing Business 2020
    (Washington, DC: World Bank, 2020) World Bank
    Doing Business 2020 is the 17th in a series of annual studies investigating the regulations that enhance business activity and those that constrain it. It provides quantitative indicators covering 12 areas of the business environment in 190 economies. The goal of the Doing Business series is to provide objective data for use by governments in designing sound business regulatory policies and to encourage research on the important dimensions of the regulatory environment for firms.