Publication: How to Improve Education Outcomes Most Efficiently? A Comparison of 150 Interventions Using the New Learning-Adjusted Years of Schooling Metric
Loading...
Date
2020-10
ISSN
Published
2020-10
Author(s)
Editor(s)
Abstract
Many low- and middle-income countries lag far behind high-income countries in educational access and student learning. Limited resources mean that policymakers must make tough choices about which investments to make to improve education. Although hundreds of education interventions have been rigorously evaluated, making comparisons between the results is challenging. Some studies report changes in years of schooling; others report changes in learning. Standard deviations, the metric typically used to report learning gains, measure gains relative to a local distribution of test scores. This metric makes it hard to judge if the gain is worth the cost in absolute terms. This paper proposes using learning-adjusted years of schooling (LAYS) -- which combines access and quality and compares gains to an absolute, cross-country standard -- as a new metric for reporting gains from education interventions. The paper applies LAYS to compare the effectiveness (and cost-effectiveness, where cost is available) of interventions from 150 impact evaluations across 46 countries. The results show that some of the most cost-effective programs deliver the equivalent of three additional years of high-quality schooling (that is, schooling at quality comparable to the highest-performing education systems) for just $100 per child -- compared with zero years for other classes of interventions.
Link to Data Set
Citation
“Angrist, Noam; Evans, David K.; Filmer, Deon; Glennerster, Rachel; Rogers, F. Halsey; Sabarwal, Shwetlena. 2020. How to Improve Education Outcomes Most Efficiently? A Comparison of 150 Interventions Using the New Learning-Adjusted Years of Schooling Metric. Policy Research Working Paper;No. 9450. © World Bank. http://hdl.handle.net/10986/34658 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Geopolitical Fragmentation and Friendshoring(Washington, DC: World Bank, 2025-06-26)This paper examines the relationship between geopolitical fragmentation and friendshoring of foreign investments over time, countries, and sectors. The analysis uses comprehensive data on foreign direct investments covering greenfield projects, mergers and acquisitions, and stocks of affiliates, as well as data on four alternative measures of geopolitical distance between countries. The gravity estimations suggest that, first, geopolitical differences have a negative effect on foreign investments and the magnitude has heightened in the post-pandemic period compared to a decade ago. Second, it is primarily the companies from advanced Western economies whose foreign investment decisions are increasingly shaped by friendshoring forces. Finally, the paper shows that friendshoring is not only confined to strategic industries, implying that allocations of foreign direct investments may not solely reflect national security or resilience considerations.Publication Soaring Food Prices Threaten Recent Economic Gains in the EU(Washington, DC: World Bank, 2025-07-02)The surge in food prices following the 2021 economic rebound has become a significant concern for households, particularly low-income ones, in Bulgaria, Croatia, Poland, and Romania. Food price inflation, which surpasses general inflation rates, risks worsening poverty and food insecurity in these countries. This paper explores the distributional impacts of rising food prices and the effectiveness of government response measures. Low-income households, who allocate a larger share of their income to food, are disproportionately affected and are struggling to cope with unexpected expenses, leading to increased difficulties in accessing proper nutrition. Simulations indicate that rising food prices contribute to higher poverty rates and greater income inequality, especially among vulnerable populations. They also suggest that the main poverty-targeted social assistance schemes offer critical support for the extreme poor, but expanding both coverage and benefits is vital to shield all at-risk individuals. Targeted policies that balance immediate relief with long-term resilience-building are essential to addressing the challenges posed by escalating food prices.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Learning-Adjusted Years of Schooling(World Bank, Washington, DC, 2018-09)The standard summary metric of education-based human capital used in macro analyses—the average number of years of schooling in a population—is based only on quantity. But ignoring schooling quality turns out to be a major omission. As recent research shows, students in different countries who have completed the same number of years of school often have vastly different learning outcomes. This paper therefore proposes a new summary measure, Learning-Adjusted Years of Schooling (LAYS), that combines quantity and quality of schooling into a single easy-to-understand metric of progress. The cross-country comparisons produced by this measure are robust to different ways of adjusting for learning (for example, by using different international assessments or different summary learning indicators), and the assumptions and implications of LAYS are consistent with other evidence, including other approaches to quality adjustment. The paper argues that (1) LAYS improves on the standard metric, because it is a better predictor of important outcomes, and it improves incentives for policymakers; and (2) its virtues of simplicity and transparency make it a good candidate summary measure of education.Publication Learning-adjusted years of schooling(Elsevier, 2020-08-01)The standard summary metric of education-based human capital used in macro analyses is a quantity-based one: The average number of years of schooling in a population. But as recent research shows, students in different countries who have completed the same number of years of school often have vastly different learning outcomes. We therefore propose a new summary measure, the Learning-Adjusted Years of Schooling (LAYS). This measure combines quantity and quality of schooling into a single easy-to-understand metric of progress, revealing considerably larger cross-country education gaps than the standard metric. We show that the comparisons produced by this measure are robust to different ways of adjusting for learning and that LAYS is consistent with other evidence, including other approaches to quality adjustment. Like other learning measures, LAYS reflects learning, and barriers to learning, both inside and outside of school; also, cross-country comparability of LAYS rests on assumptions related to learning trajectories and the validity, reliability, and comparability of test data. Acknowledging these limitations, we argue that LAYS nonetheless improves on the standard metric in key ways.Publication Learning in the Time of COVID-19(World Bank, Washington, DC, 2021-03-29)This note discusses the impact of Coronavirus (COVID-19) and related school closures on primary students’ access to learning in Nepal. The primary source of data is a phone-survey with households that have children enrolled in public schools (grades 3-5) collected from November 2020 to February 2021. The authors describe student learning, parental perception of student levels, access to learning during school closures, and families’ emotional health during Coronavirus (COVID-19).Publication Remote Learning(World Bank, Washington, DC, 2021-07)This note discusses early results from a distance education program on foundational numeracy for primary school students in Nepal during Coronavirus (COVID-19) evaluated in a randomized trial. The trial included 3,700 households with children in public school (grades 3-5). It provided support for foundational numeracy through mobile phone-based tutoring. The trial tested delivery through public school teachers and also through NGO facilitators. It led to a 30 percent increase in foundational numeracy, with teachers being slightly more effective at producing learning gains than NGO facilitators. These results suggest that instructional support through mobile phones can be a high-access and low-cost approach to providing instruction at scalePublication The Permanent Input Hypothesis : The Case of Textbooks and (No) Student Learning in Sierra Leone(World Bank Group, Washington, DC, 2014-09)A textbook provision program in Sierra Leone demonstrates how volatility in the flow of government-provided learning inputs to schools can induce storage of these inputs by school administrators to smooth future consumption. This process in turn leads to low current utilization of inputs for student learning. A randomized trial of a public program providing textbooks to primary schools had modest positive impacts on teacher behavior but no impacts on student performance. In many treatment schools, student access to textbooks did not actually increase because a large majority of the books were stored rather than distributed to students. At the same time, the propensity to save books was positively correlated with uncertainty on the part of head teachers regarding government transfers of books. The evidence suggests that schools that have high uncertainty with respect to future transfers are more likely to store a high proportion of current transfers. These results show that reducing uncertainty in school input flows could result in higher current input use for student learning. For effective program design, public policy programs must take forward-looking behavior among intermediate actors into account.
Users also downloaded
Showing related downloaded files
Publication Breaking the Conflict Trap : Civil War and Development Policy(Washington, DC: World Bank and Oxford University Press, 2003)Most wars are now civil wars. Even though international wars attract enormous global attention, they have become infrequent and brief. Civil wars usually attract less attention, but they have become increasingly common and typically go on for years. This report argues that civil war is now an important issue for development. War retards development, but conversely, development retards war. This double causation gives rise to virtuous and vicious circles. Where development succeeds, countries become progressively safer from violent conflict, making subsequent development easier. Where development fails, countries are at high risk of becoming caught in a conflict trap in which war wrecks the economy and increases the risk of further war. The global incidence of civil war is high because the international community has done little to avert it. Inertia is rooted in two beliefs: that we can safely 'let them fight it out among themselves' and that 'nothing can be done' because civil war is driven by ancestral ethnic and religious hatreds. The purpose of this report is to challenge these beliefs.Publication Government Matters III : Governance Indicators for 1996-2002(World Bank, Washington, DC, 2003-08)The authors present estimates of six dimensions of governance covering 199 countries and territories for four time periods: 1996, 1998, 2000, and 2002. These indicators are based on several hundred individual variables measuring perceptions of governance, drawn from 25 separate data sources constructed by 18 different organizations. The authors assign these individual measures of governance to categories capturing key dimensions of governance and use an unobserved components model to construct six aggregate governance indicators in each of the four periods. They present the point estimates of the dimensions of governance as well as the margins of errors for each country for the four periods. The governance indicators reported here are an update and expansion of previous research work on indicators initiated in 1998 (Kaufmann, Kraay, and Zoido-Lobat 1999a,b and 2002). The authors also address various methodological issues, including the interpretation and use of the data given the estimated margins of errors.Publication Governance Matters VIII : Aggregate and Individual Governance Indicators 1996–2008(2009-06-01)This paper reports on the 2009 update of the Worldwide Governance Indicators (WGI) research project, covering 212 countries and territories and measuring six dimensions of governance between 1996 and 2008: Voice and Accountability, Political Stability and Absence of Violence/Terrorism, Government Effectiveness, Regulatory Quality, Rule of Law, and Control of Corruption. These aggregate indicators are based on hundreds of specific and disaggregated individual variables measuring various dimensions of governance, taken from 35 data sources provided by 33 different organizations. The data reflect the views on governance of public sector, private sector and NGO experts, as well as thousands of citizen and firm survey respondents worldwide. The authors also explicitly report the margins of error accompanying each country estimate. These reflect the inherent difficulties in measuring governance using any kind of data. They find that even after taking margins of error into account, the WGI permit meaningful cross-country comparisons as well as monitoring progress over time. The aggregate indicators, together with the disaggregated underlying indicators, are available at www.govindicators.org.Publication Governance Matters IV : Governance Indicators for 1996-2004(World Bank, Washington, DC, 2005-06)The authors present the latest update of their aggregate governance indicators, together with new analysis of several issues related to the use of these measures. The governance indicators measure the following six dimensions of governance: (1) voice and accountability; (2) political instability and violence; (3) government effectiveness; (4) regulatory quality; (5) rule of law, and (6) control of corruption. They cover 209 countries and territories for 1996, 1998, 2000, 2002, and 2004. They are based on several hundred individual variables measuring perceptions of governance, drawn from 37 separate data sources constructed by 31 organizations. The authors present estimates of the six dimensions of governance for each period, as well as margins of error capturing the range of likely values for each country. These margins of error are not unique to perceptions-based measures of governance, but are an important feature of all efforts to measure governance, including objective indicators. In fact, the authors give examples of how individual objective measures provide an incomplete picture of even the quite particular dimensions of governance that they are intended to measure. The authors also analyze in detail changes over time in their estimates of governance; provide a framework for assessing the statistical significance of changes in governance; and suggest a simple rule of thumb for identifying statistically significant changes in country governance over time. The ability to identify significant changes in governance over time is much higher for aggregate indicators than for any individual indicator. While the authors find that the quality of governance in a number of countries has changed significantly (in both directions), they also provide evidence suggesting that there are no trends, for better or worse, in global averages of governance. Finally, they interpret the strong observed correlation between income and governance, and argue against recent efforts to apply a discount to governance performance in low-income countries.Publication Design Thinking for Social Innovation(2010-07)Designers have traditionally focused on enchancing the look and functionality of products.