Publication: Effects of COVID-19 on Student Learning: Assessing Learning Losses Using Adaptive Technology
Loading...
Date
2025-06-13
ISSN
Published
2025-06-13
Editor(s)
Abstract
This paper quantifies learning losses between 2020 and 2022 in the Dominican Republic, an upper-middle-income country. The paper uses data from a sample of ninth-grade students who benefited from computer adaptive learning software during this period. This study is among a few to measure actual losses among secondary school students, and it is the first to use detailed data on students’ mastery of individual math topics to do so. The findings show no evidence of learning losses in our analysis sample. However, the paper documents concerningly low learning levels, with the average student mastering only 45 percent of pre-requisite topics for their grade. These results should be interpreted with caution, as they are based on a select sample of urban schools and may not fully reflect broader educational trends across the country.
Link to Data Set
Citation
“Baron, Juan; Mola, José; Pineda, Astrid Camille; Polanco Santos, Paola Patricia. 2025. Effects of COVID-19 on Student Learning: Assessing Learning Losses Using Adaptive Technology. Policy Research Working Paper; 11144. © World Bank. http://hdl.handle.net/10986/43334 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication From Tailwinds to Headwinds(Washington, DC: World Bank, 2025-07-10)The first quarter of the twenty-first century has been transformative for emerging market and developing economies (EMDEs). These economies now account for about 45 percent of global GDP, up from about 25 percent in 2000, a trend driven by robust collective growth in the three largest EMDEs—China, India, and Brazil (the EM3). Collectively, EMDEs have contributed about 60 percent of annual global growth since 2000, on average, double the share during the 1990s. Their ascendance was powered by swift global trade and financial integration, especially during the first decade of the century. Interdependence among these economies has also increased markedly. Today, nearly half of goods exports from EMDEs go to other EMDEs, compared to one-quarter in 2000. As cross-border linkages have strengthened, business cycles among EMDEs and between EMDEs and advanced economies have become more synchronized, and a distinct EMDE business cycle has emerged. Cross-border business cycle spillovers from the EM3 to other EMDEs are sizable, at about half of the magnitude of spillovers from the largest advanced economies (the United States, the euro area, and Japan). Yet EMDEs confront a host of headwinds at the turn of the second quarter of the century. Progress implementing structural reforms in many of these economies has stalled. Globally, protectionist measures and geopolitical fragmentation have risen sharply. High debt burdens, demographic shifts, and the rising costs of climate change weigh on economic prospects. A successful policy approach to accelerate growth and development should focus on boosting investment and productivity, navigating a difficult external environment, and enhancing macroeconomic stability.Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Why Do Students Learn so Little?(World Bank, Washington, DC, 2015-05)The Haitian education system made substantial improvements in access over the last decade, such that today the majority of Haiti’s children are in school. Despite improvements, the primary education system is highly inefficient: children start primary school 2 years late on average, and fewer than 60 percent will reach the last grade of the cycle. At each school, classroom observations were conducted using the Stallings Classroom Snapshot instrument, and questions about the school calendar and daily schedule asked. The results provide a representative picture of class time and teacher classroom practice in the Nord and Nord Est departments, and while not representative of Haiti as a whole, do provide a starting point for better understanding the major constraint to achieving a high-quality education for all children: the quality of teacher instruction. Section two describes the sample of schools and the stallings instrument; sections three and four present the main results of the classroom observations on teacher time use and pedagogical practices; section five provides estimates of overall class time that students receive; and section six concludes.Publication Promotion with and without Learning : Effects on Student Enrollment and Dropout Behavior(World Bank, Washington, DC, 2008-09)Many educators and policymakers have argued for lenient grade promotion policy - even automatic promotion - in developing country settings where grade retention rates are high. The argument assumes that grade retention discourages persistence or continuation in school and that the promotion of children with lower achievement does not hamper their ability or their peers' ability to perform at the next level. Alternatively, promoting students into grades for which they are not prepared may lead to early dropout behavior. This study shows that in a sample of schools from the Northwest Frontier Province of Pakistan, students are promoted primarily on the basis of merit. An econometric decomposition of promotion decisions into a component that is based on merit indicators (attendance and achievement in mathematics and language) and another that is uncorrelated with those indicators allows a test of whether parental decisions to keep their child in school is influenced by merit-based or non-merit-based promotions. Results suggest that the enrollment decision is significantly influenced by whether learning has taken place, and that grade promotion that is uncorrelated with merit has a negligible impact on school continuation.Publication A Simulation of COVID-19 School Closure Impact on Student Learning in Bangladesh(World Bank, Washington, DC, 2021-01)This Note presents results from a series of simulations that aim to capture the impacts that school closures in Bangladesh might have on the learning levels, enrollment and future earnings of children and students using a methodological tool developed by the Education Global Practice of the World Bank . We find that overall loss in learning for every child enrolled in school even in the most optimistic scenario is expected to be substantial and the economic implications of the learning losses are huge. Available data also indicates that remote learning requires to be made more effective. It is hoped that the insights from this note will be useful for the government, non-government, private sector and civil society engaged in education service delivery as they are attempting to forge effective partnerships during and after the crisis. There is an urgent need to substantially reduce additional dropouts and absenteeism through stipends and safe school opening and communication campaigns.Publication Lessons on Implementation(Washington, DC: World Bank, 2024-08-26)This study explored the perceptions and experiences of students, parents, teachers, and other education stakeholders involved in Prográmate, a project that uses a digital personalized learning (DPL) platform to develop secondary school students’ math skills and knowledge in the Dominican Republic.Publication Infrastructure, Learning Complements, and Student Learning(World Bank, Washington, DC, 2020-11-23)The purpose of this mixed methods study was twofold: (i) to examine how school infrastructure and learning complements can be better utilized to promote student learning in Indonesian schools; and (ii) to help the relevant ministries make more informed decisions about investment in school infrastructure and learning complements. Three analyses were conducted in the quantitative component: descriptive and comparative analyses of madrasah infrastructure, and a multivariate analysis of madrasah infrastructure and student achievement. The qualitative component employed the intentional sampling and positive‐deviance approach consisting of semi‐structured phone interviews with principals, teachers, librarians, and parents from 20 madrasah and non‐madrasah schools (11 high‐performing secondary schools with science laboratories and nine primary schools with libraries of which eight were supported by the innovation for Indonesia’s school children program, which aims to improve students’ literacy and numeracy skills). The results of the descriptive and comparative analyses indicated that the madrasah sector as a whole is not adequately equipped with basic physical and learning resource infrastructure and that private madrasahs have significantly lower levels of infrastructure than their public counterparts. However, the multivariate analysis results did not conclusively show that infrastructure directly contributes to student learning outcomes. The qualitative analysis found some promising learning practices related to teachers’ professional development, literacy initiatives, and customized teaching and learning. Nevertheless, challenges remain for many schools in the disconnect between pedagogical and infrastructural quality assurance mechanisms, the failure to fully exploit libraries as resources for student learning, and learning spaces and assets that are not sufficiently conducive to science education. Based on the study results and findings, this report offers four key steps to address the main challenges related to school infrastructure and learning complements: (i) prioritize resource allocation to basic physical and digital infrastructure for the most underserved groups of students; (ii) leverage educators to maximize their potential as catalysts in facilitating improved teaching and learning processes through an innovative and effective utilization of learning spaces and complements; (iii) streamline and strengthen quality assurance mechanisms to document, monitor, and assess the quality, condition, and use of infrastructure and related assets, and to improve the links between school infrastructure management and learning quality management; and (iv) increase the overall resilience of the education system to future crises by strengthening its capacity to coordinate, monitor, and manage the continued delivery of equitable education services through distance and hybrid learning.
Users also downloaded
Showing related downloaded files
Publication Unlocking the Power of Healthy Longevity(Washington, DC: World Bank, 2024-09-12)Noncommunicable diseases (NCDs) are among the major health and development challenges of our time. Every year, about 41 million people die due to NCDs. This makes up about 74 percent of all deaths globally, the majority of which are in low- and middle-income countries (LMICs). Countless more people live with NCDs every day. Yet, NCDs are largely treatable and preventable. The risk of developing NCDs and deaths from them can both be lowered with appropriate attention to prevention and treatment. However, weak health systems and limited access to affordable care and information, especially in LMICs, contribute to lapses in seeking and receiving appropriate and timely care. This compendium is a compilation of 18 chapters, each exploring a different but related topic in the nexus of NCDs, human capital, and productivity. It is based on a series of analytical work taken up by the World Bank to support the Healthy Longevity Initiative (HLI) - a collaborative effort between the World Bank, the University of Toronto, and key academic and development partners including the Harvard University and the University of Washington. The HLI presents one of a growing set of efforts to increase the urgency of policy response to NCDs across the world.Publication Air Quality Management in Central Asia(Washington, DC: World Bank, 2025-05-02)This report aims to enhance the understanding of the priorities, needs, and solutions for improving air quality (AQ) in Central Asia (CA) through local action and regional collaboration. It focuses on key components of holistic air quality management (AQM): evidence-based analytics to identify the main sources of air pollution in CA, application of modern tools to assess the impact of cost-effective measures to improve AQ, assessment of the institutional and governance setup for AQM in CA with recommendations to strengthen it, and approaches to financing AQ improvement. Given the lack of comprehensive systematic and validated emission inventories of all PM2.5 precursor emissions, the technical assessment employs the regional emission inventory of the Greenhouse Gas - Air Pollution Interactions and Synergies (GAINS) model. Input data were updated for this study based on recent energy statistics and relevant national surveys. This report addresses emissions and the regional transboundary flows of pollution between Kazakhstan, the Kyrgyz Republic, Tajikistan, Turkmenistan, and Uzbekistan. Subsequently, the resulting PM2.5 concentrations in ambient air throughout CA were computed with the atmospheric chemistry and transport calculations of the GAINS model. Employing the source apportionment results of the GAINS model, the analysis then examines the contributions to PM2.5 population exposure. The report also presents source apportionment analyses for important air pollution hot spots in CA: Dushanbe (Tajikistan), Bishkek (the Kyrgyz Republic), Tashkent (Uzbekistan), Samarkand (Uzbekistan), Astana, and Almaty (Kazakhstan).Publication State of Social Protection Report 2025(Washington, DC: World Bank, 2025-04-07)Social protection goes well beyond cash transfers; it includes policies and programs that bridge skill, financial, and information gaps, aiding people in securing better jobs. The three pillars of social protection—social assistance, social insurance, and labor market programs—support households and workers in handling crises, escaping poverty, facing transitions, and seizing employment opportunities. But despite a substantial expansion over the past decade, 2 billion people remain uncovered or inadequately covered across low- and middle-income countries. Drawing from administrative and household survey data from the World Bank’s Atlas of Social Protection Indicators of Resilience and Equity (ASPIRE), the "State of Social Protection Report 2025: The 2-Billion-Person Challenge" documents advances and challenges to strengthening social protection and labor systems across low- and middle-income countries, analyzing the evolution of expenditure, coverage, and adequacy of support. This report details four policy action areas governments can embrace to maximize the benefits of adequate social protection for all: extending social protection to those in need; strengthening the adequacy of social protection support; building shock-proof social protection systems; and optimizing social protection financing. The report discusses how the path of reforms will depend on country context, capacity, and fiscal space. The rising frequency of shocks and crises calls for major investments in the adaptability and preparedness of social protection and labor systems. Amid a world in transition, social protection is more important and necessary than ever.Publication Enhancing Bahia’s Agriculture Support(Washington, DC: World Bank, 2025-04-14)Efforts to conduct comprehensive assessments of agricultural policies globally involve various methodologies and contributions from international bodies such as the Food and Agriculture Organization of the United Nations (FAO), the World Trade Organization (WTO), the International Food and Policy Research Institute (IFPRI), and the Organization for Economic Cooperation and Development (OECD). The OECD methodology, in particular, estimates the value of monetary transfers made by taxpayers and consumers to agricultural producers. One objective of this analysis is to quantify the impact of the agricultural policies of the state government of Bahia on producers, consumers, and the sector as a whole, based on the transfers these policies generate. Consequently, the results reflect only the transfers derived from the implementation of Bahia's agricultural policies, excluding national policies, although both could be complementary and measure their total impact on the income of the state's producers. The analysis estimates the amount and significance of these transfers within the producer’s gross income, facilitating comparisons over time and with other economies.Publication Cities’ Partnership Initiative(Washington, DC: World Bank, 2025-04-24)Sustainable urban development is one of the key areas of development policy in Poland, which is in line with global trends. Sustainable urban development requires an integrated approach that takes into account the complexity and dynamics of phenomena and processes taking place in the urban environment. Meeting the challenges of urban development requires, on the one hand, a steady increase in the capacity of cities to plan and implement development projects, and on the other hand, a favorable regulatory and financial framework and support instruments that are an adequate response to the needs of urban centers. The Cities’ Partnership Initiative (CPI) is a flagship project of the Ministry of Development Funds and Regional Policy of Poland (MDFRP) aimed at supporting sustainable urban development. This final report is the third product of the Reimbursable Advisory Service Agreement on Sustainable Urban Development - Cities’ Partnership Initiative concluded between the MDFRP and the World Bank on January 28, 2022. The report summarizes the project work, including the results of the work of 30 CPI-participating cities, and presents conclusions and recommendations on the three thematic networks and the CPI formula itself.