Publication: Are Short-Term Gains in Learning Outcomes Possible? Evidence from the Malawi Education Sector Improvement Project
Loading...
Published
2024-07-17
ISSN
Date
2024-07-17
Author(s)
Gera, Ravinder Casley
Editor(s)
Abstract
This paper presents evidence of the impact of a five-year package of interconnected interventions intended to improve learning environments in eight disadvantaged districts in Malawi. The intervention, which was implemented over five years, provided additional finance to schools to support the hiring of additional teachers and construction of learning shelters to improve class sizes in lower primary, along with constructing classrooms and providing results-based finance to reward improvements in staffing. The interventions were targeted to eight districts with longstanding disadvantages in staffing, learning environments, and learning outcomes, particularly for girls. Employing administrative data and data from a nationally representative independent sample of public primary schools, the analysis finds that these investments closed the gap in learning outcomes between the targeted districts and the rest of Malawi. There is also suggestive evidence that the program reduced learning gaps between girls and boys. The findings suggest that even in a low-income environment with significant constraints, targeted efforts to reduce class sizes can close district-level gaps in learning.
Link to Data Set
Citation
“Asim, Salman; Gera, Ravinder Casley. 2024. Are Short-Term Gains in Learning Outcomes Possible? Evidence from the Malawi Education Sector Improvement Project. Policy Research Working Paper; 10845. © World Bank. http://hdl.handle.net/10986/41884 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Can Targeted Allocation of Teachers Improve Student Learning Outcomes? Evidence from Malawi(Washington, DC: World Bank, 2024-07-16)Teachers are one of the most important inputs for learning, but in many low-income countries they are poorly distributed between schools. This paper discusses the case of Malawi, which has introduced new evidence-based policies and procedures to improve the equity and efficiency of the allocation of teachers to schools. The analysis finds that adherence to these policies has been highly variable between the country’s districts, with the most successful deploying 75 percent of teachers according to the rules and the least successful just 22 percent. Using administrative data, the paper identifies the impacts on student repetition rates of reductions in pupil–qualified teacher ratios as a result of the new teachers. The findings show that schools that moved from having more than 90 pupils per qualified teacher to a lower ratio experienced reductions in lower primary school repetition rates of 2–3 percentage points. However, similar impacts on dropout are not observed.Publication Does Effective School Leadership Improve Student Progression and Test Scores? Evidence from a Field Experiment in Malawi(Washington, DC: World Bank, 2024-07-17)Evidence from high-income countries suggests that the quality of school leadership has measurable impacts on teacher behaviors and student learning achievement. However, there is a lack of rigorous evidence in low-income contexts, particularly in Sub-Saharan Africa. This study tests the impact on student progression and test scores of a two-year, multi-phase intervention to strengthen leadership skills for head teachers, deputy head teachers, and sub-district education officials. The intervention consists of two phases of classroom training along with follow-up visits, implemented over two years. It focuses on skills related to making more efficient use of resources; motivating and incentivizing teachers to improve performance; and curating a culture in which students and teachers are all motivated to strengthen learning. A randomized controlled trial was conducted in 1,198 schools in all districts of Malawi, providing evidence of the impact of the intervention at scale. The findings show that the intervention improved student test scores by 0.1 standard deviations, equivalent to around eight weeks of additional learning, as well as improving progression rates. The outcomes were achieved primarily as a result of improvements in the provision of remedial classes.Publication What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey(Washington, DC: World Bank, 2024-06-10)Since the introduction of free primary education in 1994, Malawi has achieved rapid expansion in access to school, but the resulting rapid growth in enrollments have outstripped the increase in resources and capacity of the system to deliver learning. The result is an education system with widespread overcrowding and large disparities in conditions, access, and learning outcomes between schools. "What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey" presents one of the most comprehensive pictures ever presented of conditions, practices, and learning outcomes in a low-income country. Using data from a nationally representative, longitudinal survey of more than 500 schools; 4,000 teachers; and a gender-balanced, random sample of more than 13,000 grade 4 students, this book presents a robust analysis of the school-, teacher-, and student-level characteristics that prevent students from learning. The analysis reveals a strong relationship between the remoteness of a school’s location and inequities in school conditions, including the availability and condition of infrastructure, teaching and learning materials, finance, staffing, and supervision. Large class sizes limit the effectiveness of even skilled and highly motivated teachers. Poor learning outcomes are also evident in schools with high proportions of students who have illiterate parents; speak minority languages; are older than the typical age for their grade; and, particularly, have a poor mindset. A dedicated chapter focused on girls’ learning shows that student-level characteristics account for the majority of variation in learning outcomes; of those characteristics, gender is associated with the biggest inequities. The book introduces a new Disadvantage Index (DI) as tool to understand the ways in which multiple dimensions of disadvantage at the school level interact, and it models the impact of investing in low-cost classrooms and additional lower primary teachers at the most disadvantaged schools. What Matters for Learning in Malawi? will be of interest to researchers, educators, and policy makers who have an interest in improving learning outcomes in low-income countries and populations.Publication Learning Loss as a Result of COVID-19(Washington, DC: World Bank, 2024-07-16)School closures from COVID-19 have resulted in large learning losses, from 0.05 to 0.17 standard deviations in high income countries, equivalent to two to six months of lost learning. However, the extent of primary-level learning loss in low-income countries remains unclear, studies lack information on individual students’ learning trajectories, and most do not include students who dropped out. This paper uses representative survey data from Malawi that includes unique longitudinal data on individual students (grade 4 at baseline), including those who dropped out, at three points in time: pre-COVID; 1–12 months before the seven-month school closures; and 14–20 months after schools reopened. Across math, English, and Chichewa, the local language, the average learning loss amounts to 18 months (78 points, 0.78 standard deviations), significantly higher than the loss documented in high income contexts. Decomposing this loss, the findings show that students lost 0.25 standard deviations of existing knowledge during the closure, and a further 0.23 standard deviations in foregone learning compared to the expected trajectory had schools remained open. Further loss comes from a slowdown in learning after schools reopened, with students gaining 7 points’ less new knowledge in math per 100 days, the majority of which is not explained by increased dropout. Our findings are relevant for other low-income and lower-middle income contexts: remote learning during school closure was in general ineffectual, necessitating urgent action to remediate lost learning; and children who dropped out had the highest learning losses and now require out-of-school learning opportunities.Publication Student Learning Outcomes in Tanzania’s Primary Schools(World Bank, Washington, DC, 2019-01)This policy note is an attempt to systematically analyze and document emerging trends in the evolution of students’ learning outcomes in Tanzania’s primary schools. The note is based on two rounds of the Service Delivery Indicators Survey in Tanzania, 2014 and 2016, and provides guidance to the Government on: (1) regional, district and school-level variations in gains in pupil achievement scores; (2) student, teacher and school level factors associated with learning outcomes; and (3) key observable factors associated with highest gains in test scores. The good news is that the Government’s concerted reform efforts are showing positive results in quality of schooling: test scores in English, Math, and Kiswahili for Standard four pupils have improved significantly over time. They have improved all across Tanzania, with largest gains registered in disadvantaged targeted districts (EQUIP-T3), followed by rural areas. Low-performing regions are catching up as the impacts of several large-scale investment programs are taking root. These improvements in test scores appear to be associated with improvements in teacher effort and subject knowledge. Rising pupil-teacher-ratios pose risks to continued learning improvements, particularly as the Government is preparing for rapid expansion in enrolments in the wake of the Fee-Free Basic Education Policy. Students tested for 2016 will be entering Form 1 secondary in 2018-19. For the improvements in learning at the primary level to have maximum impact, particularly in disadvantaged regions supported by EQUIP-T, they will require immediate attention to and investments in secondary schools to take these students through the full cycle of quality basic education promised by FFBEP. Female students, overage students, and non-native Kiswahili speakers continue to lag behind in learning, posing threats to the long-term equity of the system. Careful measurement of teacher practices at secondary level can provide ways to supportteaching behavior conducive to the well-being of these children.
Users also downloaded
Showing related downloaded files
Publication Comoros Country Climate and Development Report(Washington, DC: World Bank, 2025-06-18)The Union of the Comoros (The Comoros) has significant vulnerability to climate change-related risks but has considerable opportunities to strengthen preparedness and resilience against these challenges. According to the Notre Dame Global Adaptation Index, the Comoros is the 29th-most vulnerable country to climate change and the 163rd most ready to adapt (out of 191). The Comoros archipelago is exposed to many natural hazards that adversely affect the country’s natural capital, people, and physical infrastructure. In 2014, the economic cost of climate-related disasters was estimated at 5.7 million dollars annually, equivalent to 9.2 percent of Gross Domestic Product (GDP). Between 2018 and 2023, as many as 11 tropical depressions or cyclones impacted the country, with Cyclone Kenneth causing the greatest damage, equivalent to 14 percent of GDP, resulting in total economic growth falling from 3.6 percent in 2018 to 1.9 percent in 2019. More than 345,000 people (40 percent of the population) were affected by the cyclone, with 185,000 people experiencing severe impacts and 12,000 people displaced. However, there is an opportunity for the country to grow more robust and shock-responsive, and to establish pre-positioned funding mechanisms to enhance future crisis response efforts. For the Comoros, adaptation and climate-resilient development are the key climate change focus areas, with the country projected to face 836 million dollars 2050 in additional costs due to climate-related impacts. Current plans to adapt to the impacts of climate change in the Comoros include efforts to improve water management, strengthen coastal protection, and develop climate-smart agriculture practices. Given the country’s reliance on its natural resource base for economic growth and mobility, protection of these resources from climate change will be essential for promoting resilient growth and development. In addition to growing the adaptive capacity of the country’s natural resource sectors, strategic economic diversification will be important to help minimize future climate impacts, and development activities will need to be undertaken in such a way as to attract low-carbon co-benefits. The Union of the Comoros is committed to addressing climate change through its Nationally Determined Contribution (NDC) and national priorities. The country’s NDC (which was revised in 2021 for a ten-year horizon) sets ambitious targets, with a goal of reducing greenhouse gas emissions by 23 percent by 2030. The country also plans to significantly increase the share of renewable energy in its energy portfolio, reaching 33 MW by 2030. This will not only promote low-carbon development but also reduce the country’s dependency on imported oil and coal, which currently make up 95 percent of the energy mix. Additionally, the Comoros has declared its intention to increase CO2 removals by 47 percent by 2030, compared to BAU.Publication Jobs in a Changing Climate: Insights from World Bank Group Country Climate and Development Reports Covering 93 Economies(Washington, DC: World Bank, 2025-11-05)The World Bank Group’s Country Climate and Development Reports (CCDRs) provide a crosscutting look at how countries’ development prospects, and the job opportunities they offer to their people, can be threatened by climate impacts and supported by climate policies. Climate change and policies affect jobs through impacts on productivity, energy and material efficiency, and physical, human, and natural capital. They can also transform employment opportunities, especially through complementary measures that help workers and firms adapt to and benefit from new technologies and production practices. Prepared by the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA), CCDRs integrate country perspectives, climate science and economic modeling, private sector information, and policy analysis to assess how countries can successfully grow and develop their economies and create jobs despite increasing climate risks and while achieving their climate objectives and commitments. Each CCDR starts from the country’s development priorities, opportunities, and challenges, and is developed in close consultation with governments, businesses, and civil society, ensuring the recommendations reflect national priorities. By combining evidence on adaptation, resilience, and emissions pathways, CCDRs highlight where climate action can reinforce development and job creation, and where targeted policies are needed to manage risks and smooth labor market transitions. Taken together, these elements can help create local jobs, ensure economic transitions are just and inclusive, and equip workers and firms to navigate the disruptions and opportunities of a changing climate and changing technologies.Publication Madagascar Country Climate and Development Report(Washington, DC: World Bank, 2024-10-25)Climate change has made delivering better development in Madagascar ever more urgent. This Country Climate and Development Report (CCDR) finds that Madagascar’s aspiration to evolve into an emerging country by 2040 will be derailed unless it can bolster its resilience to intensifying climate shocks to safeguard its modest development gains and boost economic growth. The high frequency of extreme climate shocks since the 1970s has led to significant macroeconomic disturbances and weak growth. This CCDR examines the implications of future climate change for Madagascar’s growth, and the potential benefits of both structural reforms and adaptation investments. It outlines three priority areas for building resilience to climate change, and calculates the costs needed to achieve this. It provides detailed recommendations for finding the finance required, as well as for implementing the policy challenges identified.Publication Kyrgyz Republic Country Climate and Development Report(Washington, DC: World Bank, 2025-11-03)This Country Climate and Development Report (CCDR) on the Kyrgyz Republic aims to support the country’s development goals amid a changing climate. The CCDR considers two policy scenarios up to 2050: the business-as-usual (BAU) and high-growth scenarios. As it quantifies the likely impacts of climate change on the Kyrgyz economy between now and 2050, the report highlights key government actions to best prepare for and adapt to climate impacts (referred to as “with adaptation” measures), with a particular focus on the time horizon up to 2030. The CCDR also outlines a path to net zero emissions by 2050 (referred to as “with mitigation” measures, “decarbonization,” or, simply, “net zero 2050”), highlighting associated development co-benefits.Publication Guinea-Bissau Country Climate and Development Report(Washington, DC: World Bank, 2024-10-23)Guinea-Bissau is endowed with a wealth of natural resources, with the highest natural capital per capita in West Africa (US3,874 dollars per capita), which could be leveraged for sustainable and resilient growth. However, Guinea-Bissau faces significant development hurdles, such as high poverty rates, political instability, and economic challenges, including an over-reliance on cashew nuts. Rural poverty has increased, and the nation's infrastructure, education, and health care systems are underdeveloped. Climate change poses a severe threat, potentially impacting agriculture, fisheries, and infrastructure. Without adaptation, it could lead to a significant cut in real GDP per capita (minus 7.3 percent by 2050) and increase in poverty (with up to over 200,000 additional poor by 2050, that is, 5 percent of the expected population, in the worst scenario). The country's low greenhouse gas emissions are expected to rise, mainly due to agriculture and land-use changes, with deforestation being a major contributing factor. Although Guinea-Bissau is a low emitter, it has high mitigation ambitions, targeting a 30 percent reduction in greenhouse gas emissions by 2030. The Nationally Determined Contribution outlines significant climate actions, with initiatives focused on forest conservation, sustainable agriculture, and community development. However, the country's political instability, institutional weaknesses, and limited financial resources pose challenges to implementing these climate commitments, which depend heavily on external funding. The financial sector's underdevelopment and vulnerability to external shocks limit its ability to support green investments, though reforms could enhance resilience. Guinea-Bissau must consider its climate financing as development financing and vice-versa, engage the private sector, and integrate climate goals with national development plans to ensure a sustainable future. Concessional climate financing is vital due to the underdeveloped financial sector and the government’s limited borrowing capacity. Addressing Guinea-Bissau's vulnerability to climate change and its structural issues requires a cohesive approach that integrates development and climate strategies. This could involve improving governance, diversifying the economy, protecting natural capital, developing human capital, and investing in sustainable agriculture and infrastructure. The transition to a more sustainable and inclusive development pathway that supports economic growth is possible, but requires focusing on key strategic sectors, enhancing institutional capacity, and creating the conditions to mobilize finance. As a highly vulnerable country, there are myriad needs in the different sectors; however, to be more efficient and effective, Guinea-Bissau should prioritize actions in a few sectors, especially actions on biodiversity, agriculture, and social protection. Low carbon development, especially in energy and forestry sectors, could provide cost-efficient solutions and attract climate finance, including from the private sector, which will support the overall development agenda.