Publication: Are Short-Term Gains in Learning Outcomes Possible? Evidence from the Malawi Education Sector Improvement Project
Loading...
Date
2024-07-17
ISSN
Published
2024-07-17
Author(s)
Gera, Ravinder Casley
Editor(s)
Abstract
This paper presents evidence of the impact of a five-year package of interconnected interventions intended to improve learning environments in eight disadvantaged districts in Malawi. The intervention, which was implemented over five years, provided additional finance to schools to support the hiring of additional teachers and construction of learning shelters to improve class sizes in lower primary, along with constructing classrooms and providing results-based finance to reward improvements in staffing. The interventions were targeted to eight districts with longstanding disadvantages in staffing, learning environments, and learning outcomes, particularly for girls. Employing administrative data and data from a nationally representative independent sample of public primary schools, the analysis finds that these investments closed the gap in learning outcomes between the targeted districts and the rest of Malawi. There is also suggestive evidence that the program reduced learning gaps between girls and boys. The findings suggest that even in a low-income environment with significant constraints, targeted efforts to reduce class sizes can close district-level gaps in learning.
Link to Data Set
Citation
“Asim, Salman; Gera, Ravinder Casley. 2024. Are Short-Term Gains in Learning Outcomes Possible? Evidence from the Malawi Education Sector Improvement Project. Policy Research Working Paper; 10845. © World Bank. http://hdl.handle.net/10986/41884 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.Publication Participation in Pension Programs in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-04-24)Low- and middle-income countries are aging rapidly but stagnation of growth in participation in pension programs, due to widespread informal employment, presents a major fiscal challenge. Some claim that improving the design of pension program rules can encourage more pension contributions, while others push for universal non-contributory pensions. This paper reviews the recent academic literature on the determinants of active participation in pension systems in high- informality settings. An emerging body of evidence shows that participation responds significantly to financial incentives as well as nonfinancial obstacles. At the same time, pensions are imperfect substitutes for other strategies to cover longevity risk, including support through the family, which will remain crucial for many older people in fiscally constrained environments. Therefore, policy makers should integrate the design of contributory pensions, social pensions, and policies that facilitate other forms of elderly support and consider how all three interact. To inform such efforts, these interactions must be more systematically investigated, and the empirical evidence must be expanded beyond a small number of middle-income countries.Publication Capitalizing on Digital Transformation to Enhance the Effectiveness of Property Institutions(Washington, DC: World Bank, 2025-04-14)Property registries have long been a pillar of state capacity and a basis for private market activity. While registry establishment and operation traditionally were costly and time consuming, digital technology makes low-cost registry operation and wide outreach easier. To guide developing countries aiming to establish such registries and measure progress, this paper develops indicators (in terms of digital coverage, interoperability, and property taxation for local service delivery and public land management) of effective digital registry service provision. Data from 85 countries highlight vast differences and provide suggestions for strategic reforms as well as a basis for measuring progress over time. Expanding geographical coverage and collecting these indicators on a regular basis could provide guidance to improve the way in which, by protecting property, the state creates the basis for widely shared prosperity and a livable environment.Publication Bridging the Gap(Washington, DC: World Bank, 2025-04-21)This paper examines tax revenue shortfalls in South Asian countries. On average during 2019–23, South Asian revenues totaled 18 percent of GDP—well below the average 24 percent among emerging market and developing economies (EMDEs). Econometric estimates from stochastic frontier analysis, which control for tax rates and the size of potential tax bases, suggest that tax revenues in the region are 1 to 7 percentage points of GDP below potential, with shortfalls in five of the region’s eight countries larger than in the average EMDE. Even after controlling for country characteristics, such as widespread informal economic activity outside the tax net and large agriculture sectors, sizable tax gaps remain, suggesting the need for improved tax policy and administration. The paper discusses and provides evidence from international experience with reforms to raise government revenues.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Can Targeted Allocation of Teachers Improve Student Learning Outcomes? Evidence from Malawi(Washington, DC: World Bank, 2024-07-16)Teachers are one of the most important inputs for learning, but in many low-income countries they are poorly distributed between schools. This paper discusses the case of Malawi, which has introduced new evidence-based policies and procedures to improve the equity and efficiency of the allocation of teachers to schools. The analysis finds that adherence to these policies has been highly variable between the country’s districts, with the most successful deploying 75 percent of teachers according to the rules and the least successful just 22 percent. Using administrative data, the paper identifies the impacts on student repetition rates of reductions in pupil–qualified teacher ratios as a result of the new teachers. The findings show that schools that moved from having more than 90 pupils per qualified teacher to a lower ratio experienced reductions in lower primary school repetition rates of 2–3 percentage points. However, similar impacts on dropout are not observed.Publication Does Effective School Leadership Improve Student Progression and Test Scores? Evidence from a Field Experiment in Malawi(Washington, DC: World Bank, 2024-07-17)Evidence from high-income countries suggests that the quality of school leadership has measurable impacts on teacher behaviors and student learning achievement. However, there is a lack of rigorous evidence in low-income contexts, particularly in Sub-Saharan Africa. This study tests the impact on student progression and test scores of a two-year, multi-phase intervention to strengthen leadership skills for head teachers, deputy head teachers, and sub-district education officials. The intervention consists of two phases of classroom training along with follow-up visits, implemented over two years. It focuses on skills related to making more efficient use of resources; motivating and incentivizing teachers to improve performance; and curating a culture in which students and teachers are all motivated to strengthen learning. A randomized controlled trial was conducted in 1,198 schools in all districts of Malawi, providing evidence of the impact of the intervention at scale. The findings show that the intervention improved student test scores by 0.1 standard deviations, equivalent to around eight weeks of additional learning, as well as improving progression rates. The outcomes were achieved primarily as a result of improvements in the provision of remedial classes.Publication What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey(Washington, DC: World Bank, 2024-06-10)Since the introduction of free primary education in 1994, Malawi has achieved rapid expansion in access to school, but the resulting rapid growth in enrollments have outstripped the increase in resources and capacity of the system to deliver learning. The result is an education system with widespread overcrowding and large disparities in conditions, access, and learning outcomes between schools. "What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey" presents one of the most comprehensive pictures ever presented of conditions, practices, and learning outcomes in a low-income country. Using data from a nationally representative, longitudinal survey of more than 500 schools; 4,000 teachers; and a gender-balanced, random sample of more than 13,000 grade 4 students, this book presents a robust analysis of the school-, teacher-, and student-level characteristics that prevent students from learning. The analysis reveals a strong relationship between the remoteness of a school’s location and inequities in school conditions, including the availability and condition of infrastructure, teaching and learning materials, finance, staffing, and supervision. Large class sizes limit the effectiveness of even skilled and highly motivated teachers. Poor learning outcomes are also evident in schools with high proportions of students who have illiterate parents; speak minority languages; are older than the typical age for their grade; and, particularly, have a poor mindset. A dedicated chapter focused on girls’ learning shows that student-level characteristics account for the majority of variation in learning outcomes; of those characteristics, gender is associated with the biggest inequities. The book introduces a new Disadvantage Index (DI) as tool to understand the ways in which multiple dimensions of disadvantage at the school level interact, and it models the impact of investing in low-cost classrooms and additional lower primary teachers at the most disadvantaged schools. What Matters for Learning in Malawi? will be of interest to researchers, educators, and policy makers who have an interest in improving learning outcomes in low-income countries and populations.Publication Learning Loss as a Result of COVID-19(Washington, DC: World Bank, 2024-07-16)School closures from COVID-19 have resulted in large learning losses, from 0.05 to 0.17 standard deviations in high income countries, equivalent to two to six months of lost learning. However, the extent of primary-level learning loss in low-income countries remains unclear, studies lack information on individual students’ learning trajectories, and most do not include students who dropped out. This paper uses representative survey data from Malawi that includes unique longitudinal data on individual students (grade 4 at baseline), including those who dropped out, at three points in time: pre-COVID; 1–12 months before the seven-month school closures; and 14–20 months after schools reopened. Across math, English, and Chichewa, the local language, the average learning loss amounts to 18 months (78 points, 0.78 standard deviations), significantly higher than the loss documented in high income contexts. Decomposing this loss, the findings show that students lost 0.25 standard deviations of existing knowledge during the closure, and a further 0.23 standard deviations in foregone learning compared to the expected trajectory had schools remained open. Further loss comes from a slowdown in learning after schools reopened, with students gaining 7 points’ less new knowledge in math per 100 days, the majority of which is not explained by increased dropout. Our findings are relevant for other low-income and lower-middle income contexts: remote learning during school closure was in general ineffectual, necessitating urgent action to remediate lost learning; and children who dropped out had the highest learning losses and now require out-of-school learning opportunities.Publication Student Learning Outcomes in Tanzania’s Primary Schools(World Bank, Washington, DC, 2019-01)This policy note is an attempt to systematically analyze and document emerging trends in the evolution of students’ learning outcomes in Tanzania’s primary schools. The note is based on two rounds of the Service Delivery Indicators Survey in Tanzania, 2014 and 2016, and provides guidance to the Government on: (1) regional, district and school-level variations in gains in pupil achievement scores; (2) student, teacher and school level factors associated with learning outcomes; and (3) key observable factors associated with highest gains in test scores. The good news is that the Government’s concerted reform efforts are showing positive results in quality of schooling: test scores in English, Math, and Kiswahili for Standard four pupils have improved significantly over time. They have improved all across Tanzania, with largest gains registered in disadvantaged targeted districts (EQUIP-T3), followed by rural areas. Low-performing regions are catching up as the impacts of several large-scale investment programs are taking root. These improvements in test scores appear to be associated with improvements in teacher effort and subject knowledge. Rising pupil-teacher-ratios pose risks to continued learning improvements, particularly as the Government is preparing for rapid expansion in enrolments in the wake of the Fee-Free Basic Education Policy. Students tested for 2016 will be entering Form 1 secondary in 2018-19. For the improvements in learning at the primary level to have maximum impact, particularly in disadvantaged regions supported by EQUIP-T, they will require immediate attention to and investments in secondary schools to take these students through the full cycle of quality basic education promised by FFBEP. Female students, overage students, and non-native Kiswahili speakers continue to lag behind in learning, posing threats to the long-term equity of the system. Careful measurement of teacher practices at secondary level can provide ways to supportteaching behavior conducive to the well-being of these children.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Uzbekistan(World Bank, Washington, DC, 2020-05)This document has been produced by the World Bank to underpin the Republic of Uzbekistan’s ‘Strategy for the Development of the Transport System until 2035’ as it continues structural reforms and transitions the country to a competitive market-oriented economy. The policy paper aims to provide a vision to policy makers and practitioners for improving transport and logistics connectivity and service delivery and to define the building blocks of a comprehensive strategy by (a) laying out the higher-level objectives and priority directions for developing the sector, (b) defining the key aspects of advancing the institutional reforms, (c) identifying main transport and logistics gaps and barriers, and (d) presenting opportunities for introducing innovative financing mechanisms and PPPs in transport and logistics. At the same time, the paper points out areas needing further diagnostics and data gathering to better determine deficiencies, calculate transport and logistics costs, and identify further areas for improvement.Publication Greater Heights(Washington, DC: World Bank, 2025-03-12)Twenty-seven countries have reached high-income status since 1990. Ten of these are in the Europe and Central Asia region and have joined the European Union. Another 20 in the region have become more prosperous since the 1990s. However, their transition to high-income status has been delayed. These middle-income countries have found that the prospects for growth to high-income status have become even more difficult since the 2007–09 global financial crisis. This reflects partly a slowdown in structural reforms at home and partly the challenges associated with a deterioration in the global environment. The concern has emerged that many countries in the region may be caught in the middle-income trap, a phase in development characterized by a recurring deceleration in growth and by per capita incomes that are systematically below the high-income threshold. To ensure that these countries overcome the obstacles to growth and achieve progress toward high-income status, policy makers need to make the transition from a strategy driven largely by investment to a strategy that is supported by the importation and diffusion of global capital, knowledge, and technology and then to a strategy that complements these with innovation. The report Greater Heights: Growing to High Income in Europe and Central Asia relies on the 3i strategy described in World Development Report 2024—investment, infusion, and innovation—to propose policy options to assist middle-income countries in Europe and Central Asia in the effort to reach high-income status. Drawing on comprehensive empirical analysis, the report offers actionable recommendations that will enable policy makers to advance stronger economic growth across the region. Such a transition will require continued and sustained foundational reform to maximize the drivers of economic growth while pivoting to new transformative reforms to promote the development of more complex economic structures and institutions. These involve the need to discipline incumbents, boost the role of the private sector, strengthen the competitive environment, and reward merit. The emphasis on a strategy driven by innovation is also critically important for those countries that have already attained high-income status.Publication Hospital Sector Reform in Uzbekistan : A Policy Note(World Bank, Washington, DC, 2012-01)Since the mid-1990s, Uzbekistan has undergone reforms in the health sector focused on restructuring of primary health care in Uzbekistan as well as the establishment of an emergency medical care network. Reform and development initiatives in at secondary and tertiary care level have been limited to gradual downsizing of sub-national hospitals, with the exception of the emergency medical care network, and expansion of Republican specialized tertiary centers. Recent years have seen increases in out-of-pocket payments (both official and informal) for hospital and other health services, which now present a barrier to accessing health services and pharmaceuticals for some patients. The Ministry of Health (MOH) is implementing a program of development of new standards for diagnostic/curative services at each level of care that are intended to modernize practice and increase quality and efficiency. Twenty disease areas have been covered to date. Standards for equipment requirements at each level are also being defined. The Ministry now faces the challenge of developing a strategy to changing clinical and managerial practice in hospitals to bring them into line with the new standards. Uzbekistan has a large and fragmented network of hospitals and specialist clinics, characterized by multiple vertical programs and many single-specialty facilities. There is lack of clarity regarding the specific roles and linkages between the numerous hospitals and specialized care facilities. The Government has pursued a policy of increases in official user fees or "self-financing", alongside offsetting reductions in budget provision for non-salary operating costs in Republican hospitals and many Oblast hospitals in recent years. City and oblast hospitals have self-financing beds. User fees are projected to amount to an average of 18 percent of revenue in 2008 for oblast hospitals (compared to an average of 1.4 percent in 2000). Republican Specialist Centers (tertiary level hospitals) now obtain up to around 65 percent of revenue from user fees, and have a target of 80 percent. By contrast, rayon hospitals collect little user revenue (projected to be a little under 1percent in 2008, a level that is approximately unchanged since 2000). Budget funds for oblast hospital now cover little more than the costs of staff salaries and benefits, following budget reductions that offset increases in user fees.Publication Europe and Central Asia Economic Update, Fall 2024: Better Education for Stronger Growth(Washington, DC: World Bank, 2024-10-17)Economic growth in Europe and Central Asia (ECA) is likely to moderate from 3.5 percent in 2023 to 3.3 percent this year. This is significantly weaker than the 4.1 percent average growth in 2000-19. Growth this year is driven by expansionary fiscal policies and strong private consumption. External demand is less favorable because of weak economic expansion in major trading partners, like the European Union. Growth is likely to slow further in 2025, mostly because of the easing of expansion in the Russian Federation and Turkiye. This Europe and Central Asia Economic Update calls for a major overhaul of education systems across the region, particularly higher education, to unleash the talent needed to reinvigorate growth and boost convergence with high-income countries. Universities in the region suffer from poor management, outdated curricula, and inadequate funding and infrastructure. A mismatch between graduates' skills and the skills employers are seeking leads to wasted potential and contributes to the region's brain drain. Reversing the decline in the quality of education will require prioritizing improvements in teacher training, updated curricula, and investment in educational infrastructure. In higher education, reforms are needed to consolidate university systems, integrate them with research centers, and provide reskilling opportunities for adult workers.