Publication: Does Effective School Leadership Improve Student Progression and Test Scores? Evidence from a Field Experiment in Malawi
Loading...
Date
2024-07-17
ISSN
Published
2024-07-17
Author(s)
Editor(s)
Abstract
Evidence from high-income countries suggests that the quality of school leadership has measurable impacts on teacher behaviors and student learning achievement. However, there is a lack of rigorous evidence in low-income contexts, particularly in Sub-Saharan Africa. This study tests the impact on student progression and test scores of a two-year, multi-phase intervention to strengthen leadership skills for head teachers, deputy head teachers, and sub-district education officials. The intervention consists of two phases of classroom training along with follow-up visits, implemented over two years. It focuses on skills related to making more efficient use of resources; motivating and incentivizing teachers to improve performance; and curating a culture in which students and teachers are all motivated to strengthen learning. A randomized controlled trial was conducted in 1,198 schools in all districts of Malawi, providing evidence of the impact of the intervention at scale. The findings show that the intervention improved student test scores by 0.1 standard deviations, equivalent to around eight weeks of additional learning, as well as improving progression rates. The outcomes were achieved primarily as a result of improvements in the provision of remedial classes.
Link to Data Set
Citation
“Asim, Salman; Gera, Ravinder Casley; Harris, Donna; Dercon, Stefan. 2024. Does Effective School Leadership Improve Student Progression and Test Scores? Evidence from a Field Experiment in Malawi. Policy Research Working Paper; 10846. © World Bank. http://hdl.handle.net/10986/41886 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Tradeoffs over Rate Cycles(Washington, DC: World Bank, 2025-05-23)Central banks often face tradeoffs in how their monetary policy decisions impact economic activity (including employment), inflation and the price level. This paper assesses how these tradeoffs have evolved over time and varied across countries, with a focus on understanding the post-pandemic adjustment. To make these comparisons, we compile a cross-country, historical database of “rate cycles” (i.e., easing and tightening phases for monetary policy) for 24 advanced economies from 1970 through 2024. This allows us to quantify the characteristics of interest rate adjustments and corresponding macroeconomic outcomes and tradeoffs. We also calculate Sacrifice Ratios (output losses per inflation reduction) and document a historically low “sacrifice” during the post-pandemic tightening. This popular measure, however, ignores adjustments in the price level—which increased by more after the pandemic than over the past four decades. A series of regressions and simulations suggest monetary policy (and particularly the timing and aggressiveness of rate hikes) play a meaningful role in explaining these tradeoffs and how adjustments occur during tightening phases. Central bank credibility is the one measure we assess that corresponds to only positive outcomes and no difficult tradeoffs.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Chalkboards to Chatbots(Washington, DC: World Bank, 2025-05-20)This study evaluates the impact of a program leveraging large language models for virtual tutoring in secondary education in Nigeria. Using a randomized controlled trial, the program deployed Microsoft Copilot (powered by GPT-4) to support first-year senior secondary students in English language learning over six weeks. The intervention demonstrated a significant improvement of 0.31 standard deviation on an assessment that included English topics aligned with the Nigerian curriculum, knowledge of artificial intelligence and digital skills. The effect on English, the main outcome of interest, was of 0.23 standard deviations. Cost-effectiveness analysis revealed substantial learning gains, equating to 1.5 to 2 years of ’business-as-usual’ schooling, situating the intervention among some of the most cost-effective programs to improve learning outcomes. An analysis of heterogeneous effects shows that while the program benefits students across the baseline ability distribution, the largest effects are for female students, and those with higher initial academic performance. The findings highlight that artificial intelligence-powered tutoring, when designed and used properly, can have transformative impacts in the education sector in low-resource settings.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Can Targeted Allocation of Teachers Improve Student Learning Outcomes? Evidence from Malawi(Washington, DC: World Bank, 2024-07-16)Teachers are one of the most important inputs for learning, but in many low-income countries they are poorly distributed between schools. This paper discusses the case of Malawi, which has introduced new evidence-based policies and procedures to improve the equity and efficiency of the allocation of teachers to schools. The analysis finds that adherence to these policies has been highly variable between the country’s districts, with the most successful deploying 75 percent of teachers according to the rules and the least successful just 22 percent. Using administrative data, the paper identifies the impacts on student repetition rates of reductions in pupil–qualified teacher ratios as a result of the new teachers. The findings show that schools that moved from having more than 90 pupils per qualified teacher to a lower ratio experienced reductions in lower primary school repetition rates of 2–3 percentage points. However, similar impacts on dropout are not observed.Publication What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey(Washington, DC: World Bank, 2024-06-10)Since the introduction of free primary education in 1994, Malawi has achieved rapid expansion in access to school, but the resulting rapid growth in enrollments have outstripped the increase in resources and capacity of the system to deliver learning. The result is an education system with widespread overcrowding and large disparities in conditions, access, and learning outcomes between schools. "What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey" presents one of the most comprehensive pictures ever presented of conditions, practices, and learning outcomes in a low-income country. Using data from a nationally representative, longitudinal survey of more than 500 schools; 4,000 teachers; and a gender-balanced, random sample of more than 13,000 grade 4 students, this book presents a robust analysis of the school-, teacher-, and student-level characteristics that prevent students from learning. The analysis reveals a strong relationship between the remoteness of a school’s location and inequities in school conditions, including the availability and condition of infrastructure, teaching and learning materials, finance, staffing, and supervision. Large class sizes limit the effectiveness of even skilled and highly motivated teachers. Poor learning outcomes are also evident in schools with high proportions of students who have illiterate parents; speak minority languages; are older than the typical age for their grade; and, particularly, have a poor mindset. A dedicated chapter focused on girls’ learning shows that student-level characteristics account for the majority of variation in learning outcomes; of those characteristics, gender is associated with the biggest inequities. The book introduces a new Disadvantage Index (DI) as tool to understand the ways in which multiple dimensions of disadvantage at the school level interact, and it models the impact of investing in low-cost classrooms and additional lower primary teachers at the most disadvantaged schools. What Matters for Learning in Malawi? will be of interest to researchers, educators, and policy makers who have an interest in improving learning outcomes in low-income countries and populations.Publication Are Short-Term Gains in Learning Outcomes Possible? Evidence from the Malawi Education Sector Improvement Project(Washington, DC: World Bank, 2024-07-17)This paper presents evidence of the impact of a five-year package of interconnected interventions intended to improve learning environments in eight disadvantaged districts in Malawi. The intervention, which was implemented over five years, provided additional finance to schools to support the hiring of additional teachers and construction of learning shelters to improve class sizes in lower primary, along with constructing classrooms and providing results-based finance to reward improvements in staffing. The interventions were targeted to eight districts with longstanding disadvantages in staffing, learning environments, and learning outcomes, particularly for girls. Employing administrative data and data from a nationally representative independent sample of public primary schools, the analysis finds that these investments closed the gap in learning outcomes between the targeted districts and the rest of Malawi. There is also suggestive evidence that the program reduced learning gaps between girls and boys. The findings suggest that even in a low-income environment with significant constraints, targeted efforts to reduce class sizes can close district-level gaps in learning.Publication Learning Loss as a Result of COVID-19(Washington, DC: World Bank, 2024-07-16)School closures from COVID-19 have resulted in large learning losses, from 0.05 to 0.17 standard deviations in high income countries, equivalent to two to six months of lost learning. However, the extent of primary-level learning loss in low-income countries remains unclear, studies lack information on individual students’ learning trajectories, and most do not include students who dropped out. This paper uses representative survey data from Malawi that includes unique longitudinal data on individual students (grade 4 at baseline), including those who dropped out, at three points in time: pre-COVID; 1–12 months before the seven-month school closures; and 14–20 months after schools reopened. Across math, English, and Chichewa, the local language, the average learning loss amounts to 18 months (78 points, 0.78 standard deviations), significantly higher than the loss documented in high income contexts. Decomposing this loss, the findings show that students lost 0.25 standard deviations of existing knowledge during the closure, and a further 0.23 standard deviations in foregone learning compared to the expected trajectory had schools remained open. Further loss comes from a slowdown in learning after schools reopened, with students gaining 7 points’ less new knowledge in math per 100 days, the majority of which is not explained by increased dropout. Our findings are relevant for other low-income and lower-middle income contexts: remote learning during school closure was in general ineffectual, necessitating urgent action to remediate lost learning; and children who dropped out had the highest learning losses and now require out-of-school learning opportunities.Publication Student Learning Outcomes in Tanzania’s Primary Schools(World Bank, Washington, DC, 2019-01)This policy note is an attempt to systematically analyze and document emerging trends in the evolution of students’ learning outcomes in Tanzania’s primary schools. The note is based on two rounds of the Service Delivery Indicators Survey in Tanzania, 2014 and 2016, and provides guidance to the Government on: (1) regional, district and school-level variations in gains in pupil achievement scores; (2) student, teacher and school level factors associated with learning outcomes; and (3) key observable factors associated with highest gains in test scores. The good news is that the Government’s concerted reform efforts are showing positive results in quality of schooling: test scores in English, Math, and Kiswahili for Standard four pupils have improved significantly over time. They have improved all across Tanzania, with largest gains registered in disadvantaged targeted districts (EQUIP-T3), followed by rural areas. Low-performing regions are catching up as the impacts of several large-scale investment programs are taking root. These improvements in test scores appear to be associated with improvements in teacher effort and subject knowledge. Rising pupil-teacher-ratios pose risks to continued learning improvements, particularly as the Government is preparing for rapid expansion in enrolments in the wake of the Fee-Free Basic Education Policy. Students tested for 2016 will be entering Form 1 secondary in 2018-19. For the improvements in learning at the primary level to have maximum impact, particularly in disadvantaged regions supported by EQUIP-T, they will require immediate attention to and investments in secondary schools to take these students through the full cycle of quality basic education promised by FFBEP. Female students, overage students, and non-native Kiswahili speakers continue to lag behind in learning, posing threats to the long-term equity of the system. Careful measurement of teacher practices at secondary level can provide ways to supportteaching behavior conducive to the well-being of these children.
Users also downloaded
Showing related downloaded files
Publication Choosing Our Future(Washington, DC: World Bank, 2024-09-04)Education can propel faster and better climate action in two crucial ways. First, education can galvanize behavior change at scale - not just for tomorrow, but also for today. Second, education can unlock skills and innovation to shift economies onto greener trajectories for growth. At the same time, education needs to be protected from climate change. Extreme climate events and temperatures are already eroding hard-won progress on schooling and learning. Climate change is causing school closures, learning losses, and dropouts. These will turn into long-run inter-generational earnings losses putting into jeopardy education’s powerful potential for spurring poverty alleviation and economic growth. Governments can act now to adapt schools for climate change in cost-effective ways. This report outlines new data, evidence, and examples on how countries can harness education to propel climate action. It provides an actionable policy agenda to meet development, education, and climate goals together, recognizing that tackling climate change requires changes to individual beliefs, behaviors, and skills – changes that education is uniquely positioned to catalyze.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Achieving Sustainable and Inclusive Artisanal and Small-Scale Mining (ASM)(Washington, DC: World Bank, 2024-09-16)Artisanal and small-scale mining (ASM) has played an increasingly active role in national development and international trade over the decades. As of 2024, those engaged directly and indirectly in the sector’s labor value chain make up more than 225 million people working across Latin and South America, Africa, and Asia. Studies estimate that women account for between 18 percent and 50 percent of the 45 million people who work directly in ASM. Artisanal and small-scale miners work in diverse mineral supply chains - ranging from well-known minerals and metals such as gold, cobalt, copper, and semiprecious and precious gemstones to lesser-known materials such as salt, gravel, and quarry rock. Growth in the share of artisanal or small-scale mined material has grown significantly. In short, ASM is vital to global prosperity and poverty reduction, but the sector must also lead in environmental stewardship. As heard from miners and other stakeholders, safety and well-being along with environmental stewardship, increased domestic revenues, and improved productivity will be important outcomes to judge success. These are the incentives that will help development efforts be taken up more readily and widely by ASM actors and governments themselves. World Bank support to country clients will need to be more adaptive in their funding timelines, with a view to scaling from the start to achieve outcomes in the most effective and lean way possible. Importantly, World Bank interventions should be more participatory and ASM actor-centered, given time and resources to build the trust and create incentives for behavior change.Publication Global Economic Prospects, June 2024(Washington, DC: World Bank, 2024-06-11)After several years of negative shocks, global growth is expected to hold steady in 2024 and then edge up in the next couple of years, in part aided by cautious monetary policy easing as inflation gradually declines. However, economic prospects are envisaged to remain tepid, especially in the most vulnerable countries. Risks to the outlook, while more balanced, are still tilted to the downside, including the possibility of escalating geopolitical tensions, further trade fragmentation, and higher-for-longer interest rates. Natural disasters related to climate change could also hinder activity. Subdued growth prospects across many emerging market and developing economies and continued risks underscore the need for decisive policy action at the global and national levels. Global Economic Prospects is a World Bank Group Flagship Report that examines global economic developments and prospects, with a special focus on emerging market and developing economies, on a semiannual basis (in January and June). Each edition includes analytical pieces on topical policy challenges faced by these economies.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.