Publication: Does Effective School Leadership Improve Student Progression and Test Scores? Evidence from a Field Experiment in Malawi
Loading...
Date
2024-07-17
ISSN
Published
2024-07-17
Author(s)
Editor(s)
Abstract
Evidence from high-income countries suggests that the quality of school leadership has measurable impacts on teacher behaviors and student learning achievement. However, there is a lack of rigorous evidence in low-income contexts, particularly in Sub-Saharan Africa. This study tests the impact on student progression and test scores of a two-year, multi-phase intervention to strengthen leadership skills for head teachers, deputy head teachers, and sub-district education officials. The intervention consists of two phases of classroom training along with follow-up visits, implemented over two years. It focuses on skills related to making more efficient use of resources; motivating and incentivizing teachers to improve performance; and curating a culture in which students and teachers are all motivated to strengthen learning. A randomized controlled trial was conducted in 1,198 schools in all districts of Malawi, providing evidence of the impact of the intervention at scale. The findings show that the intervention improved student test scores by 0.1 standard deviations, equivalent to around eight weeks of additional learning, as well as improving progression rates. The outcomes were achieved primarily as a result of improvements in the provision of remedial classes.
Link to Data Set
Citation
“Asim, Salman; Gera, Ravinder Casley; Harris, Donna; Dercon, Stefan. 2024. Does Effective School Leadership Improve Student Progression and Test Scores? Evidence from a Field Experiment in Malawi. Policy Research Working Paper; 10846. © World Bank. http://hdl.handle.net/10986/41886 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Impact of Trade Promotion Organizations on Exports(Washington, DC: World Bank, 2025-08-13)This paper examines the impact of trade promotion organizations on exports during the COVID-19 pandemic using a World Bank survey. The results suggest that increased trade promotion organization budgets significantly boosted exports during downturns but had no effect during the recovery phase. Interestingly, e-commerce programs adopted by trade promotion organizations negatively affected exports during downturns as they diverted resources away from productive support, especially for sectors not intensive in online trade. These findings suggest that countercyclical trade promotion organizations budgets may enhance trade resilience during similar global shocks.Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Climate Vulnerability and Job Accessibility(Washington, DC: World Bank, 2025-08-11)Many developing cities are facing rapid population growth and extreme climate events. This paper examines the link between job accessibility and climate vulnerability, using data from Antananarivo, Madagascar, which frequently experiences flooding. As in other countries, the analysis finds that men’s commutes are longer than women’s, who tend to walk to work or use public transport. Even after controlling for observables and the potential endogeneity bias associated with commute time, the findings show that climate vulnerability negatively impacts wages, as people avoid commuting long to work due to anticipated potential climate risks. Building climate resilience into urban transport is therefore essential. As predicted by theory, the evidence also shows that the value of commuting is positive, and walking is disadvantageous. Motorized commuting yields higher returns, which could lead to overuse of private cars and taxis, posing decarbonization challenges.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Can Targeted Allocation of Teachers Improve Student Learning Outcomes? Evidence from Malawi(Washington, DC: World Bank, 2024-07-16)Teachers are one of the most important inputs for learning, but in many low-income countries they are poorly distributed between schools. This paper discusses the case of Malawi, which has introduced new evidence-based policies and procedures to improve the equity and efficiency of the allocation of teachers to schools. The analysis finds that adherence to these policies has been highly variable between the country’s districts, with the most successful deploying 75 percent of teachers according to the rules and the least successful just 22 percent. Using administrative data, the paper identifies the impacts on student repetition rates of reductions in pupil–qualified teacher ratios as a result of the new teachers. The findings show that schools that moved from having more than 90 pupils per qualified teacher to a lower ratio experienced reductions in lower primary school repetition rates of 2–3 percentage points. However, similar impacts on dropout are not observed.Publication What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey(Washington, DC: World Bank, 2024-06-10)Since the introduction of free primary education in 1994, Malawi has achieved rapid expansion in access to school, but the resulting rapid growth in enrollments have outstripped the increase in resources and capacity of the system to deliver learning. The result is an education system with widespread overcrowding and large disparities in conditions, access, and learning outcomes between schools. "What Matters for Learning in Malawi? Evidence from the Malawi Longitudinal School Survey" presents one of the most comprehensive pictures ever presented of conditions, practices, and learning outcomes in a low-income country. Using data from a nationally representative, longitudinal survey of more than 500 schools; 4,000 teachers; and a gender-balanced, random sample of more than 13,000 grade 4 students, this book presents a robust analysis of the school-, teacher-, and student-level characteristics that prevent students from learning. The analysis reveals a strong relationship between the remoteness of a school’s location and inequities in school conditions, including the availability and condition of infrastructure, teaching and learning materials, finance, staffing, and supervision. Large class sizes limit the effectiveness of even skilled and highly motivated teachers. Poor learning outcomes are also evident in schools with high proportions of students who have illiterate parents; speak minority languages; are older than the typical age for their grade; and, particularly, have a poor mindset. A dedicated chapter focused on girls’ learning shows that student-level characteristics account for the majority of variation in learning outcomes; of those characteristics, gender is associated with the biggest inequities. The book introduces a new Disadvantage Index (DI) as tool to understand the ways in which multiple dimensions of disadvantage at the school level interact, and it models the impact of investing in low-cost classrooms and additional lower primary teachers at the most disadvantaged schools. What Matters for Learning in Malawi? will be of interest to researchers, educators, and policy makers who have an interest in improving learning outcomes in low-income countries and populations.Publication Are Short-Term Gains in Learning Outcomes Possible? Evidence from the Malawi Education Sector Improvement Project(Washington, DC: World Bank, 2024-07-17)This paper presents evidence of the impact of a five-year package of interconnected interventions intended to improve learning environments in eight disadvantaged districts in Malawi. The intervention, which was implemented over five years, provided additional finance to schools to support the hiring of additional teachers and construction of learning shelters to improve class sizes in lower primary, along with constructing classrooms and providing results-based finance to reward improvements in staffing. The interventions were targeted to eight districts with longstanding disadvantages in staffing, learning environments, and learning outcomes, particularly for girls. Employing administrative data and data from a nationally representative independent sample of public primary schools, the analysis finds that these investments closed the gap in learning outcomes between the targeted districts and the rest of Malawi. There is also suggestive evidence that the program reduced learning gaps between girls and boys. The findings suggest that even in a low-income environment with significant constraints, targeted efforts to reduce class sizes can close district-level gaps in learning.Publication Learning Loss as a Result of COVID-19(Washington, DC: World Bank, 2024-07-16)School closures from COVID-19 have resulted in large learning losses, from 0.05 to 0.17 standard deviations in high income countries, equivalent to two to six months of lost learning. However, the extent of primary-level learning loss in low-income countries remains unclear, studies lack information on individual students’ learning trajectories, and most do not include students who dropped out. This paper uses representative survey data from Malawi that includes unique longitudinal data on individual students (grade 4 at baseline), including those who dropped out, at three points in time: pre-COVID; 1–12 months before the seven-month school closures; and 14–20 months after schools reopened. Across math, English, and Chichewa, the local language, the average learning loss amounts to 18 months (78 points, 0.78 standard deviations), significantly higher than the loss documented in high income contexts. Decomposing this loss, the findings show that students lost 0.25 standard deviations of existing knowledge during the closure, and a further 0.23 standard deviations in foregone learning compared to the expected trajectory had schools remained open. Further loss comes from a slowdown in learning after schools reopened, with students gaining 7 points’ less new knowledge in math per 100 days, the majority of which is not explained by increased dropout. Our findings are relevant for other low-income and lower-middle income contexts: remote learning during school closure was in general ineffectual, necessitating urgent action to remediate lost learning; and children who dropped out had the highest learning losses and now require out-of-school learning opportunities.Publication Student Learning Outcomes in Tanzania’s Primary Schools(World Bank, Washington, DC, 2019-01)This policy note is an attempt to systematically analyze and document emerging trends in the evolution of students’ learning outcomes in Tanzania’s primary schools. The note is based on two rounds of the Service Delivery Indicators Survey in Tanzania, 2014 and 2016, and provides guidance to the Government on: (1) regional, district and school-level variations in gains in pupil achievement scores; (2) student, teacher and school level factors associated with learning outcomes; and (3) key observable factors associated with highest gains in test scores. The good news is that the Government’s concerted reform efforts are showing positive results in quality of schooling: test scores in English, Math, and Kiswahili for Standard four pupils have improved significantly over time. They have improved all across Tanzania, with largest gains registered in disadvantaged targeted districts (EQUIP-T3), followed by rural areas. Low-performing regions are catching up as the impacts of several large-scale investment programs are taking root. These improvements in test scores appear to be associated with improvements in teacher effort and subject knowledge. Rising pupil-teacher-ratios pose risks to continued learning improvements, particularly as the Government is preparing for rapid expansion in enrolments in the wake of the Fee-Free Basic Education Policy. Students tested for 2016 will be entering Form 1 secondary in 2018-19. For the improvements in learning at the primary level to have maximum impact, particularly in disadvantaged regions supported by EQUIP-T, they will require immediate attention to and investments in secondary schools to take these students through the full cycle of quality basic education promised by FFBEP. Female students, overage students, and non-native Kiswahili speakers continue to lag behind in learning, posing threats to the long-term equity of the system. Careful measurement of teacher practices at secondary level can provide ways to supportteaching behavior conducive to the well-being of these children.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Achieving Sustainable and Inclusive Artisanal and Small-Scale Mining (ASM)(Washington, DC: World Bank, 2024-09-16)Artisanal and small-scale mining (ASM) has played an increasingly active role in national development and international trade over the decades. As of 2024, those engaged directly and indirectly in the sector’s labor value chain make up more than 225 million people working across Latin and South America, Africa, and Asia. Studies estimate that women account for between 18 percent and 50 percent of the 45 million people who work directly in ASM. Artisanal and small-scale miners work in diverse mineral supply chains - ranging from well-known minerals and metals such as gold, cobalt, copper, and semiprecious and precious gemstones to lesser-known materials such as salt, gravel, and quarry rock. Growth in the share of artisanal or small-scale mined material has grown significantly. In short, ASM is vital to global prosperity and poverty reduction, but the sector must also lead in environmental stewardship. As heard from miners and other stakeholders, safety and well-being along with environmental stewardship, increased domestic revenues, and improved productivity will be important outcomes to judge success. These are the incentives that will help development efforts be taken up more readily and widely by ASM actors and governments themselves. World Bank support to country clients will need to be more adaptive in their funding timelines, with a view to scaling from the start to achieve outcomes in the most effective and lean way possible. Importantly, World Bank interventions should be more participatory and ASM actor-centered, given time and resources to build the trust and create incentives for behavior change.Publication Choosing Our Future(Washington, DC: World Bank, 2024-09-04)Education can propel faster and better climate action in two crucial ways. First, education can galvanize behavior change at scale - not just for tomorrow, but also for today. Second, education can unlock skills and innovation to shift economies onto greener trajectories for growth. At the same time, education needs to be protected from climate change. Extreme climate events and temperatures are already eroding hard-won progress on schooling and learning. Climate change is causing school closures, learning losses, and dropouts. These will turn into long-run inter-generational earnings losses putting into jeopardy education’s powerful potential for spurring poverty alleviation and economic growth. Governments can act now to adapt schools for climate change in cost-effective ways. This report outlines new data, evidence, and examples on how countries can harness education to propel climate action. It provides an actionable policy agenda to meet development, education, and climate goals together, recognizing that tackling climate change requires changes to individual beliefs, behaviors, and skills – changes that education is uniquely positioned to catalyze.