Publication: Measuring and Explaining Management in Schools: New Approaches Using Public Data
Loading...
Files in English
1,369 downloads
Published
2019-11
ISSN
Date
2019-11-21
Author(s)
Editor(s)
Abstract
Why do some students learn more in some schools than others? One consideration receiving growing attention is school management. To study this, researchers need to be able to measure school management accurately and cheaply at scale, and also explain any observed relationship between school management and student learning. This paper introduces a new approach to measurement using existing public data, and applies it to build a management index covering 15,000 schools across 65 countries, and another index covering nearly all public schools in Brazil. Both indices show a strong, positive relationship between school management and student learning. The paper then develops a simple model that formalizes the intuition that strong management practices might be driving learning gains via incentive and selection effects among teachers, students and parents. The paper shows that the predictions of this model hold in public data for Latin America, and draws out implications for policy.
Link to Data Set
Citation
“Leaver, Clare; Lemos, Renata; Scur, Daniela. 2019. Measuring and Explaining Management in Schools: New Approaches Using Public Data. Policy Research Working Paper;No. 9053. © World Bank. http://hdl.handle.net/10986/32662 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication External Finance in Emerging Markets and Developing Economies: A Tale of Differences in Vulnerabilities(Washington, DC: World Bank, 2025-12-04)Over the past two decades, many emerging markets and developing economies have been viewed as increasingly resilient to external financial shocks. This paper assesses whether such resilience is broadly shared across emerging markets and developing economies by classifying them into three tiers based on economic size, income level, institutional strength, and financial integration. The analysis shows that first-tier emerging markets and developing economies have improved their external balance sheets and reduced dependence on official support. However, second- and third-tier emerging markets and developing economies have experienced growing external vulnerabilities since the global financial crisis, marked by rising external debt liabilities and declining foreign exchange reserves. Using a range of indicators, including sovereign defaults, arrears, partial defaults, and International Monetary Fund lending, the paper identifies episodes of external financial distress and shows that distress remains widespread among second- and third-tier emerging markets and developing economies. The empirical analysis confirms that key components of the net international investment position—especially external debt and foreign exchange reserves—predict the onset of external financial distress, with institutional quality shaping the impact. Weak institutions amplify risks, while strong institutions mitigate them. These findings highlight the importance of recognizing heterogeneity across emerging markets and developing economies, strengthening institutional quality alongside external balance-sheet management, and rebuilding buffers to safeguard against renewed global financial stress.Publication Rigging the Scores: Corruption through Scoring Rule Manipulation in Public Procurement Auctions(Washington, DC: World Bank, 2025-12-02)Public procurement is highly susceptible to corruption, especially in developing countries. Although open auctions are widely adopted to curb it, this paper finds that corruption remains prevalent even within this procurement format. Procurement officers can collaborate with firms to manipulate scoring rules, ensuring predetermined winners, while corrupt firms submit noncompetitive bids to meet minimum bidder requirements. Using extensive data from Chinese public procurement auctions, the paper introduces model-driven statistical tools to detect such corruption, identifying a corruption rate of 65 percent. A procurement expert audit survey confirms the tools’ reliability, with a 91 percent probability that experts recognize suspicious scoring rules when flagged. Firm-level analysis reveals that local, state-owned, and less productive firms are favored in corrupt auctions. Lastly, the paper explores policy implications. Analysis of the national anti-corruption campaign since 2012 suggests that general investigations may be insufficient to address deeply ingrained corrupt practices. Using counterfactuals based on an estimated structural model, the paper shows that implementing anonymous call-for-tender evaluations could improve social welfare by 10 percent by eliminating suspicious rules and encouraging broader participation.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication School-Based Management, School Decision-Making and Education Outcomes in Indonesian Primary Schools(2011-09-01)This paper examines the key aspects of the practices of school-based management in Indonesia, and its effect on education quality. Using a conceptual framework of an accountability system of public service delivery, the paper explores the relations among Indonesian parents, school committees, schools, and government education supervisory bodies from three tenets: participation and voice; autonomy; and accountability. Using the data from a nationally representative survey of about 400 public primary schools in Indonesia, the paper finds that the level of parental participation and voice in school management is extremely low in Indonesia. While the role of school committees is still limited to community relations, school facilities, and other administrative areas of school management, school principals, together with teachers, are much more empowered to assert professional control of the schools. The accountability system has remained weak in Indonesia's school system, which is reflected by inadequate information flow to parents, as well as seemingly low parental awareness of the need to hold schools accountable. The accountability arrangement of the Indonesian school system currently puts more emphasis on top-down supervision and monitoring by government supervisory bodies. The findings show that although the scope of school-based management in Indonesia is limited, it has begun to help schools make the right decisions on allocation of resources and hiring additional (non-civil servant) teachers, and to create an enabling environment of learning, including increasing teacher attendance rates. These aspects are found to have significantly positive effects on student learning outcomes.Publication School Autonomy and Accountability(2011-04-27)The objective of this paper is to present an assessment scale for benchmarking school autonomy and accountability. This scale is one of the tools being developed under system assessment and benchmarking for education results (SABER) initiative created by the World Bank as part of its education strategy. The purpose of this scale is to reinforce the monitoring and evaluation of education system performance to foster a better environment for teaching and learning. The goal of this effort is to align the personal and managerial incentives at the school level to produce increased student learning. The application of the assessment scale can be an important tool for education system reform if it is used as an instrument for planning and monitoring the enabling conditions for improving system performance. As such, it starts with the assumption that increased school autonomy and improved accountability are necessary conditions for improved learning because they align teacher and parent incentives. This assertion is consistent with the SABER framework for fostering better school performance that includes three important factors: (a) the periodic measurement of learning outcomes and of teacher performance as the basis for school accountability, (b) the use of school and student performance indicators that can be compared across localities and across time, and (c) the use of rewards and sanctions and policy interventions for aligning personal and school incentives with improved student performance.Publication Decentralized Decision-making in Schools : The Theory and Evidence on School-based Management(World Bank, 2009)The school-based management (SBM) has become a very popular movement over the last decade. The World Bank's work on school-based management emerged from a need to better define the concept, review the evidence, support impact assessments in various countries, and provide feedback to project teams. The authors took detailed stock of the existing literature on school-based management and then identified several cases that the Bank was supporting in various countries. The authors present as well general guidance on how to evaluate school-based management programs. The Bank continues to support and oversee a number of impact evaluations of school-based management programs in an array of countries. Despite the clear commitment of governments and international agencies to the education sector, efficient, and equitable access remains elusive for many populations - especially for girls, indigenous peoples, and other poor and marginalized groups. Many international initiatives focus on these access issues with great commitment, but even where the vast majority of children do have access to education facilities, the quality of that education often is very poor. This fact increasingly is apparent in the scores from international learning assessments on which most students from developing countries do not excel. Evidence has shown that merely increasing resource allocation without also introducing institutional reforms in the education sector will not increase equity or improve the quality of education. One way to decentralize decision-making power in education is known popularly as SBM. There are other names for this concept, but they all refer to the decentralization of authority from the central government to the school level. SBM emphasizes the individual school (represented by any combination of principals, teachers, parents, students, and other members of the school community) as the main decision-making authority, and holds that this shift in the formulating of decisions will lead to improvement in the delivery of education.Publication School Access, Resources, and Learning Outcomes(World Bank, Washington, DC, 2011-05)This study reports evidence from an unusual policy intervention- The Reaching Out of School Children (ROSC) project in Bangladesh where school grants and education allowances are offered to attract hard-to-reach children to schools comprised of a single teacher and a classroom. The operating unit cost of these schools is a fraction of that of formal primary schools. Panel data is used to investigate whether ROSC schools are effective in raising enrolment and learning outcomes. The findings suggest that there is a modest impact on school participation: ROSC schools increase enrolment probability between 9 and 18 percent for children in the two age cohorts 6 to 8 and 6 to 10. They perform as well as non-ROSC schools in terms of raising test scores, and even have positive impacts on academically stronger students. There is also strong evidence of positive externalities on non-ROSC schools in program areas. These results point to the effectiveness of a new model of non-formal primary schools that can be replicated in similar settings. This paper consists of following sections: section one gives introduction. The context for the country and the program description is provided in section two, and the data is described in section three. The impacts of the ROSC project on education outcomes as measured by student enrolment and test scores are discussed in section four and other program effects are considered in section five, with the empirical estimation frameworks being respectively detailed in each section. The relative efficiency of ROSC schools versus non-ROSC schools is discussed in section six and section seven gives conclusion.Publication School Autonomy and Accountability in Thailand : A Systems Approach for Assessing Policy Intent and Implementation(World Bank Group, Washington, DC, 2014-08)There is a consensus on the need for Thailand to reform its education system to be able to compete with other high performing countries in the region. In terms of learning outcomes, the most recent evidence from the Programme for International Student Assessment shows little improvement over time. This paper uses the World Bank's Systems Approach for Better Education Results (SABER) approach in Thailand to contrast policy intent and policy implementation in school autonomy and accountability. The policy implementation data were obtained from a survey of school principals of the schools that participated in the Programme for International Student Assessment and merged the data sets. First, the study analyzes the gap between policy intent and policy implementation. Then it examines the effect of the gaps on various schooling outcomes while controlling for covariates. The analysis finds significant differences between the Systems Approach for Better Education Results indicators of policy intent and policy implementation in all areas assessed by the indicators. Schools in Thailand exercise more flexibility in their personnel management in practice than what is intended by policy; student assessments need to address issues of content, reliability, and validity and school accountability needs to improve the interpretation of student assessments to make schools more accountable. There is a positive association between the Programme for International Student Assessment scores and school autonomy and accountability.
Users also downloaded
Showing related downloaded files
Publication Sourcebook on the Foundations of Social Protection Delivery Systems(Washington, DC: World Bank, 2020-07-30)The Sourcebook synthesizes real-world experiences and lessons learned of social protection delivery systems from around the world, with a particular focus on social and labor benefits and services. It takes a practical approach, seeking to address concrete “how-to” questions, including: How do countries deliver social protection benefits and services? How do they do so effectively and efficiently? How do they ensure dynamic inclusion, especially for the most vulnerable and needy? How do they promote better coordination and integration—not only among social protection programs but also programs in other parts of government? How can they meet the needs of their intended populations and provide a better client experience? The Sourcebook structures itself around eight key principles that can frame the delivery systems mindset: (1) delivery systems evolve over time, do so in a non-linear fashion, and are affected by the starting point(s); (2) additional efforts should be made to “do simple well”, and to do so from the start rather than trying to remedy by after-the-fact adding-on of features or aspects; (3) quality implementation matters, and weaknesses in the design or structure of any core system element will negatively impact delivery; (4) defining the “first mile” for people interface greatly affects the system and overall delivery, and is most improved when that “first mile” is understood as the weakest link in delivery systems); (5) delivery systems do not operate in a vacuum and thus should not be developed in silos; (6) delivery systems can contribute more broadly to government’s ability to intervene in other sectors, such as health insurance subsidies, scholarships, social energy tariffs, housing benefits, and legal services; (7) there is no single blueprint for delivery systems, but there are commonalities and those common elements constitute the core of the delivery systems framework; (8) inclusion and coordination are pervasive and perennial dual challenges, and they contribute to the objectives of effectiveness and efficiency.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2008(Washington, DC, 2007)The world's demand for food is expected to double within the next 50 years, while the natural resources that sustain agriculture will become increasingly scarce, degraded, and vulnerable to the effects of climate change. In many poor countries, agriculture accounts for at least 40 percent of GDP and 80 percent of employment. At the same time, about 70 percent of the world's poor live in rural areas and most depend on agriculture for their livelihoods. World Development Report 2008 seeks to assess where, when, and how agriculture can be an effective instrument for economic development, especially development that favors the poor. It examines several broad questions: How has agriculture changed in developing countries in the past 20 years? What are the important new challenges and opportunities for agriculture? Which new sources of agricultural growth can be captured cost effectively in particular in poor countries with large agricultural sectors as in Africa? How can agricultural growth be made more effective for poverty reduction? How can governments facilitate the transition of large populations out of agriculture, without simply transferring the burden of rural poverty to urban areas? How can the natural resource endowment for agriculture be protected? How can agriculture's negative environmental effects be contained? This year's report marks the 30th year the World Bank has been publishing the World Development Report.Publication Europe and Central Asia Economic Update, Fall 2024: Better Education for Stronger Growth(Washington, DC: World Bank, 2024-10-17)Economic growth in Europe and Central Asia (ECA) is likely to moderate from 3.5 percent in 2023 to 3.3 percent this year. This is significantly weaker than the 4.1 percent average growth in 2000-19. Growth this year is driven by expansionary fiscal policies and strong private consumption. External demand is less favorable because of weak economic expansion in major trading partners, like the European Union. Growth is likely to slow further in 2025, mostly because of the easing of expansion in the Russian Federation and Turkiye. This Europe and Central Asia Economic Update calls for a major overhaul of education systems across the region, particularly higher education, to unleash the talent needed to reinvigorate growth and boost convergence with high-income countries. Universities in the region suffer from poor management, outdated curricula, and inadequate funding and infrastructure. A mismatch between graduates' skills and the skills employers are seeking leads to wasted potential and contributes to the region's brain drain. Reversing the decline in the quality of education will require prioritizing improvements in teacher training, updated curricula, and investment in educational infrastructure. In higher education, reforms are needed to consolidate university systems, integrate them with research centers, and provide reskilling opportunities for adult workers.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.