Publication: School-Based Management and Learning Outcomes: Experimental Evidence from Colima, Mexico
Loading...
Files in English
1,093 downloads
Published
2019-06
ISSN
Date
2019-06-13
Author(s)
Editor(s)
Abstract
A school-based management program was implemented Mexico in 2001 and continued until 2014. This national program, Programa Escuelas de Calidad, was considered a key intervention to improve learning outcomes. In 2006, the national program was evaluated in the Mexican state of Colima, being the first experimental evaluation of the national program. All schools were invited to participate in the program; a random selection was performed to select the treatment and control groups among all the applicants. An intent-to-treat approach did not detect any impact on learning outcomes; a formal school-based management intervention plus a monetary grant was not enough to improve learning outcomes. First, the schools in the evaluation sample, control and treatment, were schools with high learning outcomes. Second, these schools had experienced some years of regular school-based management practices before the evaluation. A difference-in-difference design is used to identify heterogeneous effects of the program on learning outcomes. The difference-in-difference approach shows that the intensity of treatment increased test scores during the first year of the intervention.
Link to Data Set
Citation
“Garcia-Moreno, Vicente; Gertler, Paul; Patrinos, Harry Anthony. 2019. School-Based Management and Learning Outcomes: Experimental Evidence from Colima, Mexico. Policy Research Working Paper;No. 8874. © World Bank. http://hdl.handle.net/10986/31864 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication The Lasting Effects of Working while in School(Washington, DC: World Bank, 2025-08-18)This paper provides the first experimental evidence on the long-term effects of work-study programs, leveraging a randomized lottery design from a national program in Uruguay. Participation leads to a persistent 11 percent increase in formal labor earnings, observable seven years after the program. Effects are stronger for youth who participate during pivotal educational transitions and are larger for vulnerable youth and men, while remaining positive for women and non-vulnerable youth. The program is highly cost-effective, with average impacts exceeding those of job training programs and comparable to early childhood investments.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Institutional Effects as Determinants of Learning Outcomes : Exploring State Variations in Mexico(World Bank, Washington, DC, 2007-07)This paper uses the OECD's Program for International Student Assessment student-level achievement database for Mexico to estimate state education production functions, controlling for student characteristics, family background, home inputs, resources, and institutions. The authors take advantage of the state-level variation and representative sample to analyze the impact of institutional factors such as state accountability systems and the role of teachers' unions in student achievement. They argue that accountability, through increased use of state assessments, will improve learning outcomes. The authors also cast light on the role of teachers' unions, namely their strength through appointments to the school and relations with state governments. The analysis shows the importance of good relations between states and unions. Furthermore, it demonstrates that accountability systems are cost-effective measures for improving outcomes.Publication Using the Oaxaca-Blinder Decomposition Technique to Analyze Learning Outcomes Changes over Time : An Application to Indonesia’s Results in PISA Mathematics(2011-03-01)The Oaxaca-Blinder technique was originally used in labor economics to decompose earnings gaps and to estimate the level of discrimination. It has been applied since in other social issues, including education, where it can be used to assess how much of a gap is due to differences in characteristics (explained variation) and how much is due to policy or system changes (unexplained variation). The authors apply the decomposition technique in an effort to analyze the increase in Indonesia's score in PISA mathematics. Between 2003 and 2006, Indonesia's score increased by 30 points, or 0.3 of a standard deviation. The test score increase is assessed in relation to family, student, school and institutional characteristics. The gap over time is decomposed into its constituent components based on the estimation of cognitive achievement production functions. The decomposition results suggest that almost the entire test score increase is explained by the returns to characteristics, mostly related to student age. However, the authors find that the adequate supply of teachers also plays a role in test score changes.Publication Decentralized Decision-making in Schools : The Theory and Evidence on School-based Management(World Bank, 2009)The school-based management (SBM) has become a very popular movement over the last decade. The World Bank's work on school-based management emerged from a need to better define the concept, review the evidence, support impact assessments in various countries, and provide feedback to project teams. The authors took detailed stock of the existing literature on school-based management and then identified several cases that the Bank was supporting in various countries. The authors present as well general guidance on how to evaluate school-based management programs. The Bank continues to support and oversee a number of impact evaluations of school-based management programs in an array of countries. Despite the clear commitment of governments and international agencies to the education sector, efficient, and equitable access remains elusive for many populations - especially for girls, indigenous peoples, and other poor and marginalized groups. Many international initiatives focus on these access issues with great commitment, but even where the vast majority of children do have access to education facilities, the quality of that education often is very poor. This fact increasingly is apparent in the scores from international learning assessments on which most students from developing countries do not excel. Evidence has shown that merely increasing resource allocation without also introducing institutional reforms in the education sector will not increase equity or improve the quality of education. One way to decentralize decision-making power in education is known popularly as SBM. There are other names for this concept, but they all refer to the decentralization of authority from the central government to the school level. SBM emphasizes the individual school (represented by any combination of principals, teachers, parents, students, and other members of the school community) as the main decision-making authority, and holds that this shift in the formulating of decisions will lead to improvement in the delivery of education.Publication The Impact of an Accountability Intervention with Diagnostic Feedback(World Bank, Washington, DC, 2015-08)In 2009, the Mexican state of Colima implemented a low-stakes accountability intervention with diagnostic feedback among 108 public primary schools with the lowest test scores in the national student assessment. A difference-in-difference and a regression discontinuity design are used to identify the effects of the intervention on learning outcomes. The two alternative strategies consistently show that the intervention increased test scores by 0.12 standard deviations only a few months after the program was launched. When students, teachers, and parents in a school know that their scores are low, and this triggers a process of self-evaluation and analysis, the process itself may lead to an improvement in learning outcomes. Information on quality, without punitive measures but within a supportive and collaborative environment, appears to be sufficient to improve learning outcomes.Publication School-Based Management, School Decision-Making and Education Outcomes in Indonesian Primary Schools(2011-09-01)This paper examines the key aspects of the practices of school-based management in Indonesia, and its effect on education quality. Using a conceptual framework of an accountability system of public service delivery, the paper explores the relations among Indonesian parents, school committees, schools, and government education supervisory bodies from three tenets: participation and voice; autonomy; and accountability. Using the data from a nationally representative survey of about 400 public primary schools in Indonesia, the paper finds that the level of parental participation and voice in school management is extremely low in Indonesia. While the role of school committees is still limited to community relations, school facilities, and other administrative areas of school management, school principals, together with teachers, are much more empowered to assert professional control of the schools. The accountability system has remained weak in Indonesia's school system, which is reflected by inadequate information flow to parents, as well as seemingly low parental awareness of the need to hold schools accountable. The accountability arrangement of the Indonesian school system currently puts more emphasis on top-down supervision and monitoring by government supervisory bodies. The findings show that although the scope of school-based management in Indonesia is limited, it has begun to help schools make the right decisions on allocation of resources and hiring additional (non-civil servant) teachers, and to create an enabling environment of learning, including increasing teacher attendance rates. These aspects are found to have significantly positive effects on student learning outcomes.
Users also downloaded
Showing related downloaded files
Publication Commodity Markets Outlook, April 2025(Washington, DC: World Bank, 2025-04-29)Commodity prices are set to fall sharply this year, by about 12 percent overall, as weakening global economic growth weighs on demand. In 2026, commodity prices are projected to reach a six-year low. Oil prices are expected to exert substantial downward pressure on the aggregate commodity index in 2025, as a marked slowdown in global oil consumption coincides with expanding supply. The anticipated commodity price softening is broad-based, however, with more than half of the commodities in the forecast set to decrease this year, many by more than 10 percent. The latest shocks to hit commodity markets extend a so far tumultuous decade, marked by the highest level of commodity price volatility in at least half a century. Between 2020 and 2024, commodity price swings were frequent and sharp, with knock-on consequences for economic activity and inflation. In the next two years, commodity prices are expected to put downward pressure on global inflation. Risks to the commodity price projections are tilted to the downside. A sharper-than-expected slowdown in global growth—driven by worsening trade relations or a prolonged tightening of financial conditions—could further depress commodity demand, especially for industrial products. In addition, if OPEC+ fully unwinds its voluntary supply cuts, oil production will far exceed projected consumption. There are also important upside risks to commodity prices—for instance, if geopolitical tensions worsen, threatening oil and gas supplies, or if extreme weather events lead to agricultural and energy price spikes.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Poverty, Prosperity, and Planet Report 2024(Washington, DC: World Bank, 2024-10-15)The Poverty, Prosperity, and Planet Report 2024 is the latest edition of the series formerly known as Poverty and Shared Prosperity. The report emphasizes that reducing poverty and increasing shared prosperity must be achieved in ways that do not come at unacceptably high costs to the environment. The current “polycrisis”—where the multiple crises of slow economic growth, increased fragility, climate risks, and heightened uncertainty have come together at the same time—makes national development strategies and international cooperation difficult. Offering the first post-Coronavirus (COVID)-19 pandemic assessment of global progress on this interlinked agenda, the report finds that global poverty reduction has resumed but at a pace slower than before the COVID-19 crisis. Nearly 700 million people worldwide live in extreme poverty with less than US$2.15 per person per day. Progress has essentially plateaued amid lower economic growth and the impacts of COVID-19 and other crises. Today, extreme poverty is concentrated mostly in Sub-Saharan Africa and fragile settings. At a higher standard more typical of upper-middle-income countries—US$6.85 per person per day—almost one-half of the world is living in poverty. The report also provides evidence that the number of countries that have high levels of income inequality has declined considerably during the past two decades, but the pace of improvements in shared prosperity has slowed, and that inequality remains high in Latin America and the Caribbean and Sub-Saharan Africa. Worldwide, people’s incomes today would need to increase fivefold on average to reach a minimum prosperity threshold of US$25 per person per day. Where there has been progress in poverty reduction and shared prosperity, there is evidence of an increasing ability of countries to manage natural hazards, but climate risks are significantly higher in the poorest settings. Nearly one in five people globally is at risk of experiencing welfare losses due to an extreme weather event from which they will struggle to recover. The interconnected issues of climate change and poverty call for a united and inclusive effort from the global community. Development cooperation stakeholders—from governments, nongovernmental organizations, and the private sector to communities and citizens acting locally in every corner of the globe—hold pivotal roles in promoting fair and sustainable transitions. By emphasizing strategies that yield multiple benefits and diligently monitoring and addressing trade-offs, we can strive toward a future that is prosperous, equitable, and resilient.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.