Publication: School-Based Management and Learning Outcomes: Experimental Evidence from Colima, Mexico
Loading...
Files in English
1,103 downloads
Published
2019-06
ISSN
Date
2019-06-13
Author(s)
Editor(s)
Abstract
A school-based management program was implemented Mexico in 2001 and continued until 2014. This national program, Programa Escuelas de Calidad, was considered a key intervention to improve learning outcomes. In 2006, the national program was evaluated in the Mexican state of Colima, being the first experimental evaluation of the national program. All schools were invited to participate in the program; a random selection was performed to select the treatment and control groups among all the applicants. An intent-to-treat approach did not detect any impact on learning outcomes; a formal school-based management intervention plus a monetary grant was not enough to improve learning outcomes. First, the schools in the evaluation sample, control and treatment, were schools with high learning outcomes. Second, these schools had experienced some years of regular school-based management practices before the evaluation. A difference-in-difference design is used to identify heterogeneous effects of the program on learning outcomes. The difference-in-difference approach shows that the intensity of treatment increased test scores during the first year of the intervention.
Link to Data Set
Citation
“Garcia-Moreno, Vicente; Gertler, Paul; Patrinos, Harry Anthony. 2019. School-Based Management and Learning Outcomes: Experimental Evidence from Colima, Mexico. Policy Research Working Paper;No. 8874. © World Bank. http://hdl.handle.net/10986/31864 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Institutional Effects as Determinants of Learning Outcomes : Exploring State Variations in Mexico(World Bank, Washington, DC, 2007-07)This paper uses the OECD's Program for International Student Assessment student-level achievement database for Mexico to estimate state education production functions, controlling for student characteristics, family background, home inputs, resources, and institutions. The authors take advantage of the state-level variation and representative sample to analyze the impact of institutional factors such as state accountability systems and the role of teachers' unions in student achievement. They argue that accountability, through increased use of state assessments, will improve learning outcomes. The authors also cast light on the role of teachers' unions, namely their strength through appointments to the school and relations with state governments. The analysis shows the importance of good relations between states and unions. Furthermore, it demonstrates that accountability systems are cost-effective measures for improving outcomes.Publication Using the Oaxaca-Blinder Decomposition Technique to Analyze Learning Outcomes Changes over Time : An Application to Indonesia’s Results in PISA Mathematics(2011-03-01)The Oaxaca-Blinder technique was originally used in labor economics to decompose earnings gaps and to estimate the level of discrimination. It has been applied since in other social issues, including education, where it can be used to assess how much of a gap is due to differences in characteristics (explained variation) and how much is due to policy or system changes (unexplained variation). The authors apply the decomposition technique in an effort to analyze the increase in Indonesia's score in PISA mathematics. Between 2003 and 2006, Indonesia's score increased by 30 points, or 0.3 of a standard deviation. The test score increase is assessed in relation to family, student, school and institutional characteristics. The gap over time is decomposed into its constituent components based on the estimation of cognitive achievement production functions. The decomposition results suggest that almost the entire test score increase is explained by the returns to characteristics, mostly related to student age. However, the authors find that the adequate supply of teachers also plays a role in test score changes.Publication Decentralized Decision-making in Schools : The Theory and Evidence on School-based Management(World Bank, 2009)The school-based management (SBM) has become a very popular movement over the last decade. The World Bank's work on school-based management emerged from a need to better define the concept, review the evidence, support impact assessments in various countries, and provide feedback to project teams. The authors took detailed stock of the existing literature on school-based management and then identified several cases that the Bank was supporting in various countries. The authors present as well general guidance on how to evaluate school-based management programs. The Bank continues to support and oversee a number of impact evaluations of school-based management programs in an array of countries. Despite the clear commitment of governments and international agencies to the education sector, efficient, and equitable access remains elusive for many populations - especially for girls, indigenous peoples, and other poor and marginalized groups. Many international initiatives focus on these access issues with great commitment, but even where the vast majority of children do have access to education facilities, the quality of that education often is very poor. This fact increasingly is apparent in the scores from international learning assessments on which most students from developing countries do not excel. Evidence has shown that merely increasing resource allocation without also introducing institutional reforms in the education sector will not increase equity or improve the quality of education. One way to decentralize decision-making power in education is known popularly as SBM. There are other names for this concept, but they all refer to the decentralization of authority from the central government to the school level. SBM emphasizes the individual school (represented by any combination of principals, teachers, parents, students, and other members of the school community) as the main decision-making authority, and holds that this shift in the formulating of decisions will lead to improvement in the delivery of education.Publication The Impact of an Accountability Intervention with Diagnostic Feedback(World Bank, Washington, DC, 2015-08)In 2009, the Mexican state of Colima implemented a low-stakes accountability intervention with diagnostic feedback among 108 public primary schools with the lowest test scores in the national student assessment. A difference-in-difference and a regression discontinuity design are used to identify the effects of the intervention on learning outcomes. The two alternative strategies consistently show that the intervention increased test scores by 0.12 standard deviations only a few months after the program was launched. When students, teachers, and parents in a school know that their scores are low, and this triggers a process of self-evaluation and analysis, the process itself may lead to an improvement in learning outcomes. Information on quality, without punitive measures but within a supportive and collaborative environment, appears to be sufficient to improve learning outcomes.Publication School-Based Management, School Decision-Making and Education Outcomes in Indonesian Primary Schools(2011-09-01)This paper examines the key aspects of the practices of school-based management in Indonesia, and its effect on education quality. Using a conceptual framework of an accountability system of public service delivery, the paper explores the relations among Indonesian parents, school committees, schools, and government education supervisory bodies from three tenets: participation and voice; autonomy; and accountability. Using the data from a nationally representative survey of about 400 public primary schools in Indonesia, the paper finds that the level of parental participation and voice in school management is extremely low in Indonesia. While the role of school committees is still limited to community relations, school facilities, and other administrative areas of school management, school principals, together with teachers, are much more empowered to assert professional control of the schools. The accountability system has remained weak in Indonesia's school system, which is reflected by inadequate information flow to parents, as well as seemingly low parental awareness of the need to hold schools accountable. The accountability arrangement of the Indonesian school system currently puts more emphasis on top-down supervision and monitoring by government supervisory bodies. The findings show that although the scope of school-based management in Indonesia is limited, it has begun to help schools make the right decisions on allocation of resources and hiring additional (non-civil servant) teachers, and to create an enabling environment of learning, including increasing teacher attendance rates. These aspects are found to have significantly positive effects on student learning outcomes.
Users also downloaded
Showing related downloaded files
Publication School Management, Grants, and Test Scores(World Bank, Washington, DC, 2021-02)This paper presents the results of a large-scale randomized experiment conducted across 1,496 public primary schools in Mexico. The experiment identifies the impact on schools’ managerial capacity and student test scores of providing schools with: (a) cash grants, (b) managerial training for school principals, or (c) both. The school principals’ managerial training focused on improving principals’ capacities to collect and use data to monitor students’ basic numeracy and literacy skills and provide feedback to teachers on their instruction and pedagogical practices. After two years of implementing these interventions, the study finds that: (a) the cash grant had no impact on the student’s test scores or the management capacity of school principals; (b) the managerial training improved school principals’ managerial capacity but had no impact on students’ test scores; and (c) the combination of cash grants and managerial training amplified the effect on the school principals’ managerial capacity and had a positive but statistically insignificant impact on students’ test scores.Publication Uganda : Policy, Participation, People(Washington, DC: World Bank, 2001-05)This Country Assistance Evaluation (CAE) on Uganda departs from the customary approach and assesses the International Development Association's (IDA) assistance thematically. Attached to the CAE is a report on the findings of a participatory evaluation, which solicited stakeholder perceptions of Bank assistance. Participant focus groups were organized according to government, civil society, nongovernmental organization, private sector, and donor affiliations. This report finds that Uganda is among the top economic performers in Africa. The IDA has been a catalyst for other donors and has made a significant contribution to the country's development outcomes. Sixty-two percent of IDA projects and sixty-three percent of lending have had satisfactory outcomes, and about one-quarter of the portfolio has had substantial institutional development impact. Ugandan portfolio ratings were about as good as or better than the average ratings for Africa, but were poorer than for the Bank and IDA overall. Major challenges for the future are to reduce poverty disparities, promote rural development and service delivery, improve governance, and accelerate the development of infrastructure.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Property Rights Institutions and Investment(World Bank, Washington, D.C., 2004-05)This paper examines the channels through which alternative property rights institutions affect investment. These institutions are defined by a society's enforced laws, regulations, governance mechanisms and norms concerning the use of resources. A transaction cost framework is used to analyze the incentive impact of various types of property rights, liability rules, and rules regarding contracts. This framework is used to discuss the legal and cultural conditions necessary for the formation of productivity-enhancing organizations and the proper role of government in providing the infrastructure for private investment. A brief section examines the role of cultural and religious norms in determining the economic effectiveness of legal systems, with a focus on Islamic countries. The final section evaluates empirical approaches used to discover the specific ways property rights structures affect investment and growth.Publication Business Environment and the Incorporation Decision(World Bank, Washington, D.C., 2004-05)Using firm-level data from 52 countries, the authors investigate how a country's institutions and business environment affect firms' organizational choices and the effects of organizational form on access to finance and growth. They find that businesses are more likely to choose the corporate form in countries with developed financial sectors and efficient legal systems, strong shareholder and creditor rights, low regulatory burdens and corporate taxes, and efficient bankruptcy processes. Corporations report fewer financing, legal, and regulatory obstacles than unincorporated firms, and this advantage is greater in countries with more developed institutions and favorable business environments. The authors find some evidence of higher growth of incorporated businesses in countries with good financial and legal institutions.