Publication: The Impact of an Accountability Intervention with Diagnostic Feedback: Evidence from Mexico
Loading...
Date
2015-08
ISSN
Published
2015-08
Author(s)
Editor(s)
Abstract
In 2009, the Mexican state of Colima implemented a low-stakes accountability intervention with diagnostic feedback among 108 public primary schools with the lowest test scores in the national student assessment. A difference-in-difference and a regression discontinuity design are used to identify the effects of the intervention on learning outcomes. The two alternative strategies consistently show that the intervention increased test scores by 0.12 standard deviations only a few months after the program was launched. When students, teachers, and parents in a school know that their scores are low, and this triggers a process of self-evaluation and analysis, the process itself may lead to an improvement in learning outcomes. Information on quality, without punitive measures but within a supportive and collaborative environment, appears to be sufficient to improve learning outcomes.
Link to Data Set
Citation
“de Hoyos, Rafael; Garcia-Moreno, Vicente A.; Patrinos, Harry Anthony. 2015. The Impact of an Accountability Intervention with Diagnostic Feedback: Evidence from Mexico. Policy Research Working Paper;No. 7393. © World Bank. http://hdl.handle.net/10986/22436 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Geopolitical Fragmentation and Friendshoring(Washington, DC: World Bank, 2025-06-26)This paper examines the relationship between geopolitical fragmentation and friendshoring of foreign investments over time, countries, and sectors. The analysis uses comprehensive data on foreign direct investments covering greenfield projects, mergers and acquisitions, and stocks of affiliates, as well as data on four alternative measures of geopolitical distance between countries. The gravity estimations suggest that, first, geopolitical differences have a negative effect on foreign investments and the magnitude has heightened in the post-pandemic period compared to a decade ago. Second, it is primarily the companies from advanced Western economies whose foreign investment decisions are increasingly shaped by friendshoring forces. Finally, the paper shows that friendshoring is not only confined to strategic industries, implying that allocations of foreign direct investments may not solely reflect national security or resilience considerations.Publication Soaring Food Prices Threaten Recent Economic Gains in the EU(Washington, DC: World Bank, 2025-07-02)The surge in food prices following the 2021 economic rebound has become a significant concern for households, particularly low-income ones, in Bulgaria, Croatia, Poland, and Romania. Food price inflation, which surpasses general inflation rates, risks worsening poverty and food insecurity in these countries. This paper explores the distributional impacts of rising food prices and the effectiveness of government response measures. Low-income households, who allocate a larger share of their income to food, are disproportionately affected and are struggling to cope with unexpected expenses, leading to increased difficulties in accessing proper nutrition. Simulations indicate that rising food prices contribute to higher poverty rates and greater income inequality, especially among vulnerable populations. They also suggest that the main poverty-targeted social assistance schemes offer critical support for the extreme poor, but expanding both coverage and benefits is vital to shield all at-risk individuals. Targeted policies that balance immediate relief with long-term resilience-building are essential to addressing the challenges posed by escalating food prices.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Assessing the Long-term Effects of Conditional Cash Transfers on Human Capital : Evidence from Colombia(2011-06-01)Conditional cash transfers are programs under which poor families get a stipend provided they keep their children in school and take them for health checks. Although there is significant evidence showing that they have positive impacts on school participation, little is known about the long-term impacts of the programs on human capital. This paper investigates whether cohorts of children from poor households that benefited up to nine years from Familias en Acción, a conditional cash transfer program in Colombia, attained more school and performed better on academic tests at the end of high school. Identification of program impacts is derived from two different strategies using matching techniques with household surveys, and regression discontinuity design using a census of the poor and administrative records of the program. The authors show that, on average, participant children are 4 to 8 percentage points more likely than nonparticipant children to finish high school, particularly girls and beneficiaries in rural areas. Regarding long-term impact on tests scores, the analysis shows that program recipients who graduate from high school seem to perform at the same level as equally poor non-recipient graduates, even after correcting for possible selection bias when low-performing students enter school in the treatment group. Although the positive impacts on high school graduation may improve the employment and earning prospects of participants, the lack of positive effects on test scores raises the need to further explore policy actions to couple the program's objective of increasing human capital with enhanced learning.Publication Nigeria : Bauchi Teachers(Washington, DC, 2012-01)Research suggests that teacher quality is the main school-based predictor of student achievement and that several consecutive years of outstanding teaching can offset the learning deficits of disadvantaged students (Hanushek and Rivkin, 2006; Nye et al, 2004; Park and Hannum, 2001; Rivkin et al, 2005; Rockoff, 2004; Sanders, 1998; Sanders and Rivers 1996; and Vignoles et al, 2000). However, it is not yet clear exactly which teacher policies can raise teacher effectiveness (Goldhaber, 2002 and Rivkin et al, 2005). Thus, devising effective policies to improve teaching quality remains a challenge. The eight policy goals includes the following headings: setting clear expectations for teachers; attracting the best into teaching; preparing teachers with useful training and experience; matching teachers' skills with students' needs; leading teachers with strong principals; monitoring teaching and learning; supporting teachers to improve instruction; and motivating teachers to perform.Publication Nigeria : Ekiti Teachers(Washington, DC, 2012-01)Research suggests that teacher quality is the main school-based predictor of student achievement and that several consecutive years of outstanding teaching can offset the learning deficits of disadvantaged students (Hanushek and Rivkin, 2006; Nye et al, 2004; Park and Hannum, 2001; Rivkin et al, 2005; Rockoff, 2004; Sanders, 1998; Sanders and Rivers 1996; and Vignoles et al, 2000). However, it is not yet clear exactly which teacher policies can raise teacher effectiveness (Goldhaber, 2002 and Rivkin et al, 2005). Thus, devising effective policies to improve teaching quality remains a challenge. There is increasing interest across the globe to attract, retain, develop and motivate great teachers. While the World Bank has ample experience in supporting teacher policy reforms in developing countries, until recently there was no systematic effort to offer data and analysis that can provide policy guidance on teacher policies. The focus of the initiative is the design of teacher policies as opposed to their implementation on the ground. A number of complementary activities will be looking at implementation in a sample of countries as this will involve a different methodological approach and will require more financial and human resources.Publication Transforming Indonesia's Teaching Force : Executive Summary(World Bank, 2010-04-01)The report on the transforming Indonesia's teaching force is divided in two volumes. The executive summary is the first volume of a two-volume comprehensive report on teacher management in Indonesia. This volume summarizes the key findings of the detailed technical analysis in volume two, but with much greater focus on the key areas where policy reforms will likely generate a large impact in Indonesia. While volume two is aimed at public policy researchers and technical staff of the Government of Indonesia, this shorter volume provides policy makers and the general public a condensed version of the larger report's analysis, results, and recommended policy reforms for developing a better teaching force in Indonesia. This report not only can assist the government in setting up a future reform agenda, but also add value to ongoing educational reform in Indonesia, in terms of improving the effectiveness of reform and ensuring its institutional and fiscal sustainability.Publication How Can Bulgaria Improve Its Education System? An Analysis of PISA 2012 and Past Results(Washington, DC, 2012-09-26)Bulgaria's performance on all three disciplines of the program for international student assessment (PISA) 2012 was slightly better than its PISA 2000 performance, after having dropped between 2000 and 2006. The improvements in performance between 2006 and 2012 promoted shared prosperity, but equality of opportunities is still a major challenge. In fact, disaggregating students' PISA scores across a number of variables for example, location and ethnicity - shows that large inequalities exist in Bulgaria's education system. Peer characteristics and school segregation are the key drivers of the Bulgarian education system's performance. An in-depth analysis into math and reading skills shows imbalances in performance in Bulgaria. The main areas in which Bulgaria can further improve its educational system involve: delaying the tracking of students to reduce segregation in schools; continue improving the quality of educational resources to ensure that all students learn in an environment with books, lab equipment, and technological hardware and software; encouraging longer pre-primary education for all children; learning from successful schools to improve accountability mechanisms for schools countrywide, particularly in rural areas; reevaluating the curriculum and assessment framework to better align student learning to the envisaged country goals; and promoting effective classroom management and strengthening teaching practices.
Users also downloaded
Showing related downloaded files
Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Women, Business and the Law 2024(Washington, DC: World Bank, 2024-03-04)Women, Business and the Law 2024 is the 10th in a series of annual studies measuring the enabling conditions that affect women’s economic opportunity in 190 economies. To present a more complete picture of the global environment that enables women’s socioeconomic participation, this year Women, Business and the Law introduces two new indicators—Safety and Childcare—and presents findings on the implementation gap between laws (de jure) and how they function in practice (de facto). This study presents three indexes: (1) legal frameworks, (2) supportive frameworks (policies, institutions, services, data, budget, and access to justice), and (3) expert opinions on women’s rights in practice in the areas measured. The study’s 10 indicators—Safety, Mobility, Workplace, Pay, Marriage, Parenthood, Childcare, Entrepreneurship, Assets, and Pension—are structured around the different stages of a woman’s working life. Findings from this new research can inform policy discussions to ensure women’s full and equal participation in the economy. The indicators build evidence of the critical relationship between legal gender equality and women’s employment and entrepreneurship. Data in Women, Business and the Law 2024 are current as of October 1, 2023.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Digital Public Infrastructure and Development(Washington, DC: World Bank, 2025-03-11)DPI is an approach to digitalization focused on creating “foundational, digital building blocks designed for the public benefit.” By providing essential digital functions at society scale that can be reused across sectors, DPIs enable public and private service providers to build on these systems, innovate, and roll out new services more quickly and efficiently. Common systems built as DPIs include digital identity and electronic signatures, digital payments, and data sharing. However, to provide DPI functionality, these systems must embed principles such as inclusion, openness, modularity, inclusivity, user-centricity, privacy-by-design, and strong governance. This paper provides a common framework and primer on DPI for policymakers, practitioners, WBG staff, and the broader development community, including: • DPI Concepts and Theory of Change: This includes a working definition of DPI and its core characteristics, including the role of the private sector, how DPI differs from past approaches to digitalization, and the relationship between core DPI systems, sector-specific systems, other digital technologies, and broader ecosystem enablers and safeguards. The paper also articulates the potential benefits of DPI across a range of public and private sector services, as well as risks and challenges for implementation and adoption. • Considerations for Implementation: Drawing on the experiences of a diverse set of countries across different regions, income levels, and DPI approaches, the paper identifies common trends for building, scaling, and using DPIs that are safe and inclusive. This includes identifying what we know (and do not yet know) around different DPI design choices and models, implementation strategies, procurement, issues around use case integration and sequencing of DPI, and more. • Principles and Practical Lessons: Finally, it summarizes key lessons from countries’ experiences with DPI to date, highlighting critical success factors and risk mitigation strategies for policymakers, practitioners, and development partners. A separate volume provides examples of DPI from countries around the globe. By leveraging the opportunities presented by DPI, countries can accelerate their digital transformation journeys and achieve more inclusive and sustainable development. The World Bank Group is committed to supporting this crucial endeavor. The WBG’s new Global DPI Program will address key knowledge gaps and support countries in building safe, inclusive, and transformative DPI.