Publication: Influential Evaluations: Evaluations that Improved Performance and Impacts of Development Programs
Loading...
Other Files
72 downloads
Date
2004-09-22
ISSN
Published
2004-09-22
Author(s)
Editor(s)
Abstract
This report presents 8 examples of evaluations that had a significant impact. In many cases it was possible to compare the costs of conducting the evaluation with the economic benefits produced and to show that the evaluation was a highly cost-effective management tool. The cases describe the following evaluations: Improving the efficiency of the Indian employment assurance scheme; Using citizen report cards to hold the state to account in Bangalore, India; Assessing the effectiveness of water and sanitation interventions in Flores, Indonesia; Broadening the policy framework for assessing the viability of large dams; The abolition of wheat-flour ration shops in Pakistan; Improving the delivery of primary education services in Uganda; Enhancing the performance of a major environmental project in Bulgaria; Helping re-assess China's national forest policy.
Link to Data Set
Citation
“Operations Evaluation Department. 2004. Influential Evaluations: Evaluations that Improved Performance and Impacts of Development Programs. Evaluation Capacity Development working
paper series;ECD. © World Bank. http://hdl.handle.net/10986/23974 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication The Effectiveness of World Bank Support for Community-Based and -Driven Development(Washington, DC: World Bank, 2005)This report analyzes the effectiveness of the World Bank's lending support for the growing area of community-based development (CBD) and community-driven development (CDD). The latter supports the empowerment of the poor by giving communities control over subproject resources and decisions, while CBD gives communities less responsibility and emphasizes collaboration, consultation, or sharing information with them on project activities. Since the late 1990s, the focus of Bank-supported CBD/CDD projects has shifted toward CDD, though many CDD projects also include CBD components.Publication Planning, Monitoring, and Evaluation : Methods and Tools for Poverty and Inequality Reduction Programs(World Bank, Washington, DC, 2013-01)As the author enter the second decade of the twenty-first century, governments, international organizations, nongovernmental organizations (NGOs), philanthropic organizations, and civil society groups worldwide are actively focusing on evidence-based policy and increased accountability to stakeholders (results agenda).The widespread implementation of the Results Agenda has generated a plethora of books, guides, academic papers, trainings, and case studies, which has enabled an ongoing maturation process in the field. Consequently, specialists are now better equipped to understand what works under which circumstances. Broadly speaking there are two interrelated questions which must be answered when assessing the sustainability of a government results agenda. First, is the institutional design and practice of government conducive to evidence-based policy making? Second, are the overarching monitoring and evaluation (M&E) methods and specific tools used appropriate for garnering the evidence demanded by government? These series of notes aim to make a small contribution to the latter question by summarizing and highlighting a selection of PM&E methods and the tools that governments and international organizations around the world have developed to put these into practice in their own contexts. The central goal of this initiative is to prompt a process of learning, reflection and action by providing practical information to those whose leadership role requires them to understand PM&E methods and their potential for enhancing evidence-based policy making.Publication Meta-Evaluation of IEG Evaluations (FY15-19)(Washington, DC: World Bank, 2022-02-14)IEG’s meta-evaluation serves as an input for the upcoming independent external review of its evaluations. The report focuses on aspects of credibility related to the rationale, focus, use of innovative methods, and various research design attributes as formulated in evaluation reports and their respective approach papers. Drawing on a set of 28 evaluations published from fiscal year 2015 to 2019, the meta-evaluation offers six major conclusions and suggestions based on a systematic review of evaluation scope, reliability, validity (including construct, internal, external, and data analysis validity), consistency, and the integration of innovative methods.Publication Monitoring and Evaluation(World Bank, Washington, DC, 2004-09-01)Monitoring and evaluation (M&E) of development activities provides government officials, development managers, and civil society with better means for learning from past experience, improving service delivery, planning and allocating resources, and demonstrating results as part of accountability to key stakeholders. Within the development community there is a strong focus on results, this helps explain the growing interest in M&E. Yet there is often confusion about what M&E entails. The purpose of this M&E overview is to strengthen awareness and interest in M&E, and to clarify what it entails. The M&E overview discusses: performance indicators, the logical framework approach, theory-based evaluation, formal surveys, rapid appraisal methods, participatory methods, public expenditure tracking surveys, cost-benefit and cost-effectiveness analysis, and impact evaluation.
Users also downloaded
Showing related downloaded files
Publication The Mexican Social Protection System in Health(World Bank, Washington DC, 2013-01)With a population of 113 million and a per-capita Gross Domestic Product, or GDP of US$10,064 (current U.S. dollars), Mexico is one of the largest and highest-income countries in Latin America and the Caribbean (LAC). The country has benefited from sustained economic growth during the last decade, which was temporarily interrupted by the financial and economic crisis. Real GDP is projected to grow 3.8 percent and 3.6 percent in 2012 and 2013, respectively (International Monetary Fund, or IMF 2012). Despite this growth, poverty in the country remains high; with half of the population living below the national poverty line. The country is also highly heterogeneous, with large socioeconomic differences across states and across urban and rural areas. In 2010, while the extreme poverty ratio in the Federal District and the states of Colima and Nuevo Leon was below 3 percent, in Chiapas, Guerrero, and Oaxaca it was 25 percent or higher. These large regional differences are also found in other indicators of well-being, such as years of schooling, housing conditions, and access to social services. This case study assesses key features and achievements of the Social Protection System in Health (Sistema de Proteccion Social en Salud) in Mexico, and particularly of its main pillar, Popular Health Insurance (Seguro Popular, PHI). It analyzes the contribution of this policy to the establishment and implementation of universal health coverage in Mexico. In 2003, with the reform of the General Health Law, the PHI was institutionalized as a subsidized health insurance scheme open to the population not covered by the social security schemes. Today, the PHI covers all of its intended affiliates, about 52 million peoplePublication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Crime and Violence in Central America : A Development Challenge - Main Report(World Bank, 2011-01-01)Crime and violence are now a key development issue for Central American countries. In three nations El Salvador, Guatemala, and Honduras crime rates are among the top five in Latin America. This report argues that successful strategies require actions along multiple fronts, combining prevention and criminal justice reform, together with regional approaches in the areas of drug trafficking and firearms. It also argues that interventions should be evidence based, starting with a clear understanding of the risk factors involved and ending with a careful evaluation of how any planned action might affect future options. In addition, the design of national crime reduction plans and the establishment of national cross-sectoral crime commissions are important steps to coordinate the actions of different government branches, ease cross-sectoral collaboration and prioritize resource allocation. Of equal importance is the fact that national plans offer a vehicle for the involvement of civil society organizations, in which much of the expertise in violence prevention and rehabilitation resides. Prevention efforts need to be complemented by effective law enforcement. The required reforms are no longer primarily legislative in nature because all six countries have advanced toward more transparent adversarial criminal procedures. The second-generation reforms should instead help deliver on the promises of previous reforms by: (i) strengthening key institutions and improving the quality and timeliness of the services they provide to citizens; (ii) improving efficiency and effectiveness while respecting due process and human rights; (iii) ensuring accountability and addressing corruption; (iv) increasing inter-agency collaboration; and (v) improving access to justice, especially for poor and disenfranchised groups. Specific interventions reviewed in the report include: information systems and performance indicators as a prerequisite to improve inter-institutional coordination and information sharing mechanisms; an internal overhaul of court administration and case management to create rapid reaction, one-stop shops; the strengthening of entities that provide legal counseling to the poor and to women; and the promotion of alternative dispute-resolution mechanisms and the implementation of community policing programs.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Guide to the Debt Management Performance Assessment Tool(Washington, DC, 2008-02-05)The purpose of this document is to provide guidance and supplemental information to assist with country assessments of debt management performance, using the Debt Management Performance Assessment (DeMPA) tool. The DeMPA is a methodology used for assessing public debt management performance through a comprehensive set of 15 performance indicators spanning the full range of government Debt Management (DeM) functions. It is based on the principles set out in the International Monetary Fund (IMF) and World Bank guidelines for public debt management, initially published in 2001 and updated in 2003. It is modeled after the Public Expenditure and Financial Accountability (PEFA) framework for performance measurement of public financial management. The DeMPA has been designed to be a user-friendly tool to undertake an assessment of the strengths and weaknesses in government DeM practices. This guide provides additional background and supporting information so that a no specialist in the area of debt management may undertake a country assessment effectively. The guide can be used by assessors in preparing for and undertaking an assessment. It is particularly useful for understanding the rationale for the inclusion of the indicators, the scoring methodology, and the list of supporting documents or evidence required, and the questions that could be asked for the assessment.