Publication: Impact Evaluation in Practice, Second Edition
Loading...
Files in English
289,065 downloads
Other Files
50,597 downloads
62,385 downloads
249 downloads
2,642 downloads
Published
2016-09-13
ISSN
Date
2016-09-12
Editor(s)
Abstract
The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.
Link to Data Set
Citation
“Gertler, Paul J.; Martinez, Sebastian; Premand, Patrick; Rawlings, Laura B.; Vermeersch, Christel M. J.. 2016. Impact Evaluation in Practice, Second Edition. © World Bank. http://hdl.handle.net/10986/25030 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Impact Evaluation of Conflict Prevention and Peacebuilding Interventions(World Bank, Washington, DC, 2013-06)The international community is paying increased attention to the 25 percent of the world's population that lives in fragile and conflict affected settings, acknowledging that these settings represent daunting development challenges. To deliver better results on the ground, it is necessary to improve the understanding of the impacts and effectiveness of development interventions operating in contexts of conflict and fragility. This paper argues that it is both possible and important to carry out impact evaluations even in settings of violent conflict, and it presents some examples from a collection of impact evaluations of conflict prevention and peacebuilding interventions. The paper examines the practices of impact evaluators in the peacebuilding sector to see how they address evaluation design, data collection, and conflict analysis. Finally, it argues that such evaluations are crucial for testing assumptions about how development interventions affect change -- the so-called "theory of change" -- which is important for understanding the results on the ground.Publication Evaluating the Impact of Conditional Cash Transfer Programs : Lessons from Latin America(World Bank, Washington, DC, 2003-08)Unlike most development initiatives, conditional cash transfer programs recently introduced in the Latin America and the Caribbean region have been subject to rigorous evaluations of their effectiveness. These programs provide money to poor families, conditional on certain behavior, usually investments in human capital-such as sending children to school or bringing them to health centers on a regular basis. Rawlings and Rubio review the experience in evaluating the impact of these programs, exploring the application of experimental and quasi-experimental evaluation methods and summarizing results from programs launched in Brazil, Honduras, Jamaica, Mexico, and Nicaragua. Evaluation results from the first generation of programs in Brazil, Mexico, and Nicaragua show that conditional cash transfer programs are effective in promoting human capital accumulation among poor households. There is clear evidence of success in increasing enrollment rates, improving preventive health care, and raising household consumption. Despite this promising evidence, many questions remain unanswered about the impact of conditional cash transfer programs, including those concerning their effectiveness under different country conditions and the sustainability of the welfare impacts.Publication Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners(Washington, DC: World Bank, 2000-05)Very little is known about the actual impact of projects on the poor. Many are reluctant to carry out impact evaluations because they are deemed expensive, time consuming, and technically complex, and because the findings can be politically sensitive. Yet a rigorous evaluation can be powerful in assessing the appropriateness and effectiveness of programs. Evaluating impact is particularly critical in developing where resources are scarce and every dollar spent should aim to maximize its impact on poverty reduction. This handbook seeks to provide project managers and policy analysts with the tools needed for evaluating project impact. It is aimed at readers with a general knowledge of statistics. Chapter 1 presents an overview of concepts and methods, Chapter 2 discusses key steps and related issues to consider in implementation, Chapter 3 illustrates various analytical techniques through a case study, and Chapter 4 includes a discussion of lessons that have been reviewed for this handbook. The case studies, included in Annex I, were selected from a range of evaluations carried out by the Bank, other donor agencies, research institutions, and private consulting firms. Also included in the annexes are samples of the main components that would be necessary in planning any impact evaluation - sample terms of reference, a budget, impact indicators, a log frame, and a matrix of analysis.Publication Handbook on Impact Evaluation : Quantitative Methods and Practices(World Bank, 2010)This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.
Users also downloaded
Showing related downloaded files
Publication The Global Findex Database 2025: Connectivity and Financial Inclusion in the Digital Economy(Washington, DC: World Bank, 2025-07-16)The Global Findex 2025 reveals how mobile technology is equipping more adults around the world to own and use financial accounts to save formally, access credit, make and receive digital payments, and pursue opportunities. Including the inaugural Global Findex Digital Connectivity Tracker, this fifth edition of Global Findex presents new insights on the interactions among mobile phone ownership, internet use, and financial inclusion. The Global Findex is the world’s most comprehensive database on digital and financial inclusion. It is also the only global source of comparable demand-side data, allowing cross-country analysis of how adults access and use mobile phones, the internet, and financial accounts to reach digital information and resources, save, borrow, make payments, and manage their financial health. Data for the Global Findex 2025 were collected from nationally representative surveys of about 145,000 adults in 141 economies. The latest edition follows the 2011, 2014, 2017, and 2021 editions and includes new series measuring mobile phone ownership and internet use, digital safety, and frequency of transactions using financial services. The Global Findex 2025 is an indispensable resource for policy makers in the fields of digital connectivity and financial inclusion, as well as for practitioners, researchers, and development professionals.Publication The Spread of COVID-19 and Policy Responses(World Bank, Washington, DC, 2021-01-07)Since early 2020, the COVID-19 (coronavirus) pandemic has spread to most countries and territories around the world. For many countries, the second wave of infections is turning out to be more serious than the first. Notwithstanding the global spread of the virus, public policy responses have varied across countries and regions. This brief analyzes the spread of COVID-19 and the effectiveness of policy efforts to contain the disease across a large number of countries. The findings suggest that public health measures - especially testing - and economic support policies are associated with effective containment of the disease, and thus are supporting fundamental prerequisites for a resumption of normalcy. This brief examines the evolution of COVID-19 and public policy responses across country groups around the world; presents an econometric analysis of the relationship between the spread of infections and the policy responses; and concludes with main policy implications.Publication Refugees and Other Forcibly Displaced Populations(Washington, DC: World Bank, 2025-06-04)Forced displacement has reached unprecedented levels, with more than 120 million individuals displaced globally as of 2024 due to conflict, violence, climate change, and human rights violations. These crises are increasingly protracted, characterized by low return rates, and demand a shift from hosting models solely funded through humanitarian aid to financially sustainable, medium- to long-term strategies. This VoxDevLit synthesizes quantitative research conducted between 2010 and 2024, focusing on studies that use experimental or quasi-experimental methods to examine (1) the impacts of forced displacement on host communities and (2) the effectiveness of policies designed to support both forcibly displaced populations and their hosts. Key insights from this body of work indicate that forced displacement inflows generally exert neutral effects on native employment and wages, although vulnerable native workers—particularly those in the informal sector—may initially face challenges. Investments in inclusive social protection services that benefit both displaced populations and host communities can alleviate pressures and foster social cohesion. Additionally, cash transfers enhance immediate well-being and are most effective in the medium run when paired with initiatives that promote the economic self-reliance of forcibly displaced populations. Granting refugees the right to work has demonstrated transformative impacts on economic and well-being outcomes, while also providing a financially sustainable solution for hosting refugees over the medium to long term. Finally, addressing the mental health challenges faced by forcibly displaced populations is critical to enable them to recover their lives. This review underscores the importance of transitioning from humanitarian aid to self-reliance models, closing policy implementation gaps, and tailoring interventions to local contexts.Publication Asset and Interest Disclosure(Washington, DC: World Bank, 2023-06-28)Asset and interest disclosure of public officials is a well-established tool to prevent corruption and to help strengthen integrity in public administration. Countries use it to identify unexplained wealth, prevent conflicts of interest, and promote accountability and integrity of public officials. Asset and interest disclosure is a mechanism by which public officials must submit information about income, assets, liabilities, expenditures, and other interests of the officials and their family members. This mechanism includes many elements, including the disclosure form, the scope of declarants (filing population), methods of submission (paper or electronic), procedures of submitting the form, validation and verification of the forms, publication of information, institutional set-up to deal with the disclosure system, sanctions, and others. This technical guide focuses on the disclosure form. How and what data are requested in the form represents the disclosure system's main and most important input. It also defines declarations' role in the anticorruption value chain.Publication Rwanda Economic Update, April 2025(Washington, DC: World Bank, 2025-04-01)Rwanda’s economy remained resilient in 2024, with GDP growth reaching 8.9 percent, driven by strong performances in services, industry, and a rebound in agriculture. Despite strong export growth, the current account deficit widened due to decline in official transfers. This necessitated continued reliance on forex inflows from FDI and external concessional borrowing. Inflation moderated, averaging 4.8 percent in 2024, due to lower food prices and tight monetary policy, allowing the central bank to ease interest rates by reducing the Central Bank Rate (CBR) from 7.5 percent to 6.5 percent in 2024. The fiscal position improved with higher tax collections supporting fiscal consolidation, though public debt is projected to peak at 80 percent of GDP in 2025, despite reduced borrowing needs, before gradually declining, driven by past deficits and exchange rate depreciation. Rwanda’s agriculture sector remains a cornerstone of the economy, employing 43 percent of the workforce and contributing 27 percent to GDP. Despite diversification beyond traditional cash crops like coffee and tea, agricultural productivity remains constrained by land fragmentation, limited mechanization, post-harvest losses, and climate change impacts. While agricultural exports account for 37 percent of total export revenues, trade remains vulnerable to price fluctuations, and regional market integration is underdeveloped. The sector has much more potential to deliver higher growth, better jobs and boost forex earnings. Part 2 of this report focuses on how to unlock this potential. It examines key drivers of agricultural productivity, including input use, irrigation expansion, mechanization, and digital innovation, while evaluating persistent challenges such as limited access to finance, weak extension services, and climate vulnerability. It assesses policy efforts under the Fifth Strategic Plan for Agriculture Transformation (PSTA5), which aims to modernize production, enhance market access, and transition toward a more private sector-driven model. Key recommendations include strengthening seed systems, expanding irrigation, investing in agro-logistics, improving financial access, and implementing regulatory reforms to attract private investment. By addressing these structural bottlenecks and aligning policies with regional and global trade opportunities in the East African Community (EAC) and the African Continental Free Trade Area (AfCFTA), Rwanda can build a resilient, competitive, and sustainable agri-food sector that supports economic transformation and food security.