Publication: Impact Evaluation in International Development: Theory, Methods and Practice
Loading...
Files in English
28,197 downloads
Published
2022-03-17
ISSN
Date
2022-03-17
Author(s)
Editor(s)
Abstract
Impact evaluations are studies that attempt to measure the causal impact of a project, program, or policy on one or more outcomes. This book provides a comprehensive exposition of how to conduct impact evaluations. Part I provides an overview of impact evaluations and comprises five chapters which are accessible to readers who have few or none of the technical (statistical and econometric) skills that are needed to conduct impact evaluations. Parts II and III make use of statistical and econometric methods and are at a level similar to a graduate-student course but written to make them accessible to the ambitious reader whose skills are not at that level. Part II presents, in Chapters 6-10, a comprehensive discussion of the use of randomized controlled trials (RCTs) to conduct impact evaluations, including a general discussion of the ethical issues involved in conducting impact evaluations. Part III presents the main nonexperimental methods that are used to implement impact evaluations when RCTs are not feasible or not recommended for other reasons. Chapters 11 and 12 present regression methods, including difference-in-differences estimation. Matching methods are described in Chapter 13, after which regression discontinuity methods are covered in Chapter 14. Instrumental variable methods, including the estimation of local average treatment effects (LATE), are discussed in detail in Chapter 15. Chapters 16 and 17 cover more advanced topics: quantile treatment effects and control function methods, respectively. Part IV then considers more practical issues when conducting impact evaluations, including designing questionnaires (Chapter 18), data collection methods and survey management (Chapters 19 and 20), and disseminating results to policymakers (Chapter 21). Finally, Part V addresses two topics in impact evaluation: qualitative methods for conducting impact evaluations (Chapter 22), and cost-benefit and cost-effectiveness analysis (Chapter 23).
Link to Data Set
Citation
āGlewwe, Paul; Todd, Petra. 2022. Impact Evaluation in International Development: Theory, Methods and Practice. Ā© World Bank. http://hdl.handle.net/10986/37152 License: CC BY 3.0 IGO.ā
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Effectiveness of Interventions Aimed atImproving Womenās Employability and Quality of Work : A Critical Review(World Bank, Washington, DC, 2012-09)This paper examines the effectiveness of a variety of policy interventions that have been tried in developing and transition economies with the goal of improving women's employability and quality of work. The programs include active labor market programs, education and training programs, programs that facilitate work (such as childcare subsidies, parental leave programs and land titling programs), microfinance programs, entrepreneurship and leadership programs, and conditional cash transfer programs. Some of these policy interventions were undertaken to increase employment, some to increase female employment, and some for other reasons. All of these programs have been subjected to impact evaluations of different kinds and some also to rigorous cost-benefit analyses. Many were found to be effective in increasing women's quantity of work as measured by increased rates of labor market participation and number of hours worked. In some cases, the programs also increased women's quality of work, for example, by increasing the capacity for women to work in the formal rather than the informal sector where wages are higher and where women are more likely to have access to health, retirement, and other benefits.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Does Child Sponsorship Pay Off in Adulthood?(World Bank, Washington, DC, 2016-02)This research estimates the impact of international child sponsorship on adult income and wealth of formerly sponsored children using data on 10,144 individuals in six countries. To identify causal effects, an age-eligibility rule followed from 1980 to 1992 is utilized that limited sponsorship to children twelve years old or younger when the program was introduced in a village, allowing comparisons of sponsored children with older siblings who were slightly too old to be sponsored. Estimations indicate that international child sponsorship increased monthly income by $13ā17 over an untreated baseline of $75, principally from inducing higher future labor market participation. Results show evidence for positive impacts on dwelling quality in adulthood and modest evidence of impacts on ownership of consumer durables in adulthood, limited to increased ownership of mobile phones. Finally, results point to modest effects of child sponsorship on childbearing in adulthood.Publication The Impact of Sri Lankaās School-Based Management Program on Teachersā Pedagogical Practices and Student Learning(Taylor and Francis, 2021-12)Education is widely accepted as a key determinant of economic and social development. Developing countries have made substantial progress in increasing school enrollment rates in the last 50 years, but in many countriesā students are not learning the skills that the curriculum sets as the goals of their education. One policy that has been advocated by experts and international development agencies is school-based management. This paper investigates the effectiveness of a school-based management policy recently introduced in Sri Lanka, the Program for School Improvement (PSI). The PSI established new management structures and provided training and support services in order to: (a) devolve decisions for a range of activities to the school level; (b) increase the participation of parents and the local community in the work of the school; and (c) focus schoolsā efforts on student learning. To evaluate the effectiveness of the PSI on measures of school performance, a randomized controlled trial was conducted. Overall, the data show some evidence of changes in the behavior of both principals and teachers in the PSI schools, but most of the observed behaviors did not change. Turning to student learning as measured by test scores, there are also no statistically significant effects, although the (imprecisely) estimated impact on math scores (0.21 standard deviations) is moderately large.Publication The Impact of Early Childhood Nutritional Status on Cognitive Development : Does the Timing of Malnutrition Matter?(Washington, DC: World Bank, 2001-01)This article uses longitudinal data from the Philippines to examine whether the timing of malnutrition in early childhood is a critical factor in determining subsequent cognitive development. Although some observers have argued that the first six months of life are the most critical in the sense that malnutrition during that time period harms cognitive development more than malnutrition later in life, analysis of the Philippines data does not support this claim. To the contrary, the data suggest that malnutrition in the second year of life may have a larger negative impact than malnutrition in the first year of life.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, todayās middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the āmiddle-income trap.ā It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovationānot just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Todayās middle-income countries will have to do the same.Publication Handbook on Impact Evaluation : Quantitative Methods and Practices(World Bank, 2010)This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.Publication TĆ¼rkiye Country Climate and Development Report(Washington, DC: World Bank, 2022-06-13)Integrating climate and development is a pillar of the World Bank Groupās Climate Change Action Plan 2021-25. To advance its implementation, the Bank Group has launched a new, core diagnostic tool: the Country Climate and Development Report, a new, core diagnostic tool that analyzes how a countryās development goals can be achieved in the context of adapting to and mitigating against climate change. These reports will reflect the countryās climate commitments and identify ways to support their implementation through public and private sector solutions. They will capture the centrality of people in policies on climate change adaptation and mitigation, assessing how climate risks affect people, and ways in which governments can build resilience and address poverty, distributional and job impact of climate change and climate action. The Turkiye Country Climate and Development Report explores how climate action, in line with the countryās mitigation goal of achieving net zero emissions by 2053 as well as its adaptation and resilience needs, interact with its growth and development path and contribute to achieving the countryās development objectives, help seize opportunities offered by green technologies, protect the economy against longer-term risks such as large-scale disasters or carbon lock-in as the world transitions towards zero-carbon technologies, and support a just and inclusive transition for all.Publication Impact Evaluation in Practice, Second Edition(Washington, DC: Inter-American Development Bank and World Bank, 2016-09-13)The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.