Publication: Impact Evaluation in International Development: Theory, Methods and Practice
Loading...
Files in English
27,431 downloads
Date
2022-03-17
ISSN
Published
2022-03-17
Author(s)
Editor(s)
Abstract
Impact evaluations are studies that attempt to measure the causal impact of a project, program, or policy on one or more outcomes. This book provides a comprehensive exposition of how to conduct impact evaluations. Part I provides an overview of impact evaluations and comprises five chapters which are accessible to readers who have few or none of the technical (statistical and econometric) skills that are needed to conduct impact evaluations. Parts II and III make use of statistical and econometric methods and are at a level similar to a graduate-student course but written to make them accessible to the ambitious reader whose skills are not at that level. Part II presents, in Chapters 6-10, a comprehensive discussion of the use of randomized controlled trials (RCTs) to conduct impact evaluations, including a general discussion of the ethical issues involved in conducting impact evaluations. Part III presents the main nonexperimental methods that are used to implement impact evaluations when RCTs are not feasible or not recommended for other reasons. Chapters 11 and 12 present regression methods, including difference-in-differences estimation. Matching methods are described in Chapter 13, after which regression discontinuity methods are covered in Chapter 14. Instrumental variable methods, including the estimation of local average treatment effects (LATE), are discussed in detail in Chapter 15. Chapters 16 and 17 cover more advanced topics: quantile treatment effects and control function methods, respectively. Part IV then considers more practical issues when conducting impact evaluations, including designing questionnaires (Chapter 18), data collection methods and survey management (Chapters 19 and 20), and disseminating results to policymakers (Chapter 21). Finally, Part V addresses two topics in impact evaluation: qualitative methods for conducting impact evaluations (Chapter 22), and cost-benefit and cost-effectiveness analysis (Chapter 23).
Link to Data Set
Citation
āGlewwe, Paul; Todd, Petra. 2022. Impact Evaluation in International Development: Theory, Methods and Practice. Ā© World Bank. http://hdl.handle.net/10986/37152 License: CC BY 3.0 IGO.ā
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Effectiveness of Interventions Aimed atImproving Womenās Employability and Quality of Work : A Critical Review(World Bank, Washington, DC, 2012-09)This paper examines the effectiveness of a variety of policy interventions that have been tried in developing and transition economies with the goal of improving women's employability and quality of work. The programs include active labor market programs, education and training programs, programs that facilitate work (such as childcare subsidies, parental leave programs and land titling programs), microfinance programs, entrepreneurship and leadership programs, and conditional cash transfer programs. Some of these policy interventions were undertaken to increase employment, some to increase female employment, and some for other reasons. All of these programs have been subjected to impact evaluations of different kinds and some also to rigorous cost-benefit analyses. Many were found to be effective in increasing women's quantity of work as measured by increased rates of labor market participation and number of hours worked. In some cases, the programs also increased women's quality of work, for example, by increasing the capacity for women to work in the formal rather than the informal sector where wages are higher and where women are more likely to have access to health, retirement, and other benefits.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Does Child Sponsorship Pay Off in Adulthood?(World Bank, Washington, DC, 2016-02)This research estimates the impact of international child sponsorship on adult income and wealth of formerly sponsored children using data on 10,144 individuals in six countries. To identify causal effects, an age-eligibility rule followed from 1980 to 1992 is utilized that limited sponsorship to children twelve years old or younger when the program was introduced in a village, allowing comparisons of sponsored children with older siblings who were slightly too old to be sponsored. Estimations indicate that international child sponsorship increased monthly income by $13ā17 over an untreated baseline of $75, principally from inducing higher future labor market participation. Results show evidence for positive impacts on dwelling quality in adulthood and modest evidence of impacts on ownership of consumer durables in adulthood, limited to increased ownership of mobile phones. Finally, results point to modest effects of child sponsorship on childbearing in adulthood.Publication The Impact of Sri Lankaās School-Based Management Program on Teachersā Pedagogical Practices and Student Learning(Taylor and Francis, 2021-12)Education is widely accepted as a key determinant of economic and social development. Developing countries have made substantial progress in increasing school enrollment rates in the last 50 years, but in many countriesā students are not learning the skills that the curriculum sets as the goals of their education. One policy that has been advocated by experts and international development agencies is school-based management. This paper investigates the effectiveness of a school-based management policy recently introduced in Sri Lanka, the Program for School Improvement (PSI). The PSI established new management structures and provided training and support services in order to: (a) devolve decisions for a range of activities to the school level; (b) increase the participation of parents and the local community in the work of the school; and (c) focus schoolsā efforts on student learning. To evaluate the effectiveness of the PSI on measures of school performance, a randomized controlled trial was conducted. Overall, the data show some evidence of changes in the behavior of both principals and teachers in the PSI schools, but most of the observed behaviors did not change. Turning to student learning as measured by test scores, there are also no statistically significant effects, although the (imprecisely) estimated impact on math scores (0.21 standard deviations) is moderately large.Publication The Impact of Early Childhood Nutritional Status on Cognitive Development : Does the Timing of Malnutrition Matter?(Washington, DC: World Bank, 2001-01)This article uses longitudinal data from the Philippines to examine whether the timing of malnutrition in early childhood is a critical factor in determining subsequent cognitive development. Although some observers have argued that the first six months of life are the most critical in the sense that malnutrition during that time period harms cognitive development more than malnutrition later in life, analysis of the Philippines data does not support this claim. To the contrary, the data suggest that malnutrition in the second year of life may have a larger negative impact than malnutrition in the first year of life.
Users also downloaded
Showing related downloaded files
Publication Innovations in Tax Compliance(Washington, DC: World Bank, 2022-02-17)Recent decades have seen important progress in strengthening country tax systems. Yet many areas of reform have remained stubbornly resistant to major improvements. Overall, revenue collection still falls short of that needed for effective governance and service delivery. Tax collection is too often riddled with high rates of evasion among large corporations and the rich and by disproportionate, though often hidden, burdens on lower-income groups. As countries around the world deal with the large debt burdens induced by COVID-19, an in-depth look at how to strengthen tax systems is especially timely. Innovations in Tax Compliance: Building Trust, Navigating Politics, and Tailoring Reform takes a fresh look at tax reform. The authors draw on recent research and experience for their new conceptual framework to guide more effective approaches to reform. Building on the achievements of recent decades, they argue for a greater emphasis on the overlapping goals of building trust, navigating political resistance, and tailoring reform to unique local contextsāan emphasis achieved by identifying the most binding constraints on reform. This focus not only can lead to greater compliance, a fairer system, and higher revenues, but also can contribute to building state capacity, sustained political support for further reforms, and a stronger fiscal contract between citizens and governments.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Performance-Based Financing Toolkit(Washington, DC: World Bank, 2014-02-26)Performance-based financing (PBF) approaches have expanded rapidly in lower-and middle income countries, and especially in Africa. The number of countries has grown from three in 2006 to 32 in 2013. PBF schemes are flourishing and cause considerable demand for technical assistance in executing these health reforms in a rational and accountable manner. Currently there is a lack of knowledge among many health reformers of how to implement performance-based financing pilot projects, and scale them up intelligently. In a context of tremendous demand for solid design and implementation experience and given the rapid expansion of results-based financing (RBF) programs, there is an urgent need to build capacity in designing and implementing PBF programs. As yet there has been little attempt to gather the learning from these experiences together in one volume and, moreover, in a form that serves as a guide to implementers. This toolkit answers the most pressing issues related to the supply-side RBF programs of which PBF forms part.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000ā22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: Ā· By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. Ā· By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bankās operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Implementation Know-how Briefs to Support Countries to Prioritize, Connect and Scale for a Digital-in-Health Future(Washington, DC: World Bank, 2023-08-18)Technology and data are integral to daily life. As health systems face increasing demands to deliver new, more, better, and seamless services affordable to all people, data and technology are essential. With the potential and perils of innovations like artificial intelligence the future of health care is expected to be technology-embedded and data-linked. This shift involves expanding the focus from digitization of health data to integrating digital and health as one: Digital-in-Health. The World Bankās report, Digital-in-Health: Unlocking the Value for Everyone, calls for a new digital-in-health approach where digital technology and data are infused into every aspect of health systems management and health service delivery for better health outcomes. The report proposes ten recommendations across three priority areas for governments to invest in: prioritize, connect and scale. The Implementation Know-How Briefs serve as practical guides for countries as they implement the ten recommendations. Every Implementation Know-How Brief provides practical information to start planning and implementing how to implement the recommendations. It also contains key terminologies for those not familiar with a particular topic, provides key questions to ask, and a general orientation as to typical issues in these sectors. Topics covered are: 1.) Digital health assessments; 2.) Telemedicine and virtual health care; 3.) Private sector involvement in digital health; 4.) Interoperability in health sector; 5.) Data governance for health data; 6.) Cybersecurity for health sector; 7.) Digital health records; 8.) Determining value of digital technology in health; 9.) Certification and regulatory sandboxes for digital technologies in health; 10.) Workflow mapping for digital technology (re)design in health systems.