Publication: Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners
Loading...
Published
2000-05
ISSN
Date
2013-06-17
Author(s)
Editor(s)
Abstract
Very little is known about the actual impact of projects on the poor. Many are reluctant to carry out impact evaluations because they are deemed expensive, time consuming, and technically complex, and because the findings can be politically sensitive. Yet a rigorous evaluation can be powerful in assessing the appropriateness and effectiveness of programs. Evaluating impact is particularly critical in developing where resources are scarce and every dollar spent should aim to maximize its impact on poverty reduction. This handbook seeks to provide project managers and policy analysts with the tools needed for evaluating project impact. It is aimed at readers with a general knowledge of statistics. Chapter 1 presents an overview of concepts and methods, Chapter 2 discusses key steps and related issues to consider in implementation, Chapter 3 illustrates various analytical techniques through a case study, and Chapter 4 includes a discussion of lessons that have been reviewed for this handbook. The case studies, included in Annex I, were selected from a range of evaluations carried out by the Bank, other donor agencies, research institutions, and private consulting firms. Also included in the annexes are samples of the main components that would be necessary in planning any impact evaluation - sample terms of reference, a budget, impact indicators, a log frame, and a matrix of analysis.
Link to Data Set
Citation
“Baker, Judy L.. 2000. Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners. Directions in development;. © World Bank. http://hdl.handle.net/10986/13949 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Strengthening Competitiveness In Bangladesh—Thematic Assessment(Washington, DC: World Bank, 2016-07-15)This is volume 2 of a three-volume publication on Bangladesh’s trade prospects. Bangladesh’s ambition is to build on its very solid growth and poverty reduction achievements, and accelerate growth to become a middle income country by 2021, and share prosperity more widely amongst its citizens. This includes one of its greatest development challenges: to provide gainful employment to the over 2 million people that will join the labor force each year over the next decade. Moreover, only 54.1 million of its 94 million working age people are employed. Bangladesh needs to use its labor endowment even more intensively to increase growth and, in turn, to absorb the incoming labor. The Diagnostic Trade Integration Study identifies the following actions centered around four pillars to sustain and accelerate export growth: (1) breaking into new markets through a) better trade logistics to reduce delivery lags ; as world markets become more competitive and newer products demand shorter lead times, to generate new sources of competitiveness and thereby enable market diversification; and b) better exploitation of regional trading opportunities in nearby growing and dynamic markets, especially East and South Asia; (2) breaking into new products through a) more neutral and rational trade policy and taxation and bonded warehouse schemes; b) concerted efforts to spur domestic investment and attract foreign direct investment, to contribute to export promotion and diversification, including by easing the energy and land constraints; and c) strategic development and promotion of services trade; (3) improving worker and consumer welfare by a) improving skills and literacy; b) implementing labor and work safety guidelines; and c) making safety nets more effective in dealing with trade shocks; and (4) building a supportive environment, including a) sustaining sound macroeconomic fundamentals; and b) strengthening the institutional capacity for strategic policy making aimed at the objective of international competitiveness to help bring focus and coherence to the government’s reform efforts. This second volume provides in-depth analysis across seven cross-cutting themes that underpin most of the findings of pillars 1 and 2 above.Publication Democratic Republic of Congo Urbanization Review(Washington, DC: World Bank, 2018)The Democratic Republic of Congo has the third largest urban population in sub-Saharan Africa (estimated at 43% in 2016) after South Africa and Nigeria. It is expected to grow at a rate of 4.1% per year, which corresponds to an additional 1 million residents moving to cities every year. If this trend continues, the urban population could double in just 15 years. Thus, with a population of 12 million and a growth rate of 5.1% per year, Kinshasa is poised to become the most populous city in Africa by 2030. Such strong urban growth comes with two main challenges – the need to make cities livable and inclusive by meeting the high demand for social services, infrastructure, education, health, and other basic services; and the need to make cities more productive by addressing the lack of concentrated economic activity. The Urbanization Review of the Democratic Republic of Congo argues that the country is urbanizing at different rates and identifies five regions (East, South, Central, West and Congo Basin) that present specific challenges and opportunities. The Urbanization Review proposes policy options based on three sets of instruments, known as the three 'I's – Institutions, Infrastructures and Interventions – to help each region respond to its specific needs while reaping the benefits of economic agglomeration The Democratic Republic of the Congo is at a crossroads. The recent decline in commodity prices could constitute an opportunity for the country to diversify its economy and invest in the manufacturing sector. Now is an opportune time for Congolese decision-makers to invest in cities that can lead the country's structural transformation and facilitate greater integration with African and global markets. Such action would position the country well on the path to emergence.Publication An Investment Framework for Nutrition(Washington, DC: World Bank, 2017-04-12)The report estimates the costs, impacts and financing scenarios to achieve the World Health Assembly global nutrition targets for stunting, anemia in women, exclusive breastfeeding and the scaling up of the treatment of severe wasting among young children. To reach these four targets, the world needs $70 billion over 10 years to invest in high-impact nutrition-specific interventions. This investment would have enormous benefits: 65 million cases of stunting and 265 million cases of anemia in women would be prevented in 2025 as compared with the 2015 baseline. In addition, at least 91 million more children would be treated for severe wasting and 105 million additional babies would be exclusively breastfed during the first six months of life over 10 years. Altogether, achieving these targets would avert at least 3.7 million child deaths. Every dollar invested in this package of interventions would yield between $4 and $35 in economic returns, making investing in early nutrition one of the best value-for-money development actions. Although some of the targets—especially those for reducing stunting in children and anemia in women—are ambitious and will require concerted efforts in financing, scale-up, and sustained commitment, recent experience from several countries suggests that meeting these targets is feasible. These investments in the critical 1000 day window of early childhood are inalienable and portable and will pay lifelong dividends – not only for children directly affected but also for us all in the form of more robust societies – that will drive future economies.Publication At a Crossroads(World Bank, Washington, DC, 2017-05-02)Higher education (HE) has expanded dramatically in Latin America and the Caribbean (LAC) since 2000. While access became more equitable, quality concerns remain. This volume studies the expansion, as well as HE quality, variety and equity in LAC. It investigates the expansion’s demand and supply drivers, and outlines policy implications.Publication Sri Lanka Education Sector Assessment(Washington, DC: World Bank, 2017-06-08)A country’s education system plays a pivotal role in promoting economic growth and shared prosperity. Sri Lanka has enjoyed high school-attainment and enrollment rates for several decades. However, it still faces major challenges in the education sector, and these challenges undermine the country’s inclusivegrowth goal and its ambition to become a competitive upper-middle-income country. The authors of Sri Lanka Education Sector Assessment: Achievements, Challenges, and Policy Options offer a thorough review of Sri Lanka’s education sector—from early childhood education through higher education. With this book, they attempt to answer three questions: • How is Sri Lanka’s education system performing, especially with respect to participation rates, learning outcomes, and labor market outcomes? • How can the country address the challenges at each stage of the education process, taking into account both country and international experience and also best practices? • Which policy actions should Sri Lanka make a priority for the short and medium term? The authors identify the most critical constraints on performance and present strategic priorities and policy options to address them. To attain inclusive growth and become globally competitive, Sri Lanka needs to embark on integrated reforms across all levels of education. These reforms must address both short-term skill shortages and long-term productivity. As Sri Lanka moves up the development ladder, the priorities of primary, secondary, and postsecondary education must be aligned to meet the increasingly complex education and skill requirements.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development(2010-03-01)This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Handbook on Impact Evaluation : Quantitative Methods and Practices(World Bank, 2010)This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Impact Evaluation of Conflict Prevention and Peacebuilding Interventions(World Bank, Washington, DC, 2013-06)The international community is paying increased attention to the 25 percent of the world's population that lives in fragile and conflict affected settings, acknowledging that these settings represent daunting development challenges. To deliver better results on the ground, it is necessary to improve the understanding of the impacts and effectiveness of development interventions operating in contexts of conflict and fragility. This paper argues that it is both possible and important to carry out impact evaluations even in settings of violent conflict, and it presents some examples from a collection of impact evaluations of conflict prevention and peacebuilding interventions. The paper examines the practices of impact evaluators in the peacebuilding sector to see how they address evaluation design, data collection, and conflict analysis. Finally, it argues that such evaluations are crucial for testing assumptions about how development interventions affect change -- the so-called "theory of change" -- which is important for understanding the results on the ground.
Users also downloaded
Showing related downloaded files
Publication Rural-Urban Migration in Developing Countries(World Bank, Washington, DC, 2021-05)This paper reviews the recent literature on rural-urban migration in developing countries, focusing on three key questions: What motivates or forces people to migrate? What costs do migrants face? What are the impacts of migration on migrants and the economy? The literature paints a complex picture whereby rural-urban migration is driven by many factors and the returns to migration as well as the costs are very high. The evidence supports the notion that migration barriers hinder labor market adjustment and are likely to be welfare reducing. The review concludes by identifying gaps in current research and data needs.Publication World Development Report 1984(New York: Oxford University Press, 1984)Long-term needs and sustained effort are underlying themes in this year's report. As with most of its predecessors, it is divided into two parts. The first looks at economic performance, past and prospective. The second part is this year devoted to population - the causes and consequences of rapid population growth, its link to development, why it has slowed down in some developing countries. The two parts mirror each other: economic policy and performance in the next decade will matter for population growth in the developing countries for several decades beyond. Population policy and change in the rest of this century will set the terms for the whole of development strategy in the next. In both cases, policy changes will not yield immediate benefits, but delay will reduce the room for maneuver that policy makers will have in years to come.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication World Development Report 2014(Washington, DC, 2013-10-06)The past 25 years have witnessed unprecedented changes around the world—many of them for the better. Across the continents, many countries have embarked on a path of international integration, economic reform, technological modernization, and democratic participation. As a result, economies that had been stagnant for decades are growing, people whose families had suffered deprivation for generations are escaping poverty, and hundreds of millions are enjoying the benefits of improved living standards and scientific and cultural sharing across nations. As the world changes, a host of opportunities arise constantly. With them, however, appear old and new risks, from the possibility of job loss and disease to the potential for social unrest and environmental damage. If ignored, these risks can turn into crises that reverse hard-won gains and endanger the social and economic reforms that produced these gains. The World Development Report 2014 (WDR 2014), Risk and Opportunity: Managing Risk for Development, contends that the solution is not to reject change in order to avoid risk but to prepare for the opportunities and risks that change entails. Managing risks responsibly and effectively has the potential to bring about security and a means of progress for people in developing countries and beyond. Although individuals’ own efforts, initiative, and responsibility are essential for managing risk, their success will be limited without a supportive social environment—especially when risks are large or systemic in nature. The WDR 2014 argues that people can successfully confront risks that are beyond their means by sharing their risk management with others. This can be done through naturally occurring social and economic systems that enable people to overcome the obstacles that individuals and groups face, including lack of resources and information, cognitive and behavioral failures, missing markets and public goods, and social externalities and exclusion. These systems—from the household and the community to the state and the international community—have the potential to support people’s risk management in different yet complementary ways. The Report focuses on some of the most pressing questions policy makers are asking. What role should the state take in helping people manage risks? When should this role consist of direct interventions, and when should it consist of providing an enabling environment? How can governments improve their own risk management, and what happens when they fail or lack capacity, as in many fragile and conflict-affected states? Through what mechanisms can risk management be mainstreamed into the development agenda? And how can collective action failures to manage systemic risks be addressed, especially those with irreversible consequences? The WDR 2014 provides policy makers with insights and recommendations to address these difficult questions. It should serve to guide the dialogue, operations, and contributions from key development actors—from civil society and national governments to the donor community and international development organizations.