Publication: Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners
Loading...
Published
2000-05
ISSN
Date
2013-06-17
Author(s)
Editor(s)
Abstract
Very little is known about the actual impact of projects on the poor. Many are reluctant to carry out impact evaluations because they are deemed expensive, time consuming, and technically complex, and because the findings can be politically sensitive. Yet a rigorous evaluation can be powerful in assessing the appropriateness and effectiveness of programs. Evaluating impact is particularly critical in developing where resources are scarce and every dollar spent should aim to maximize its impact on poverty reduction. This handbook seeks to provide project managers and policy analysts with the tools needed for evaluating project impact. It is aimed at readers with a general knowledge of statistics. Chapter 1 presents an overview of concepts and methods, Chapter 2 discusses key steps and related issues to consider in implementation, Chapter 3 illustrates various analytical techniques through a case study, and Chapter 4 includes a discussion of lessons that have been reviewed for this handbook. The case studies, included in Annex I, were selected from a range of evaluations carried out by the Bank, other donor agencies, research institutions, and private consulting firms. Also included in the annexes are samples of the main components that would be necessary in planning any impact evaluation - sample terms of reference, a budget, impact indicators, a log frame, and a matrix of analysis.
Link to Data Set
Citation
“Baker, Judy L.. 2000. Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners. Directions in development;. © World Bank. http://hdl.handle.net/10986/13949 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Strengthening Competitiveness In Bangladesh—Thematic Assessment(Washington, DC: World Bank, 2016-07-15)This is volume 2 of a three-volume publication on Bangladesh’s trade prospects. Bangladesh’s ambition is to build on its very solid growth and poverty reduction achievements, and accelerate growth to become a middle income country by 2021, and share prosperity more widely amongst its citizens. This includes one of its greatest development challenges: to provide gainful employment to the over 2 million people that will join the labor force each year over the next decade. Moreover, only 54.1 million of its 94 million working age people are employed. Bangladesh needs to use its labor endowment even more intensively to increase growth and, in turn, to absorb the incoming labor. The Diagnostic Trade Integration Study identifies the following actions centered around four pillars to sustain and accelerate export growth: (1) breaking into new markets through a) better trade logistics to reduce delivery lags ; as world markets become more competitive and newer products demand shorter lead times, to generate new sources of competitiveness and thereby enable market diversification; and b) better exploitation of regional trading opportunities in nearby growing and dynamic markets, especially East and South Asia; (2) breaking into new products through a) more neutral and rational trade policy and taxation and bonded warehouse schemes; b) concerted efforts to spur domestic investment and attract foreign direct investment, to contribute to export promotion and diversification, including by easing the energy and land constraints; and c) strategic development and promotion of services trade; (3) improving worker and consumer welfare by a) improving skills and literacy; b) implementing labor and work safety guidelines; and c) making safety nets more effective in dealing with trade shocks; and (4) building a supportive environment, including a) sustaining sound macroeconomic fundamentals; and b) strengthening the institutional capacity for strategic policy making aimed at the objective of international competitiveness to help bring focus and coherence to the government’s reform efforts. This second volume provides in-depth analysis across seven cross-cutting themes that underpin most of the findings of pillars 1 and 2 above.Publication Democratic Republic of Congo Urbanization Review(Washington, DC: World Bank, 2018)The Democratic Republic of Congo has the third largest urban population in sub-Saharan Africa (estimated at 43% in 2016) after South Africa and Nigeria. It is expected to grow at a rate of 4.1% per year, which corresponds to an additional 1 million residents moving to cities every year. If this trend continues, the urban population could double in just 15 years. Thus, with a population of 12 million and a growth rate of 5.1% per year, Kinshasa is poised to become the most populous city in Africa by 2030. Such strong urban growth comes with two main challenges – the need to make cities livable and inclusive by meeting the high demand for social services, infrastructure, education, health, and other basic services; and the need to make cities more productive by addressing the lack of concentrated economic activity. The Urbanization Review of the Democratic Republic of Congo argues that the country is urbanizing at different rates and identifies five regions (East, South, Central, West and Congo Basin) that present specific challenges and opportunities. The Urbanization Review proposes policy options based on three sets of instruments, known as the three 'I's – Institutions, Infrastructures and Interventions – to help each region respond to its specific needs while reaping the benefits of economic agglomeration The Democratic Republic of the Congo is at a crossroads. The recent decline in commodity prices could constitute an opportunity for the country to diversify its economy and invest in the manufacturing sector. Now is an opportune time for Congolese decision-makers to invest in cities that can lead the country's structural transformation and facilitate greater integration with African and global markets. Such action would position the country well on the path to emergence.Publication Entrepreneurship Education and Training Programs around the World : Dimensions for Success(Washington, DC: World Bank, 2014-04-23)Entrepreneurship has attracted global interest for its potential to catalyze economic and social development. Research suggesting that certain entrepreneurial mindsets and skills can be learned has given rise to the field of entrepreneurship education and training (EET). Despite the growth of EET, global knowledge about these programs and their impact remains thin. In response, this study surveys the available literature and program evaluations to propose a Conceptual Framework for understanding the EET program landscape. The study finds that EET today consists of a heterogeneous mix of programs that can be broken into two groups: entrepreneurship education and entrepreneurship training. These programs target a range of participants: secondary and post-secondary education students, as well as potential and practicing entrepreneurs. The outcomes measured by program evaluations are equally diverse but generally fall under the domains of entrepreneurial mindsets and capabilities, entrepreneurial status, and entrepreneurial performance. The dimensions of EET programs vary according the particular target group. Programs targeting secondary education students focus on the development of foundational skills linked to entrepreneurship, while post-secondary education programs emphasize skills related to strategic business planning. Programs targeting potential entrepreneurs generally are embedded within broader support programs and tend to target vulnerable populations for whom employment alternatives may be limited. While programs serving practicing entrepreneurs focus on strengthening entrepreneurs’ knowledge, skills and business practices, which while unlikely to transform an enterprise in the near term, may accrue benefits to entrepreneurs over time. The study also offers implications for policy and program implementation, emphasizing the importance of clarity about target groups and desired outcomes when making program choices, and sound understanding of extent to which publicly-supported programs offer a broader public good, and compare favorably to policy alternatives for supporting the targeted individuals as well as the overall economic and social objectives.Publication At a Crossroads(World Bank, Washington, DC, 2017-05-02)Higher education (HE) has expanded dramatically in Latin America and the Caribbean (LAC) since 2000. While access became more equitable, quality concerns remain. This volume studies the expansion, as well as HE quality, variety and equity in LAC. It investigates the expansion’s demand and supply drivers, and outlines policy implications.Publication An Investment Framework for Nutrition(Washington, DC: World Bank, 2017-04-12)The report estimates the costs, impacts and financing scenarios to achieve the World Health Assembly global nutrition targets for stunting, anemia in women, exclusive breastfeeding and the scaling up of the treatment of severe wasting among young children. To reach these four targets, the world needs $70 billion over 10 years to invest in high-impact nutrition-specific interventions. This investment would have enormous benefits: 65 million cases of stunting and 265 million cases of anemia in women would be prevented in 2025 as compared with the 2015 baseline. In addition, at least 91 million more children would be treated for severe wasting and 105 million additional babies would be exclusively breastfed during the first six months of life over 10 years. Altogether, achieving these targets would avert at least 3.7 million child deaths. Every dollar invested in this package of interventions would yield between $4 and $35 in economic returns, making investing in early nutrition one of the best value-for-money development actions. Although some of the targets—especially those for reducing stunting in children and anemia in women—are ambitious and will require concerted efforts in financing, scale-up, and sustained commitment, recent experience from several countries suggests that meeting these targets is feasible. These investments in the critical 1000 day window of early childhood are inalienable and portable and will pay lifelong dividends – not only for children directly affected but also for us all in the form of more robust societies – that will drive future economies.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development(2010-03-01)This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.Publication Handbook on Impact Evaluation : Quantitative Methods and Practices(World Bank, 2010)This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Impact Evaluation of Conflict Prevention and Peacebuilding Interventions(World Bank, Washington, DC, 2013-06)The international community is paying increased attention to the 25 percent of the world's population that lives in fragile and conflict affected settings, acknowledging that these settings represent daunting development challenges. To deliver better results on the ground, it is necessary to improve the understanding of the impacts and effectiveness of development interventions operating in contexts of conflict and fragility. This paper argues that it is both possible and important to carry out impact evaluations even in settings of violent conflict, and it presents some examples from a collection of impact evaluations of conflict prevention and peacebuilding interventions. The paper examines the practices of impact evaluators in the peacebuilding sector to see how they address evaluation design, data collection, and conflict analysis. Finally, it argues that such evaluations are crucial for testing assumptions about how development interventions affect change -- the so-called "theory of change" -- which is important for understanding the results on the ground.
Users also downloaded
Showing related downloaded files
Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication Africa's Future, Africa's Challenge : Early Childhood Care and Development in Sub-Saharan Africa(Washington, DC : World Bank, 2008)This book seeks to achieve a balance, describing challenges that are being faced as well as developments that are underway. It seeks a balance in terms of the voices heard, including not just voices of the North commenting on the South, but voices from the South, and in concert with the North. It seeks to provide the voices of specialists and generalists, of those from international and local organizations, from academia and the field. It seeks a diversity of views and values. Such diversity and complexity are the reality of Sub-Saharan Africa (SSA) today. The major focus of this book is on SSA from the Sahel south. Approximately 130 million children between birth and age 6 live in SSA. Every year 27 million children are born, and every year 4.7 million children under age 5 die. Rates of birth and of child deaths are consistently higher in SSA than in any other part of the world; the under-5 mortality rate of 163 per 1,000 is twice that of the rest of the developing world and 30 times that of industrialized countries (UNICEF 2006). Of the children who are born, 65 percent will experience poverty, 14 million will be orphans affected by HIV/AIDS directly and within their families and one-third will experience exclusion because of their gender or ethnicity.Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication Zimbabwe(World Bank, Washington, DC, 2019-03-01)This report presents an assessment of Zimbabwe’s agriculture sector disaster risk and management capacity. The findings indicate that Zimbabwe is highly exposed to agricultural risks and has limited capacity to manage risk at various levels. The report shows that disaster-related shocks along Zimbabwe’s agricultural supply chains directly translate to volatility in agricultural GDP. Such shocks have a substantial impact on economic growth, food security, and fiscal balance. When catastrophic disasters occur, the economy absorbs the shocks, without benefiting from any instruments that transfer the risk to markets and coping ability. The increasing prevalence of ‘shock recovery-shock’ cycles impairs Zimbabwe’s ability to plan and pursue a sustainable development path. The findings presented here confirm that it is highly pertinent for Zimbabwe to strengthen the capacity to manage risk at various levels, from the smallholder farmer, to other participants along the supply chain, to consumers (who require a reliable, safe food supply), and ultimately to the government to manage natural disasters. The assessment provides the following evidence on sources of risks and plausible risk management solutions. It is our hope that the report contributes to action by the Government of Zimbabwe to adopt a proactive and integrated risk management strategy appropriate to the current structure of the agricultural sector.Publication World Development Report 1984(New York: Oxford University Press, 1984)Long-term needs and sustained effort are underlying themes in this year's report. As with most of its predecessors, it is divided into two parts. The first looks at economic performance, past and prospective. The second part is this year devoted to population - the causes and consequences of rapid population growth, its link to development, why it has slowed down in some developing countries. The two parts mirror each other: economic policy and performance in the next decade will matter for population growth in the developing countries for several decades beyond. Population policy and change in the rest of this century will set the terms for the whole of development strategy in the next. In both cases, policy changes will not yield immediate benefits, but delay will reduce the room for maneuver that policy makers will have in years to come.