Publication: Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners
Loading...
Date
2000-05
ISSN
Published
2000-05
Author(s)
Editor(s)
Abstract
Very little is known about the actual impact of projects on the poor. Many are reluctant to carry out impact evaluations because they are deemed expensive, time consuming, and technically complex, and because the findings can be politically sensitive. Yet a rigorous evaluation can be powerful in assessing the appropriateness and effectiveness of programs. Evaluating impact is particularly critical in developing where resources are scarce and every dollar spent should aim to maximize its impact on poverty reduction. This handbook seeks to provide project managers and policy analysts with the tools needed for evaluating project impact. It is aimed at readers with a general knowledge of statistics. Chapter 1 presents an overview of concepts and methods, Chapter 2 discusses key steps and related issues to consider in implementation, Chapter 3 illustrates various analytical techniques through a case study, and Chapter 4 includes a discussion of lessons that have been reviewed for this handbook. The case studies, included in Annex I, were selected from a range of evaluations carried out by the Bank, other donor agencies, research institutions, and private consulting firms. Also included in the annexes are samples of the main components that would be necessary in planning any impact evaluation - sample terms of reference, a budget, impact indicators, a log frame, and a matrix of analysis.
Link to Data Set
Citation
“Baker, Judy L.. 2000. Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners. Directions in development;. © World Bank. http://hdl.handle.net/10986/13949 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Democratic Republic of Congo Urbanization Review(Washington, DC: World Bank, 2018)The Democratic Republic of Congo has the third largest urban population in sub-Saharan Africa (estimated at 43% in 2016) after South Africa and Nigeria. It is expected to grow at a rate of 4.1% per year, which corresponds to an additional 1 million residents moving to cities every year. If this trend continues, the urban population could double in just 15 years. Thus, with a population of 12 million and a growth rate of 5.1% per year, Kinshasa is poised to become the most populous city in Africa by 2030. Such strong urban growth comes with two main challenges – the need to make cities livable and inclusive by meeting the high demand for social services, infrastructure, education, health, and other basic services; and the need to make cities more productive by addressing the lack of concentrated economic activity. The Urbanization Review of the Democratic Republic of Congo argues that the country is urbanizing at different rates and identifies five regions (East, South, Central, West and Congo Basin) that present specific challenges and opportunities. The Urbanization Review proposes policy options based on three sets of instruments, known as the three 'I's – Institutions, Infrastructures and Interventions – to help each region respond to its specific needs while reaping the benefits of economic agglomeration The Democratic Republic of the Congo is at a crossroads. The recent decline in commodity prices could constitute an opportunity for the country to diversify its economy and invest in the manufacturing sector. Now is an opportune time for Congolese decision-makers to invest in cities that can lead the country's structural transformation and facilitate greater integration with African and global markets. Such action would position the country well on the path to emergence.Publication Entrepreneurship Education and Training Programs around the World : Dimensions for Success(Washington, DC: World Bank, 2014-04-23)Entrepreneurship has attracted global interest for its potential to catalyze economic and social development. Research suggesting that certain entrepreneurial mindsets and skills can be learned has given rise to the field of entrepreneurship education and training (EET). Despite the growth of EET, global knowledge about these programs and their impact remains thin. In response, this study surveys the available literature and program evaluations to propose a Conceptual Framework for understanding the EET program landscape. The study finds that EET today consists of a heterogeneous mix of programs that can be broken into two groups: entrepreneurship education and entrepreneurship training. These programs target a range of participants: secondary and post-secondary education students, as well as potential and practicing entrepreneurs. The outcomes measured by program evaluations are equally diverse but generally fall under the domains of entrepreneurial mindsets and capabilities, entrepreneurial status, and entrepreneurial performance. The dimensions of EET programs vary according the particular target group. Programs targeting secondary education students focus on the development of foundational skills linked to entrepreneurship, while post-secondary education programs emphasize skills related to strategic business planning. Programs targeting potential entrepreneurs generally are embedded within broader support programs and tend to target vulnerable populations for whom employment alternatives may be limited. While programs serving practicing entrepreneurs focus on strengthening entrepreneurs’ knowledge, skills and business practices, which while unlikely to transform an enterprise in the near term, may accrue benefits to entrepreneurs over time. The study also offers implications for policy and program implementation, emphasizing the importance of clarity about target groups and desired outcomes when making program choices, and sound understanding of extent to which publicly-supported programs offer a broader public good, and compare favorably to policy alternatives for supporting the targeted individuals as well as the overall economic and social objectives.Publication Options for Aged Care in China(Washington, DC: World Bank, 2018-11-20)China is aging at an unprecedented rate. Improvements in life expectancy and the consequences of the decades-old family planning policy have led to a rapid increase in the elderly population. According to the United Nations World Population Prospects, the proportion of older people age 65 and over will increase by about one-fourth by 2030, and the elderly will account for about one quarter of the total population by 2050. Population aging will not only pose challenges for elder care but also have an impact on the economy and all aspects of society (World Bank, 2016a). The government is aware of the need to develop an efficient and sustainable approach to aged care. To this end, the General Office of the State Council issued the 12th Five-Year Plan for the Development of Aged Care Services in China and the Development Plan for a System of Social Services for the Aged (2011-2015). It is now in the process of formulating the 13th Five-Year National Plan on Aging, which will further elaborate and finalize the reform roadmap for 2016 to 2020. The Plan is expected to be finalized and launched by June 2016. The National Development and Reform Commission (NDRC) helped draft these plans and is now leading the development of policy measures for the provision of social services for the elderly. This volume has been prepared to support the translation of the broad ideas on aged care provision expressed in the 12th and 13th Five-Year Plans and other government plans into reality and to help the government tackle the challenges described above. It strives to identify a policy framework that fits the Chinese context and can be put in place gradually. Specifically, it aims to provide an up-to-date understanding of the evolving aged care landscape in China; review international experiences in long-term care provision, financing, and quality assurance and assess their relevance to China’s current situation; discuss implications of current developments and trends for the future of aged care in China; and propose policy options based on available evidence and best practices.Publication At a Crossroads(World Bank, Washington, DC, 2017-05-02)Higher education (HE) has expanded dramatically in Latin America and the Caribbean (LAC) since 2000. While access became more equitable, quality concerns remain. This volume studies the expansion, as well as HE quality, variety and equity in LAC. It investigates the expansion’s demand and supply drivers, and outlines policy implications.Publication An Investment Framework for Nutrition(Washington, DC: World Bank, 2017-04-12)The report estimates the costs, impacts and financing scenarios to achieve the World Health Assembly global nutrition targets for stunting, anemia in women, exclusive breastfeeding and the scaling up of the treatment of severe wasting among young children. To reach these four targets, the world needs $70 billion over 10 years to invest in high-impact nutrition-specific interventions. This investment would have enormous benefits: 65 million cases of stunting and 265 million cases of anemia in women would be prevented in 2025 as compared with the 2015 baseline. In addition, at least 91 million more children would be treated for severe wasting and 105 million additional babies would be exclusively breastfed during the first six months of life over 10 years. Altogether, achieving these targets would avert at least 3.7 million child deaths. Every dollar invested in this package of interventions would yield between $4 and $35 in economic returns, making investing in early nutrition one of the best value-for-money development actions. Although some of the targets—especially those for reducing stunting in children and anemia in women—are ambitious and will require concerted efforts in financing, scale-up, and sustained commitment, recent experience from several countries suggests that meeting these targets is feasible. These investments in the critical 1000 day window of early childhood are inalienable and portable and will pay lifelong dividends – not only for children directly affected but also for us all in the form of more robust societies – that will drive future economies.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development(2010-03-01)This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Handbook on Impact Evaluation : Quantitative Methods and Practices(World Bank, 2010)This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Impact Evaluation of Conflict Prevention and Peacebuilding Interventions(World Bank, Washington, DC, 2013-06)The international community is paying increased attention to the 25 percent of the world's population that lives in fragile and conflict affected settings, acknowledging that these settings represent daunting development challenges. To deliver better results on the ground, it is necessary to improve the understanding of the impacts and effectiveness of development interventions operating in contexts of conflict and fragility. This paper argues that it is both possible and important to carry out impact evaluations even in settings of violent conflict, and it presents some examples from a collection of impact evaluations of conflict prevention and peacebuilding interventions. The paper examines the practices of impact evaluators in the peacebuilding sector to see how they address evaluation design, data collection, and conflict analysis. Finally, it argues that such evaluations are crucial for testing assumptions about how development interventions affect change -- the so-called "theory of change" -- which is important for understanding the results on the ground.
Users also downloaded
Showing related downloaded files
Publication Africa's Future, Africa's Challenge : Early Childhood Care and Development in Sub-Saharan Africa(Washington, DC : World Bank, 2008)This book seeks to achieve a balance, describing challenges that are being faced as well as developments that are underway. It seeks a balance in terms of the voices heard, including not just voices of the North commenting on the South, but voices from the South, and in concert with the North. It seeks to provide the voices of specialists and generalists, of those from international and local organizations, from academia and the field. It seeks a diversity of views and values. Such diversity and complexity are the reality of Sub-Saharan Africa (SSA) today. The major focus of this book is on SSA from the Sahel south. Approximately 130 million children between birth and age 6 live in SSA. Every year 27 million children are born, and every year 4.7 million children under age 5 die. Rates of birth and of child deaths are consistently higher in SSA than in any other part of the world; the under-5 mortality rate of 163 per 1,000 is twice that of the rest of the developing world and 30 times that of industrialized countries (UNICEF 2006). Of the children who are born, 65 percent will experience poverty, 14 million will be orphans affected by HIV/AIDS directly and within their families and one-third will experience exclusion because of their gender or ethnicity.Publication World Development Report 1984(New York: Oxford University Press, 1984)Long-term needs and sustained effort are underlying themes in this year's report. As with most of its predecessors, it is divided into two parts. The first looks at economic performance, past and prospective. The second part is this year devoted to population - the causes and consequences of rapid population growth, its link to development, why it has slowed down in some developing countries. The two parts mirror each other: economic policy and performance in the next decade will matter for population growth in the developing countries for several decades beyond. Population policy and change in the rest of this century will set the terms for the whole of development strategy in the next. In both cases, policy changes will not yield immediate benefits, but delay will reduce the room for maneuver that policy makers will have in years to come.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication Supporting Youth at Risk(World Bank, Washington, DC, 2008)The World Bank has produced this policy Toolkit in response to a growing demand from our government clients and partners for advice on how to create and implement effective policies for at-risk youth. The author has highlighted 22 policies (six core policies, nine promising policies, and seven general policies) that have been effective in addressing the following five key risk areas for young people around the world: (i) youth unemployment, underemployment, and lack of formal sector employment; (ii) early school leaving; (iii) risky sexual behavior leading to early childbearing and HIV/AIDS; (iv) crime and violence; and (v) substance abuse. The objective of this Toolkit is to serve as a practical guide for policy makers in middle-income countries as well as professionals working within the area of youth development on how to develop and implement an effective policy portfolio to foster healthy and positive youth development.