Publication: The Road to Results : Designing and
Conducting Effective Development Evaluations
Loading...
Other Files
2,687 downloads
7,759 downloads
974 downloads
2,100 downloads
12,991 downloads
Published
2009-12-01
ISSN
Date
2012-03-19
Author(s)
Editor(s)
Abstract
The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.
Link to Data Set
Citation
“Morra Imas, Linda G.; Rist, Ray C.. 2009. The Road to Results : Designing and
Conducting Effective Development Evaluations. © World Bank. http://hdl.handle.net/10986/2699 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners(Washington, DC: World Bank, 2000-05)Very little is known about the actual impact of projects on the poor. Many are reluctant to carry out impact evaluations because they are deemed expensive, time consuming, and technically complex, and because the findings can be politically sensitive. Yet a rigorous evaluation can be powerful in assessing the appropriateness and effectiveness of programs. Evaluating impact is particularly critical in developing where resources are scarce and every dollar spent should aim to maximize its impact on poverty reduction. This handbook seeks to provide project managers and policy analysts with the tools needed for evaluating project impact. It is aimed at readers with a general knowledge of statistics. Chapter 1 presents an overview of concepts and methods, Chapter 2 discusses key steps and related issues to consider in implementation, Chapter 3 illustrates various analytical techniques through a case study, and Chapter 4 includes a discussion of lessons that have been reviewed for this handbook. The case studies, included in Annex I, were selected from a range of evaluations carried out by the Bank, other donor agencies, research institutions, and private consulting firms. Also included in the annexes are samples of the main components that would be necessary in planning any impact evaluation - sample terms of reference, a budget, impact indicators, a log frame, and a matrix of analysis.Publication Tracking Results in Agriculture and Rural Development in Less-Than-Ideal Conditions : A Sourcebook of Indicators for Monitoring and Evaluation(Bonn: Global Donor Platform for Rural Development, 2008)The purpose of this sourcebook is to pull together into a single document a collection of common sense tips and recommendations based on actual practices and experience around the world. The sourcebook aims first and foremost to help strengthen Monitoring and Evaluation (M&E) capacity at the national and sub-national levels, and to ensure a consistency of approach and methodology so that, at the global level, sufficient reliable and timely information can be accessed from the different countries and used to make cross-country comparisons and to calculate development indicators at the global level. The sourcebook is specifically targeted towards countries where conditions are less-than-ideal, particularly with respect to the availability of relevant information. The sourcebook also shows how a service delivery approach can be used to select indicators which can generate useful, easy-to-measure early outcome measures. It suggests that greater use be made of qualitative indicators, such as access, use and satisfaction. The sourcebook devotes considerable attention to the need for a strong statistical infrastructure and reviews the range of different statistical instruments available.Publication Tracking Results in Agriculture and Rural Development in Less-Than-Ideal Conditions : A Sourcebook of Indicators for Monitoring and Evaluation(Global Donor Platform for Rural Development, 2008)The purpose of this sourcebook is to pull together into a single document a collection of common sense tips and recommendations based on actual practices and experience around the world. The sourcebook aims first and foremost to help strengthen Monitoring and Evaluation (M&E) capacity at the national and sub-national levels, and to ensure a consistency of approach and methodology so that, at the global level, sufficient reliable and timely information can be accessed from the different countries and used to make cross-country comparisons and to calculate development indicators at the global level. The sourcebook is specifically targeted towards countries where conditions are less-than-ideal, particularly with respect to the availability of relevant information. The sourcebook also shows how a service delivery approach can be used to select indicators which can generate useful, easy-to-measure early outcome measures. It suggests that greater use be made of qualitative indicators, such as access, use and satisfaction. The sourcebook devotes considerable attention to the need for a strong statistical infrastructure and reviews the range of different statistical instruments available.Publication Integrating Quantitative and Qualitative Research in Development Projects(Washington, DC: World Bank, 2000-06)"Much of the early work on poverty was highly quantitative:... It became increasingly clear, however, that while numbers are essential for policy and monitoring purposes, it is also important to understand people's perception of poverty and their mechanisms for coping with poverty and other situations of extreme economic and social stress." Researchers have recognized over the past few years that quantitative analysis of the incidence and trends in poverty, while essential for national economic development planning, must be complemented by qualitative methods that help planners and managers understand the cultural, social, political, and institutional context within which projects are designed and implemented. This report is based on a two-day workshop held in June 1998, where outside research specialists and World Bank staff discussed the importance of integrating these research methods. The participants reviewed experiences in the use of mixed-method approaches in Bank research and project design. This report is a result of those discussions. The report examines the need for integrated research approaches in social and economic development, presents case studies of integrated approaches in practice, and talks about lessons learned. Part I describes the evolution of interest in, and the potential benefits of integrated research, and, Part II presents case studies on how integrated approaches have been used in poverty analysis, education, health, and water supply and sanitation, while Part III discusses lessons learned with respect to the use of integrated approaches, and assesses the benefits that can be achieved.Publication Monitoring and Evaluation(World Bank, Washington, DC, 2004-09-01)Monitoring and evaluation (M&E) of development activities provides government officials, development managers, and civil society with better means for learning from past experience, improving service delivery, planning and allocating resources, and demonstrating results as part of accountability to key stakeholders. Within the development community there is a strong focus on results, this helps explain the growing interest in M&E. Yet there is often confusion about what M&E entails. The purpose of this M&E overview is to strengthen awareness and interest in M&E, and to clarify what it entails. The M&E overview discusses: performance indicators, the logical framework approach, theory-based evaluation, formal surveys, rapid appraisal methods, participatory methods, public expenditure tracking surveys, cost-benefit and cost-effectiveness analysis, and impact evaluation.
Users also downloaded
Showing related downloaded files
Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Corporate Governance of State-Owned Enterprises : A Toolkit(Washington, DC, 2014-10-04)This Toolkit provides an overall framework with practical tools and information to help policymakers design and implement corporate governance reforms for state-owned enterprises. It covers the key elements of corporate governance, including legal and regulatory framework, state ownership arrangements, performance management systems, financial and fiscal discipline, boards of directors, transparency and disclosure, and protection of shareholders in mixed ownership companies. Experience shows that no one approach is universally applicable and the choice of measures depends on country and enterprise circumstances. The Toolkit thus provides a range of frameworks, concepts, case examples, checklists, and model documents that together aim to help government officials make the appropriate choices for their circumstances. The Toolkit concludes with guidance on managing the reform process, in particular how to prioritize and sequence reforms, build capacity, and engage with stakeholders.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Moving Out of Poverty : Volume 1. Cross-Disciplinary Perspectives on Mobility(Washington, DC: World Bank and Palgrave Macmillan, 2007)This volume brings together multidisciplinary perspectives on poor people's mobility, a dynamic approach that hopefully will add to the reader's understanding of how and why people move into and out of poverty. The chapters draw on the latest longitudinal micro data to present a moving picture of poverty that is rather different from what one can see in single snapshots, the staple of traditional poverty analysis. The book is also important because the contributors' distinct disciplinary perspectives demonstrate clearly why it is critical to draw on diverse information to improve the reader's understanding about how to reduce poverty. The economic findings reinforce what has been known for some time: fast economic growth underpins poverty reduction, but the speed of declines in poverty is greatly affected by social and political factors. The economic panels also show that the people mired in chronic poverty around the world are actually fewer in number than the people moving in and out of poverty. Static studies do not capture this dynamic quality of poverty and vulnerability. Of particular interest are the chapters clarifying interactions between the local social, political, and economic factors that underlie persistent poverty, vulnerability, and inequality. They point to the need to draw from different disciplines as we turn to the task of reaching the bottom poor trapped in poverty and those churning in and out of poverty.Publication A Guide to Assessing Needs : Essential Tools for Collecting Information, Making Decisions, and Achieving Development Results(World Bank, 2012-01-06)This book will benefit people and teams involved in planning and decision making. On the basis of their pragmatic value in guiding decisions, needs assessments are used in various professions and settings from emergency rooms to corporate boardrooms to guide decision making. Nonetheless, although needs assessments have many different applications, in this book on needs assessments as they are applied in organizations to accomplish results, as opposed to their use in personal decisions or medical triage. This book, in turn, is guide to assessing needs and then making essential decisions about what to do next. This book filled with practical strategies, tools, and guides covers both large-scale, formal needs assessments and less-formal assessments that guide daily decisions. Included in the book is a blend of rigorous methods and realistic tools that can help make informed and reasoned decisions. Together, these methods and tools offer a comprehensive, yet realistic, approach to identifying needs and selecting among alternative ways as go forward. Sections one and two offer quick, yet full, answers to many frequently asked questions regarding how to make justifiable decisions. Next, section three examines a variety of tools and techniques that can be used for both collecting information and making decisions. Appendix A then offers a number of checklists and guides for managing the systematic assessment processes that lead to quality decisions. Finally, the reference list at the end of the book is a valuable resource to research, tools, and discussions of needs assessment.