Publication: Development Evaluation in Times of Turbulence : Dealing with Crises that Endanger Our Future
Loading...
Files in English
5,279 downloads
Date
2013-04-19
ISSN
Published
2013-04-19
Author(s)
Abstract
The presence of turbulence in multiple areas of our society--food, fuel, and finances-being but three critical areas presently being impacted means that long-held assumptions are no longer true, that the past is not prologue, and that the future is not clear. And enter into this unstable present the discipline of evaluation-a discipline formed and shaped in the past fifty years of stability, little turbulence, and strong assumptions that everything will go according to plan. If things do not go well, it is because of either a poor theory of change on how to bring about positive outcomes, or weak efforts at implementation. It is not because of the stormy present upsetting our quiet past. As it is, conventional evaluation behavior and beliefs are ill suited for these times. The transformational nature of the 'Arab Spring' is just one arena in which it is clear that a business as usual approach to evaluation is entirely inappropriate. The papers in this volume are from the 2011 Global Assembly of the International Development Evaluation Association (IDEAS). Nearly 350 development evaluators from eighty-five countries came together in Amman, Jordan to discuss and analyze the consequences of turbulence on evaluation. The intent of these papers is to systematically assess what changes have come during this time of turbulence and how these changes are impacting the craft of development evaluation. To be clear: this book is not about how to assess the impacts of crises on development and on people's lives. It is about the meaning of a changed world and changed assumptions on the concepts and methods used in evaluation.
Link to Data Set
Citation
“Boily, Marie-Helene; Rist, Ray C.; Martin, Frederic R.. Rist, Ray C.; Boily, Marie-Helene; Martin, Frederic R., editors. 2013. Development Evaluation in Times of Turbulence : Dealing with Crises that Endanger Our Future. © World Bank. http://hdl.handle.net/10986/13265 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Influencing Change : Building Evaluation Capacity to Strengthen Governance(World Bank, 2011-03-28)Evaluation Capacity Building (ECB) is an often-discussed topic in developing countries and their partner international institutions. This book takes on an elusive yet frequently mentioned concept in development evaluation ECB. Differences and divergences were apparent in the spring of 2009, when the International Development Evaluation Association (IDEAS) held its biannual global assembly in Johannesburg, South Africa, around the theme of 'getting to results: evaluation capacity building and development.' What became apparent was that a number of challenges had already been identified, but that trying to capture lessons learned on effective strategies was difficult, because of the failure to agree upon a unique and coherent definition of ECB, its various objectives and wide scope, and the diversity of institutional contexts in which it takes place. This book brings together the key papers from that global assembly, as well as new papers that reflect on what was learned and shared at the conference.Publication Poverty, Inequality, and Evaluation(Washington, DC: World Bank, 2016)The basic premise of this book is that the conversation on the future of development needs to shift from a focus on poverty to that of inequality. The poverty emphasis is in an intellectual and political cul de sac. It does not address the fundamental question of why people are poor nor what can be done structurally and institutionally to reduce and eliminate it. The various chapters illustrate in the context of various countries and sectors around the world, the significant contributions that evaluators can make in terms of improvement of the analytical framework, analysis of the performance and results of specific programs and projects, as well as assessing and designing better public management systems in terms of poverty and inequality reduction. Beyond the specific contributions presented, three characteristics characterize those evaluations to be relevant for poverty and inequality analysis: a global-local approach: Global to move beyond disciplinary boundaries and consider cross-cutting issues, local to account for the diversity of countries, sectors, institutions and cultures considered; a problem-solving orientation: The issue evaluated is the core focus and determines the choice of evaluation methods to analyze this issue from a variety of angles; an evolutionary approach: Chapters presented are from iconoclasts who do not have any pre-established theory or school of thought to defend. This is the result of openness of mind and ability to adapt the analytical framework, the evaluation methods, and the interpretation of results in a constant interaction with the stakeholders. Such characteristics make evaluation a domain that can help understand better complex issues like poverty, inequality, vulnerability, and their interactions as well as propose a relevant and useful theory of change for public policies and projects to improve the plight of a large part of the world population in industrialized and developing countries alike.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication Evaluation in the Practice of Development(World Bank, Washington, DC, 2008-03)Knowledge about development effectiveness is constrained by two factors. First, the project staff in governments and international agencies who decide how much to invest in research on specific interventions are often not well informed about the returns to rigorous evaluation and (even when they are) cannot be expected to take full account of the external benefits to others from new knowledge. This leads to under-investment in evaluative research. Second, while standard methods of impact evaluation are useful, they often leave many questions about development effectiveness unanswered. The paper proposes ten steps for making evaluations more relevant to the needs of practitioners. It is argued that more attention needs to be given to identifying policy-relevant questions (including the case for intervention); that a broader approach should be taken to the problems of internal validity; and that the problems of external validity (including scaling up) merit more attention.Publication Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes(World Bank, Washington, DC, 2016-02)This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.
Users also downloaded
Showing related downloaded files
Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Poverty and Shared Prosperity 2022(Washington, DC : World Bank, 2022)Poverty and Shared Prosperity 2022: Correcting Course provides the first comprehensive analysis of the pandemic’s toll on poverty in developing countries. It identifies how governments can optimize fiscal policy to help correct course. Fiscal policies offset the impact of COVID-19 on poverty in many high-income countries, but those policies offset barely one quarter of the pandemic’s impact in low-income countries and lower-middle-income countries. Improving support to households as crises continue will require reorienting protective spending away from generally regressive and inefficient subsidies and toward a direct transfer support system—a first key priority. Reorienting fiscal spending toward supporting growth is a second key priority identified by the report. Some of the highest-value public spending often pays out decades later. Amid crises, it is difficult to protect such investments, but it is essential to do so. Finally, it is not enough just to spend wisely - when additional revenue does need to be mobilized, it must be done in a way that minimizes reductions in poor people’s incomes. The report highlights how exploring underused forms of progressive taxation and increasing the efficiency of tax collection can help in this regard. Poverty and Shared Prosperity is a biennial series that reports on global trends in poverty and shared prosperity. Each report also explores a central challenge to poverty reduction and boosting shared prosperity, assessing what works well and what does not in different settings. By bringing together the latest evidence, this corporate flagship report provides a foundation for informed advocacy around ending extreme poverty and improving the lives of the poorest in every country in the world. For more information, please visit worldbank.org/poverty-and-shared-prosperity.