Publication: Development Evaluation in Times of Turbulence : Dealing with Crises that Endanger Our Future
Loading...
Files in English
5,388 downloads
Published
2013-04-19
ISSN
Date
2013-04-24
Author(s)
Abstract
The presence of turbulence in multiple areas of our society--food, fuel, and finances-being but three critical areas presently being impacted means that long-held assumptions are no longer true, that the past is not prologue, and that the future is not clear. And enter into this unstable present the discipline of evaluation-a discipline formed and shaped in the past fifty years of stability, little turbulence, and strong assumptions that everything will go according to plan. If things do not go well, it is because of either a poor theory of change on how to bring about positive outcomes, or weak efforts at implementation. It is not because of the stormy present upsetting our quiet past. As it is, conventional evaluation behavior and beliefs are ill suited for these times. The transformational nature of the 'Arab Spring' is just one arena in which it is clear that a business as usual approach to evaluation is entirely inappropriate. The papers in this volume are from the 2011 Global Assembly of the International Development Evaluation Association (IDEAS). Nearly 350 development evaluators from eighty-five countries came together in Amman, Jordan to discuss and analyze the consequences of turbulence on evaluation. The intent of these papers is to systematically assess what changes have come during this time of turbulence and how these changes are impacting the craft of development evaluation. To be clear: this book is not about how to assess the impacts of crises on development and on people's lives. It is about the meaning of a changed world and changed assumptions on the concepts and methods used in evaluation.
Link to Data Set
Citation
“Boily, Marie-Helene; Rist, Ray C.; Martin, Frederic R.. Rist, Ray C.; Boily, Marie-Helene; Martin, Frederic R., editors. 2013. Development Evaluation in Times of Turbulence : Dealing with Crises that Endanger Our Future. © World Bank. http://hdl.handle.net/10986/13265 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Influencing Change : Building Evaluation Capacity to Strengthen Governance(World Bank, 2011-03-28)Evaluation Capacity Building (ECB) is an often-discussed topic in developing countries and their partner international institutions. This book takes on an elusive yet frequently mentioned concept in development evaluation ECB. Differences and divergences were apparent in the spring of 2009, when the International Development Evaluation Association (IDEAS) held its biannual global assembly in Johannesburg, South Africa, around the theme of 'getting to results: evaluation capacity building and development.' What became apparent was that a number of challenges had already been identified, but that trying to capture lessons learned on effective strategies was difficult, because of the failure to agree upon a unique and coherent definition of ECB, its various objectives and wide scope, and the diversity of institutional contexts in which it takes place. This book brings together the key papers from that global assembly, as well as new papers that reflect on what was learned and shared at the conference.Publication Poverty, Inequality, and Evaluation(Washington, DC: World Bank, 2016)The basic premise of this book is that the conversation on the future of development needs to shift from a focus on poverty to that of inequality. The poverty emphasis is in an intellectual and political cul de sac. It does not address the fundamental question of why people are poor nor what can be done structurally and institutionally to reduce and eliminate it. The various chapters illustrate in the context of various countries and sectors around the world, the significant contributions that evaluators can make in terms of improvement of the analytical framework, analysis of the performance and results of specific programs and projects, as well as assessing and designing better public management systems in terms of poverty and inequality reduction. Beyond the specific contributions presented, three characteristics characterize those evaluations to be relevant for poverty and inequality analysis: a global-local approach: Global to move beyond disciplinary boundaries and consider cross-cutting issues, local to account for the diversity of countries, sectors, institutions and cultures considered; a problem-solving orientation: The issue evaluated is the core focus and determines the choice of evaluation methods to analyze this issue from a variety of angles; an evolutionary approach: Chapters presented are from iconoclasts who do not have any pre-established theory or school of thought to defend. This is the result of openness of mind and ability to adapt the analytical framework, the evaluation methods, and the interpretation of results in a constant interaction with the stakeholders. Such characteristics make evaluation a domain that can help understand better complex issues like poverty, inequality, vulnerability, and their interactions as well as propose a relevant and useful theory of change for public policies and projects to improve the plight of a large part of the world population in industrialized and developing countries alike.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication Evaluation in the Practice of Development(World Bank, Washington, DC, 2008-03)Knowledge about development effectiveness is constrained by two factors. First, the project staff in governments and international agencies who decide how much to invest in research on specific interventions are often not well informed about the returns to rigorous evaluation and (even when they are) cannot be expected to take full account of the external benefits to others from new knowledge. This leads to under-investment in evaluative research. Second, while standard methods of impact evaluation are useful, they often leave many questions about development effectiveness unanswered. The paper proposes ten steps for making evaluations more relevant to the needs of practitioners. It is argued that more attention needs to be given to identifying policy-relevant questions (including the case for intervention); that a broader approach should be taken to the problems of internal validity; and that the problems of external validity (including scaling up) merit more attention.Publication Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes(World Bank, Washington, DC, 2016-02)This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.
Users also downloaded
Showing related downloaded files
Publication Trade, Doha, and Development : A Window into the Issues(Washington, DC: World Bank, 2006)This book traces the development of world trade from the era when the global trading system had been stacked against growth in developing countries to the present time when the membership of the WTO has grown to include most developing countries. It is for this reason that the Doha Round is important: It has given all countries of the world the opportunity to work collectively on barriers of interest to developing countries and to the world's poor. Although the choice is simple, it is not easy. The underlying details of the issues are notoriously complex. Observers have a difficult time penetrating the veil of legal and economic opacity that envelops the negotiations. The details are sufficiently technical and multifarious that experts in one area are often unaware of technical details in another. And details make the difference between opening markets and merely appearing to do so through a vacuous agreement that looks good on the surface but does little or nothing to widen opportunities for poor traders in the global market place. This book provides succinct analyses of the most critical issues facing negotiators, highlighting the choices that most affect development. It is a window into the issues. The WTO negotiations are not the only ones shaping the world trading system. For one thing, regional trade agreements in growing numbers are introducing preferential trade arrangements between subsets of the international community. Then again, a third subject of international policy discussions-"aid for trade"-affects developing countries' opportunities to participate in the global market. This book details the pitfalls for the world economic system to avoid, and the author hopes that it will contribute to a better world trading system, one that is more equitable and more supportive of development.Publication Food Safety Handbook(Washington, DC: World Bank, 2020-04-08)The Food Safety Handbook: A Practical Guide for Building a Robust Food Safety Management System, contains detailed information on food safety systems and what large and small food industry companies can do to establish, maintain, and enhance food safety in their operations. This new edition updates the guidelines and regulations since the previous 2016 edition, drawing on best practices and the knowledge IFC has gained in supporting food business operators around the world. The Food Safety Handbook is indispensable for all food business operators -- anywhere along the food production and processing value chain -- who want to develop a new food safety system or strengthen an existing one.Publication The Health Gains, Financial Risk Protection Benefits, and Distributional Impact of Increased Tobacco Taxes in Armenia(Taylor and Francis, 2018-01)The majority of Armenian adult males smoke, yet tobacco taxes in Armenia are among the lowest in Europe and Central Asia. Increasing taxes on tobacco is one of the most cost-effective public health interventions, but many opponents often cite regressivity as an argument against tobacco taxation. We use a mixed-methods approach to study the potential regressivity of tobacco taxation and the extent to which the regressivity argument hindered increases in tobacco taxation in Armenia. First, we pursued an extended cost-effectiveness analysis (ECEA) to assess the health, financial, and distributional consequences (by consumption quintile) of increases in the excise tax on cigarettes in Armenia. We simulated a hypothetical price hike leading to a tax rate of about 75% of the retail price of cigarettes, which would be fully passed on to consumers. Second, we conducted a series of stakeholder interviews to examine the importance of the regressivity argument and identify the factors that allowed tobacco tax increases to be adopted as public policy in Armenia. We show that increased excise taxes would bring large health and financial benefits to Armenian households. Half of tobacco-related premature deaths and 27% of associated poverty cases averted would be concentrated among the bottom 40% of the population. Though regressivity was raised as a concern at the initial stages of the policy adoption process, our qualitative stakeholder analysis indicates that the recent accession to the Eurasian Economic Union and the fiscal constraints faced by the government created a window of opportunity for tobacco taxation to be placed on the policy agenda and adopted as government policy, and the ECEA findings were an important input into the process.Publication Integrating Social Protection and Early Childhood Development(Taylor and Francis, 2018-04-24)A pre-post design with 6–13-month follow-up assessed the feasibility and acceptability of a home-visiting intervention to promote early childhood development, improve parenting and shared decision-making, and reduce violence in impoverished Rwandan households. Twenty vulnerable families with a child 36-months or younger enrolled in Sugira Muryango. Measures of parenting, home environment, family-violence, decision-making, and health-status were administered at pre/post and follow-up. Families reported high satisfaction post-intervention. OMCI scores improved for 4.8% of mother-child dyads at post-intervention and 19.0% at follow-up, while 9.5% of dyads showed declines at both times. HOME Inventory scores improved for 9.5% and 14.3% of dyads at post-intervention and follow-up respectively and declined for 4.8% and 0.0%. Indicators for equal decision-making and child dietary-diversity improved at post-intervention and follow-up. Fewer mothers believed physical punishment was necessary at follow-up. Sugira Muryango shows promise for improving parenting, beliefs about harsh punishment, child nutritional status, and shared decision-making among vulnerable families.Publication Climate Change Law in Ghana(Washington, DC, 2022-11)This legal analysis provides an assessment of Ghana’s key legal and regulatory frameworks for the priorities highlighted in Ghana’s Nationally Determined Contributions (NDCs) and Ghana’s climate agenda more generally. The assessment includes an analysis of gaps or inconsistencies between the Government’s stated climate plans and commitments and existing national policy and legislation, with a view to evaluating the ability of existing legal frameworks to support Ghana’s delivery of its climate commitments and policy goals. The analysis focuses on four key sectors: water; agriculture, forestry, and other land use (AFOLU); energy; and transport. In addition, the legal analysis research team identified broader elements of the legal enabling environment in Ghana that are essential to the effective implementation of Ghana’s NDC and the achievement of Ghana’s climate policy goals; these elements include the country’s constitution, law-making and rulemaking processes, administrative and judicial enforcement mechanisms, environmental and social impact assessment laws and regulations, and the legal frameworks to mobilize public and private finance. The analysis proposes general and sector-specific recommendations to better align existing national policy and legislation with the Government’s national and international climate change commitments. The purpose, scope, and analytical framework for this legal analysis are presented in Chapter 1 and Annex I.