Publication: Development Evaluation in Times of Turbulence : Dealing with Crises that Endanger Our Future
Loading...
Files in English
5,414 downloads
Published
2013-04-19
ISSN
Date
2013-04-24
Author(s)
Abstract
The presence of turbulence in multiple areas of our society--food, fuel, and finances-being but three critical areas presently being impacted means that long-held assumptions are no longer true, that the past is not prologue, and that the future is not clear. And enter into this unstable present the discipline of evaluation-a discipline formed and shaped in the past fifty years of stability, little turbulence, and strong assumptions that everything will go according to plan. If things do not go well, it is because of either a poor theory of change on how to bring about positive outcomes, or weak efforts at implementation. It is not because of the stormy present upsetting our quiet past. As it is, conventional evaluation behavior and beliefs are ill suited for these times. The transformational nature of the 'Arab Spring' is just one arena in which it is clear that a business as usual approach to evaluation is entirely inappropriate. The papers in this volume are from the 2011 Global Assembly of the International Development Evaluation Association (IDEAS). Nearly 350 development evaluators from eighty-five countries came together in Amman, Jordan to discuss and analyze the consequences of turbulence on evaluation. The intent of these papers is to systematically assess what changes have come during this time of turbulence and how these changes are impacting the craft of development evaluation. To be clear: this book is not about how to assess the impacts of crises on development and on people's lives. It is about the meaning of a changed world and changed assumptions on the concepts and methods used in evaluation.
Link to Data Set
Citation
“Boily, Marie-Helene; Rist, Ray C.; Martin, Frederic R.. Rist, Ray C.; Boily, Marie-Helene; Martin, Frederic R., editors. 2013. Development Evaluation in Times of Turbulence : Dealing with Crises that Endanger Our Future. © World Bank. http://hdl.handle.net/10986/13265 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Influencing Change : Building Evaluation Capacity to Strengthen Governance(World Bank, 2011-03-28)Evaluation Capacity Building (ECB) is an often-discussed topic in developing countries and their partner international institutions. This book takes on an elusive yet frequently mentioned concept in development evaluation ECB. Differences and divergences were apparent in the spring of 2009, when the International Development Evaluation Association (IDEAS) held its biannual global assembly in Johannesburg, South Africa, around the theme of 'getting to results: evaluation capacity building and development.' What became apparent was that a number of challenges had already been identified, but that trying to capture lessons learned on effective strategies was difficult, because of the failure to agree upon a unique and coherent definition of ECB, its various objectives and wide scope, and the diversity of institutional contexts in which it takes place. This book brings together the key papers from that global assembly, as well as new papers that reflect on what was learned and shared at the conference.Publication Poverty, Inequality, and Evaluation(Washington, DC: World Bank, 2016)The basic premise of this book is that the conversation on the future of development needs to shift from a focus on poverty to that of inequality. The poverty emphasis is in an intellectual and political cul de sac. It does not address the fundamental question of why people are poor nor what can be done structurally and institutionally to reduce and eliminate it. The various chapters illustrate in the context of various countries and sectors around the world, the significant contributions that evaluators can make in terms of improvement of the analytical framework, analysis of the performance and results of specific programs and projects, as well as assessing and designing better public management systems in terms of poverty and inequality reduction. Beyond the specific contributions presented, three characteristics characterize those evaluations to be relevant for poverty and inequality analysis: a global-local approach: Global to move beyond disciplinary boundaries and consider cross-cutting issues, local to account for the diversity of countries, sectors, institutions and cultures considered; a problem-solving orientation: The issue evaluated is the core focus and determines the choice of evaluation methods to analyze this issue from a variety of angles; an evolutionary approach: Chapters presented are from iconoclasts who do not have any pre-established theory or school of thought to defend. This is the result of openness of mind and ability to adapt the analytical framework, the evaluation methods, and the interpretation of results in a constant interaction with the stakeholders. Such characteristics make evaluation a domain that can help understand better complex issues like poverty, inequality, vulnerability, and their interactions as well as propose a relevant and useful theory of change for public policies and projects to improve the plight of a large part of the world population in industrialized and developing countries alike.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication Evaluation in the Practice of Development(World Bank, Washington, DC, 2008-03)Knowledge about development effectiveness is constrained by two factors. First, the project staff in governments and international agencies who decide how much to invest in research on specific interventions are often not well informed about the returns to rigorous evaluation and (even when they are) cannot be expected to take full account of the external benefits to others from new knowledge. This leads to under-investment in evaluative research. Second, while standard methods of impact evaluation are useful, they often leave many questions about development effectiveness unanswered. The paper proposes ten steps for making evaluations more relevant to the needs of practitioners. It is argued that more attention needs to be given to identifying policy-relevant questions (including the case for intervention); that a broader approach should be taken to the problems of internal validity; and that the problems of external validity (including scaling up) merit more attention.Publication Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes(World Bank, Washington, DC, 2016-02)This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.
Users also downloaded
Showing related downloaded files
Publication Latin America and the Caribbean Economic Review, October 2024: Taxing Wealth for Equity and Growth(Washington, DC: World Bank, 2024-10-09)The report highlights the progress made on inflation and, despite some resistance in the last mile, the resulting fall in interest rates that will ease pressures on debt service and investment. However, growth is projected to remain low, debt remains high, private and public investment is depressed, and the region appears to be missing the boat on nearshoring FDI. The need to generate more fiscal space, reduce the high corporate tax burden, and mitigate persistent inequality have moved wealth taxes to center stage. But traditional wealth taxes on financial assets face challenges due to the ease of moving and hiding assets which will be difficult to control without elusive global coordination. A viable alternative is a tax on real estate which is less mobile, easier to track, and less of a distortionary burden on economic activity, given the low initial rates. Property taxes also have the potential to reduce the excessive dependence of subnational governments on federal transfers. For property taxes to play a greater role, there must be improvements in property valuation which can be engineered through the use of digital platforms and centralized land registries.Publication Rethinking Caribbean Tourism(Washington, DC: World Bank, 2025-03-26)This report assesses the current performance of tourism in the Caribbean1 and, in light of the new trends, identifies future pathways and policies for sustainable growth in three targeted segments. These segments were selected to include the traditional markets of cruise and all-inclusive resort accommodation as well as new opportunities in the high-value segment of adventure tourism. Cruise and all-inclusive resorts continue to be priorities for governments as they provide jobs, stimulate foreign direct investment (FDI), and generate the majority of regional demand (WTTC, 2022) (CTO, 2020). However, influence and market power in these segments have also created environmental and social risks and inhibited tourism diversification. Adventure tourism offers potential to add value and diversity to the rich endowment of natural and cultural assets and expand the value proposition and local economic impact of traditional markets. Additionally, it can create a new ecosystem of suppliers appealing to an entirely different market segment of high-spending tourists. Segment selection was based on analysis of current impacts, growth projections, and scales of environmental and social externalities that examined the importance and value of the segments to the Caribbean. It also integrated feedback from consultations with key stakeholders and alignment with national policies and trends.Publication Timor-Leste Economic Report, December 2022(Washington, DC, 2022-12)The global economy continues to face steep challenges, but Timor-Leste’s economy is slowly recovering. Nevertheless, gross domestic product (GDP) per capita has not returned to pre-pandemic levels. Consumer price inflation reached 7.9 percent yoy in August 2022, one of the highest in the East Asia Pacific region. The real effective exchange rate (REER) has appreciated by about 10 percent since the first quarter of 2021. Enhancing productive capabilities through structural reforms and improving quality of public spending hold the key for accelerating and sustaining economic development. Extending the life of petroleum fund through fiscal consolidation is essential to delay the fiscal cliff and ensure the perpetuation of government spending to support economic growth. Despite receding impact of the pandemic, the level of government spending has not returned to the pre-COVID 19 levels.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Vietnam(World Bank, Hanoi, 2020-05-01)Following from Vietnam’s ratification of the Comprehensive and Progressive Agreement for Trans-Pacific Partnership (CPTPP) in late 2018 and its effectiveness from January 2019, and the European Parliament’s recent approval of the European Union-Vietnam Free Trade Agreement (EVFTA) and its subsequent planned ratification by the National Assembly in May 2020, Vietnam has further demonstrated its determination to be a modern, competitive, open economy. As the COVID-19 (Coronavirus) crisis has clearly shown, diversified markets and supply chains will be key in the future global context to managing the risk of disruptions in trade and in supply chains due to changing trade relationships, climate change, natural disasters, and disease outbreaks. In those regards, Vietnam is in a stronger position than most countries in the region. The benefits of globalization are increasingly being debated and questioned. However, in the case of Vietnam, the benefits have been clear in terms of high and consistent economic growth and a large reduction in poverty levels. As Vietnam moves to ratify and implement a new generation of free trade agreements (FTAs), such as the CPTPP and EVFTA, it is important to clearly demonstrate, in a transparent manner, the economic gains and distributional impacts (such as sectoral and poverty) from joining these FTAs. In the meantime, it is crucial to highlight the legal gaps that must be addressed to ensure that national laws and regulations are in compliance with Vietnam’s obligations under these FTAs. Readiness to implement this new generation of FTAs at both the national and subnational level is important to ensure that the country maximizes the full economic benefits in terms of trade and investment. This report explores the issues of globalization and the integration of Vietnam into the global economy, particularly through implementation of the EVFTA.