Publication: The Search for the Perfect Indicator: Reflections on Monitoring and Evaluation of Resilience for Improved Climate Risk Management
Loading...
Files in English
411 downloads
Published
2019
ISSN
Date
2019-03-13
Author(s)
Engle, Nathan L.
Editor(s)
Abstract
Resilience-building activities are increasingly evident in development projects, and as a result, there is a growing focus on monitoring and evaluating the associated outcomes of these projects for improved climate risk management. Significant challenges in measuring resilience, however, contribute to both a tendency towards imperfect quantified metrics, and a quest for universal resilience indicators that can be aggregated across projects, institutions, and geographies. In this paper, we draw from lessons across various sectors typically outside of the traditional resilience and climate risk management realm to highlight potential pitfalls and unintended consequences of such metrics. We then discuss several “thought experiments” to identify the desired characteristics development practitioners would want projects to demonstrate, but for which there exist risks for imperfect aggregated indicators to create perverse incentives. Process-based metrics that focus on the quality of a project’s design and implementation are more likely to avoid these pitfalls and should be considered a viable alternative to aggregated universal resilience indicators.
Link to Data Set
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Disaster Risk, Climate Change, and Poverty(World Bank, Washington, DC, 2015-11)People living in poverty are particularly vulnerable to shocks, including those caused by natural disasters such as floods and droughts. Previous studies in local contexts have shown that poor people are also often overrepresented in hazard-prone areas. However, systematic evidence across countries demonstrating this finding is lacking. This paper analyzes at the country level whether poor people are disproportionally exposed to floods and droughts, and how this exposure may change in a future climate. To this end, household survey data with spatial identifiers from 52 countries are combined with present-day and future flood and drought hazard maps. The paper defines and calculates a “poverty exposure bias” and finds support that poor people are often overexposed to droughts and urban floods. For floods, no such signal is found for rural households, suggesting that different mechanisms—such as land scarcity—are more important drivers in urban areas. The poverty exposure bias does not change significantly under future climate scenarios, although the absolute number of people potentially exposed to floods or droughts can increase or decrease significantly, depending on the scenario and the region. The study finds some evidence of regional patterns: in particular, many countries in Africa exhibit a positive poverty exposure bias for floods and droughts. For these hot spots, implementing risk-sensitive land-use and development policies that protect poor people should be a priority.Publication The Impacts of Climate Change on Poverty in 2030 and the Potential from Rapid, Inclusive, and Climate-Informed Development(World Bank, Washington, DC, 2015-11)The impacts of climate change on poverty depend on the magnitude of climate change, but also on demographic and socioeconomic trends. An analysis of hundreds of baseline scenarios for future economic development in the absence of climate change in 92 countries shows that the drivers of poverty eradication differ across countries. Two representative scenarios are selected from these hundreds. One scenario is optimistic regarding poverty and is labeled “prosperity;” the other scenario is pessimistic and labeled “poverty.” Results from sector analyses of climate change impacts—in agriculture, health, and natural disasters—are introduced in the two scenarios. By 2030, climate change is found to have a significant impact on poverty, especially through higher food prices and reduction of agricultural production in Africa and South Asia, and through health in all regions. But the magnitude of these impacts depends on development choices. In the prosperity scenario with rapid, inclusive, and climate-informed development, climate change increases poverty by between 3 million and 16 million in 2030. The increase in poverty reaches between 35 million and 122 million if development is delayed and less inclusive (the poverty scenario).Publication Making Services Work : Indicators, Assessments, and Benchmarking of the Quality and Governance of Public Service Delivery in the Human Development Sectors(2011-06-01)Improving governance is central to improving results in human development. It is clear that money is not enough: improved outcomes from service delivery require better governance, including mechanisms for holding service providers accountable and appropriate incentives for performance. There is therefore a growing demand for indicators to measure how and whether these processes work, and how they affect health and education results. This paper makes the case for measuring governance policies and performance, and the quality of service delivery in health and education. It develops a framework for selecting and measuring a set of indicators and proposes options, drawing from new and innovative measurement tools and approaches. The paper proposes the adoption of a more systematic approach that will both facilitate the work of health and education policymakers and allow for cross-country comparisons and benchmarking.Publication Economic Resilience : Definition and Measurement(World Bank, Washington, DC, 2014-05)The welfare impact of a disaster does not only depend on the physical characteristics of the event or its direct impacts in terms of lost lives and assets. Welfare impacts also depend on the ability of the economy to cope, recover, and reconstruct and therefore to minimize aggregate consumption losses. This ability can be referred to as the macroeconomic resilience to natural disasters. Macroeconomic resilience has two components: instantaneous resilience, which is the ability to limit the magnitude of immediate production losses for a given amount of asset losses, and dynamic resilience, which is the ability to reconstruct and recover. Welfare impacts also depend on micro-economic resilience, which depends on the distribution of losses; on households' vulnerability, such as their pre-disaster income and ability to smooth shocks over time with savings, borrowing, and insurance, and on the social protection system, or the mechanisms for sharing risks across the population. The (economic) welfare disaster risk in a country can be reduced by reducing the exposure or vulnerability of people and assets (reducing asset losses), increasing macroeconomic resilience (reducing aggregate consumption losses for a given level of asset losses), or increasing microeconomic resilience (reducing welfare losses for a given level of aggregate consumption losses). The paper proposes rules of thumb to estimate macroeconomic and microeconomic resilience based on the relevant parameters in the economy. It also provides a toolbox of policies to increase macro- or micro-economic resilience and a list of indicators that can be used to build a resilience indicator.Publication Drought Preparedness in Brazil(Elsevier, 2014-01-09)Large portions of Brazil's Northeast have experienced an intense and prolonged drought for the majority of 2010–2013. This drought, along with other droughts that have hit the South in recent years, has sparked a new round of discussions to improve drought policy and management at the federal and state levels. To assist with these efforts, the World Bank recently conducted a series of evaluations on national and sub-national drought preparedness measures and approaches across five country case studies. This particular article presents the Brazilian case study. The work draws from interviews with key experts and stakeholders, as well as document analyses, and focuses on preparedness measures and approaches at the national and one sub-national case; the state of Ceará. The analysis shows that although there is a rich history of drought management throughout Brazil, there are short-term and long-term gaps and opportunities on which decision makers might consider focusing to improve monitoring, forecasting, and early warning systems, vulnerability/resilience and impact assessments, and mitigation and response planning measures.
Users also downloaded
Showing related downloaded files
Publication Data Transparency and Growth in Developing Economies during and after the Global Financial Crisis(World Bank, Washington, DC, 2020-12)The study explores the effects of data transparency on economic growth for developing economies over a unique time period—at the onset of the 2007–2009 global financial crisis and thereafter. Data transparency is defined as the timely production of credible statistics as measured by the Statistical Capacity Indicator. The paper finds that data transparency has a positive effect on real gross domestic product per capita during a period of considerable uncertainty. The estimates indicate an elasticity of the magnitude of 0.03 percent per year, which is much larger than the elasticity of trade openness and schooling in the estimation sample. The empirics employ a variety of econometric estimators, including dynamic panel and cross-sectional instrumental variables estimators, with the latter approach yielding a higher estimated elasticity. The findings are robust to the inclusion of several factors in addition to political institutions and exogenous commodity-price and external debt-financing shocks.Publication Evolution of the World Bank’s Thinking on Governance(World Bank, Washington, DC, 2016-01)The preparation work for the 2017 World Development Report on Governance and the Law in 2016 will coincide with the 25th anniversary of the World Bank’s decision to broaden its ongoing work on public sector management to embrace key issues of governance in the Bank’s borrowing countries. This paper provides a broad overview of the major Bank reports on governance that went through a review process at a sufficiently high level in the institution that they can reasonably be described as reflecting the Bank’s considered views at the time on the subject. The objective is to review the evolution of the Bank’s thinking on governance and assess the relevance and effectiveness of the work and its implications for the forthcoming World Development Report. Section two of this paper begins with a brief account of how the Bank came to focus on issues of governance, reviewing the major upheaval of governance in many of the Bank’s borrowing countries in the 1980s, the legal constraints the Articles of Agreement impose on the Bank’s work on governance, and a brief overview of the Bank’s initial policy statement on governance issued to the Bank’s Board in June 1991. Section three reviews major Bank work on governance as reflected in successive World Development Reports and examines the Bank’s analysis of the issue of corruption, reviewing how the Bank’s thinking on this symptom of poor governance has evolved. Section four steps back to assess what the Bank got right and some of the issues it missed or failed to address adequately. Section five draws attention to the dramatic changes experienced by the developing world in these past 25 years, and points to the need to better understand the implications of these changes for the governance context facing developing countries.Publication Economic Governance Improvements and Sovereign Financing Costs in Developing Countries(World Bank, Washington, DC, 2021-05)Low- and middle-income country governments are increasingly tapping the global debt capital markets. This is increasing the amount of finance available for development, but at a considerably higher cost than traditional external borrowing on concessional terms. Using a novel methodology based on estimating sovereign credit ratings using the Moody’s scorecard, and examining the associations between these ratings and the World Bank’s Country Policy and Institutional Assessment scores, this paper examines how making improvements in the quality of economic policies and institutions can help lower governments’ financing costs. This method aims to overcome the small-sample problem due to the number of rated developing country sovereigns still being relatively limited (although growing). Better economic governance Country Policy and Institutional Assessment scores are associated with better estimated ratings and materially lower financing costs; on average, improvements that are sufficient to increase the Country Policy and Institutional Assessment economic governance indicator score by one point are associated with interest costs that are lower by about 40 basis points, even setting aside the direct impact on ratings of better governance indicators. There are many reasons why improving governance is a good thing. Among them is the potential payoff to the public purse — savings of $40 million or more on a standard $1 billion, 10-year bond.Publication Governance in Sub-Saharan Africa in the 21st Century(Washington, DC: World Bank, 2024-03-04)What can be learned from the governance trajectory of African countries since the beginning of the 21st century What is the quality of governance on the African continent and how does it shape development The first decade of the millennium saw promising growth and poverty reduction in much of the continent. Yet, Sub-Saharan Africa has also been the stage of a stream of governance reform failures and policy reversals, and many countries continue to suffer from the consequences of poor governance. This paper explores the dynamics of governance reform on the continent over the past two decades and points to four key trends. First, effective state institutions, capable of maintaining peace, fostering growth, and delivering services, have developed unevenly. Second, progress has been made on enhancing the inclusiveness and accountability of institutions, but it remains constrained by the weakness of checks and balances and the persistence of patterns of centralized and exclusive power arrangements. Third, civic capacity has risen considerably, but the inability of institutions to respond to social expectations and political mobilization threatens to turn liberal civic engagement into distrust, populism, and radicalization. Fourth, the combination of these three trends contributes to the rise of political instability, which constitutes a major threat for the continent.Publication Statistical Performance Indicators and Index(World Bank, Washington, DC, 2021-03)The World Bank’s Statistical Capacity Index has been widely employed to measure country statistical capacity since its inception two decades ago. This paper builds on the existing advantages of the Statistical Capacity Index, conceptually and empirically, to offer new statistical performance indicators and the Statistical Performance Index, which can better measure a country’s statistical performance. The new index has clearer conceptual motivations, employs a stronger mathematical foundation, and significantly expands the number of indicators and countries covered. The paper further provides empirical evidence that illustrates the strong correlation of the new index with other commonly used development indicators of human capital, governance, poverty, and inequality. The framework can accommodate future directions to improve the index as the global data landscape evolves