Publication: Statistical Performance Indicators and Index: A New Tool to Measure Country Statistical Capacity
Loading...
Published
2021-03
ISSN
Date
2021-03-25
Author(s)
Editor(s)
Abstract
The World Bank’s Statistical Capacity Index has been widely employed to measure country statistical capacity since its inception two decades ago. This paper builds on the existing advantages of the Statistical Capacity Index, conceptually and empirically, to offer new statistical performance indicators and the Statistical Performance Index, which can better measure a country’s statistical performance. The new index has clearer conceptual motivations, employs a stronger mathematical foundation, and significantly expands the number of indicators and countries covered. The paper further provides empirical evidence that illustrates the strong correlation of the new index with other commonly used development indicators of human capital, governance, poverty, and inequality. The framework can accommodate future directions to improve the index as the global data landscape evolves
Link to Data Set
Citation
“Pullinger, John; Dang, Hai-Anh H.; Serajuddin, Umar; Stacy, Brian. 2021. Statistical Performance Indicators and Index: A New Tool to Measure Country Statistical Capacity. Policy Research Working Paper;No. 9570. © World Bank. http://hdl.handle.net/10986/35301 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication Direct and Indirect Impacts of Transport Mobility on Access to Jobs: Evidence from South Africa(Washington, DC: World Bank, 2025-11-12)Access to jobs is essential for economic growth. In Africa, unemployment rates are notably high. This paper reexamines the relationship between transport mobility and labor market outcomes, with a particular focus on the direct and indirect effects of transport connectivity. As predicted by theory, wages are influenced by the level of commuting deterrence. Generally, higher earnings are associated with longer commute times and/or higher commuting costs. Local accessibility is also important, especially for individuals with time constraints. Both direct and indirect impacts are found to be significant in South Africa, where job accessibility has been challenging since the end of apartheid. For the direct impact, the wage elasticity associated with commuting costs is significant. Returns on commute are particularly high for women. Local accessibility to socioeconomic facilities, such as shops and health services, is also found to have a significant impact, consistent with the concept of mobility of care. To enhance employment, therefore, it is crucial to connect people not only to job locations but also to various socioeconomic points of interest, such as markets and hospitals, in an integrated manner. This integration will enable individuals to spend more time working and commuting longer distances.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication From Policy to Practice: Lessons from the Implementation of the Refugee Work Rights Policy in Ethiopia(Washington, DC: World Bank, 2025-11-10)This paper examines the early implementation of Ethiopia’s refugee work rights policy, with a focus on the issuance of permits that enable refugees to engage in economic activities. Building on significant legal and institutional advances under the 2019 Refugee Proclamation and subsequent directives, the analysis explores how these reforms are being operationalized in practice. Using a mixed-methods approach, combining document review, administrative data analysis, and semi-structured interviews, the paper identifies both progress and remaining challenges. Permit issuance has increased since the adoption of detailed operational guidance in 2024, reflecting the Government of Ethiopia’s commitment to operationalizing its progressive legal framework and ensuring that refugees can exercise their right to work. However, take-up remains modest, with about 5.2 percent of the working-age population holding a permit. Preliminary evidence suggests that coordination gaps, limited subnational capacity, low awareness among refugees and employers, and disincentives to formalize in a largely informal labor market are contributing to the low take-up. The paper offers policy suggestions, grounded in the Ethiopian context and emerging evidence, to help translate legal commitments into improved labor market outcomes for refugees.Publication Monitoring Global Aid Flows: A Novel Approach Using Large Language Models(Washington, DC: World Bank, 2025-11-04)Effective monitoring of development aid is the foundation for assessing the alignment of flows with their intended development objectives. Existing reporting systems, such as the Organisation for Economic Co-operation and Development’s Creditor Reporting System, provide standardized classification of aid activities but have limitations when it comes to capturing new areas like climate change, digitalization, and other cross-cutting themes. This paper proposes a bottom-up, unsupervised machine learning framework that leverages textual descriptions of aid projects to generate highly granular activity clusters. Using the 2021 Creditor Reporting System data set of nearly 400,000 records, the model produces 841 clusters, which are then grouped into 80 subsectors. These clusters reveal 36 emerging aid areas not tracked in the current Creditor Reporting System taxonomy, allow unpacking of “multi-sectoral” and “sector not specified” classifications, and enable estimation of flows to new themes, including World Bank Global Challenge Programs, International Development Association–20 Special Themes, and Cross-Cutting Issues. Validation against both Creditor Reporting System benchmarks and International Development Association commitment data demonstrates robustness. This approach illustrates how machine learning and the new advances in large language models can enhance the monitoring of global aid flows and inform future improvements in aid classification and reporting. It offers a useful tool that can support more responsive and evidence-based decision-making, helping to better align resources with evolving development priorities.
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Reviewing Assessment Tools for Measuring Country Statistical Capacity(Washington, DC: World Bank, 2024-03-11)Country statistical capacity is increasingly recognized as crucial for development, but no academic study exists that reviews the available assessment tools. This paper offers the first review study that fills this gap, paying particular attention to data and practical measurement challenges. It compares the World Bank’s recently developed Statistical Performance Indicators and Index with other widely used indexes, such as the Open Data Inventory index, the Global Data Barometer index, and other regional and self-assessment tools. The findings show that each index brings advantages in data sources, number of indicators, measurement focus, coverage of countries and time periods, and correlation with common development indexes. The Open Data Inventory index covers the most countries, the Global Data Barometer index collects data through its surveys, and the Statistical Performance Indicators and Index offer a broader framework for assessing statistical systems. The paper offers further thoughts on the potential mechanisms through which these tools can bring positive impacts on economic activities and some political economy concerns, as well as future directions for development.Publication Missing SDG Gender Indicators(Washington, DC: World Bank, 2023-08-15)The Sustainable Development Goal agenda lays out an ambitious set of 231 indicators to track progress. Countries continue to fall short in terms of reporting on the indicators in general, and this is particularly the case for the subset of 50 gender-related indicators, where countries reported on average on 31 percent of these indicators in at least one year from 2016 to 2020. A closer look at this low coverage reveals four salient fundings. First, this is not just a problem of missing data; lack of reporting on existing data is detected to be a problem. For example, of the 32 gender-related indicators that are sex disaggregated, if countries that had a population estimate also had a sex-disaggregated estimate (which is almost always feasible), the Sustainable Development Goal gender coverage rate would be 43 percent instead of 31 percent. Second, better statistical systems are a major part of the solution, as statistical system strength is correlated with higher coverage. Third, poorer countries are doing no worse in reporting on gender-related Sustainable Development Goal indicators than high-income countries, despite weaker statistical systems. Lastly, sizable over (and under) performance in reporting, conditional on statistical strength, suggests that country-level advocacy and focus can yield wins in Sustainable Development Goal gender indicator coverage.Publication Updating Poverty Estimates at Frequent Intervals in the Absence of Consumption Data : Methods and Illustration with Reference to a Middle-Income Country(World Bank Group, Washington, DC, 2014-09)Obtaining consistent estimates on poverty over time as well as monitoring poverty trends on a timely basis is a priority concern for policy makers. However, these objectives are not readily achieved in practice when household consumption data are neither frequently collected, nor constructed using consistent and transparent criteria. This paper develops a formal framework for survey-to-survey poverty imputation in an attempt to overcome these obstacles, and to elevate the discussion of these methods beyond the largely ad-hoc efforts in the existing literature. The framework introduced here imposes few restrictive assumptions, works with simple variance formulas, provides guidance on the selection of control variables for model building, and can be generally applied to imputation either from one survey to another survey with the same design, or to another survey with a different design. Empirical results analyzing the Household Expenditure and Income Survey and the Unemployment and Employment Survey in Jordan are quite encouraging, with imputation-based poverty estimates closely tracking the direct estimates of poverty.Publication Data Deprivation(World Bank, Washington, DC, 2015-04)The Millennium Development Goal of halving the incidence of extreme poverty from its 1990 level will be achieved in 2015, and the international development community is now moving to a new goal of “ending extreme poverty.” However, the data needed to monitor progress remain severely limited. During the 10 year period between 2002 and 2011, as many as 57 countries have zero or only one poverty estimate. This paper refers to such lack of poverty data as “data deprivation,” because the poor are often socially marginalized and voiceless, and the collection of objective and quantitative data is crucial in locating them and formulating policy to help them exit extreme deprivation. This paper studies the extent of data deprivation and proposes targets for ending data deprivation by 2030—the year by when the international community aims to end extreme poverty. According to the analysis in this paper, this target is ambitious but possible, and achieving it is necessary to be able to declare the end of extreme poverty with confidence.Publication Measuring the Statistical Capacity of Nations(World Bank, Washington, DC, 2019-01)The international development community has used the World Bank's Statistical Capacity Index since its inception in 2004. The Sustainable Development Goals create new challenges for national statistical systems to produce high-quality and internationally comparable data. This paper reviews measurement methodologies, posits desired attributes, and presents theoretical and empirical frameworks for the new, improved index to monitor progress in the statistical capacity of nations. The paper illustrates the properties of the updated index with global data from 2016.
Users also downloaded
Showing related downloaded files
Publication Data Transparency and Growth in Developing Economies during and after the Global Financial Crisis(World Bank, Washington, DC, 2020-12)The study explores the effects of data transparency on economic growth for developing economies over a unique time period—at the onset of the 2007–2009 global financial crisis and thereafter. Data transparency is defined as the timely production of credible statistics as measured by the Statistical Capacity Indicator. The paper finds that data transparency has a positive effect on real gross domestic product per capita during a period of considerable uncertainty. The estimates indicate an elasticity of the magnitude of 0.03 percent per year, which is much larger than the elasticity of trade openness and schooling in the estimation sample. The empirics employ a variety of econometric estimators, including dynamic panel and cross-sectional instrumental variables estimators, with the latter approach yielding a higher estimated elasticity. The findings are robust to the inclusion of several factors in addition to political institutions and exogenous commodity-price and external debt-financing shocks.Publication Governance in Sub-Saharan Africa in the 21st Century(Washington, DC: World Bank, 2024-03-04)What can be learned from the governance trajectory of African countries since the beginning of the 21st century What is the quality of governance on the African continent and how does it shape development The first decade of the millennium saw promising growth and poverty reduction in much of the continent. Yet, Sub-Saharan Africa has also been the stage of a stream of governance reform failures and policy reversals, and many countries continue to suffer from the consequences of poor governance. This paper explores the dynamics of governance reform on the continent over the past two decades and points to four key trends. First, effective state institutions, capable of maintaining peace, fostering growth, and delivering services, have developed unevenly. Second, progress has been made on enhancing the inclusiveness and accountability of institutions, but it remains constrained by the weakness of checks and balances and the persistence of patterns of centralized and exclusive power arrangements. Third, civic capacity has risen considerably, but the inability of institutions to respond to social expectations and political mobilization threatens to turn liberal civic engagement into distrust, populism, and radicalization. Fourth, the combination of these three trends contributes to the rise of political instability, which constitutes a major threat for the continent.Publication Economic Governance Improvements and Sovereign Financing Costs in Developing Countries(World Bank, Washington, DC, 2021-05)Low- and middle-income country governments are increasingly tapping the global debt capital markets. This is increasing the amount of finance available for development, but at a considerably higher cost than traditional external borrowing on concessional terms. Using a novel methodology based on estimating sovereign credit ratings using the Moody’s scorecard, and examining the associations between these ratings and the World Bank’s Country Policy and Institutional Assessment scores, this paper examines how making improvements in the quality of economic policies and institutions can help lower governments’ financing costs. This method aims to overcome the small-sample problem due to the number of rated developing country sovereigns still being relatively limited (although growing). Better economic governance Country Policy and Institutional Assessment scores are associated with better estimated ratings and materially lower financing costs; on average, improvements that are sufficient to increase the Country Policy and Institutional Assessment economic governance indicator score by one point are associated with interest costs that are lower by about 40 basis points, even setting aside the direct impact on ratings of better governance indicators. There are many reasons why improving governance is a good thing. Among them is the potential payoff to the public purse — savings of $40 million or more on a standard $1 billion, 10-year bond.Publication Evolution of the World Bank’s Thinking on Governance(World Bank, Washington, DC, 2016-01)The preparation work for the 2017 World Development Report on Governance and the Law in 2016 will coincide with the 25th anniversary of the World Bank’s decision to broaden its ongoing work on public sector management to embrace key issues of governance in the Bank’s borrowing countries. This paper provides a broad overview of the major Bank reports on governance that went through a review process at a sufficiently high level in the institution that they can reasonably be described as reflecting the Bank’s considered views at the time on the subject. The objective is to review the evolution of the Bank’s thinking on governance and assess the relevance and effectiveness of the work and its implications for the forthcoming World Development Report. Section two of this paper begins with a brief account of how the Bank came to focus on issues of governance, reviewing the major upheaval of governance in many of the Bank’s borrowing countries in the 1980s, the legal constraints the Articles of Agreement impose on the Bank’s work on governance, and a brief overview of the Bank’s initial policy statement on governance issued to the Bank’s Board in June 1991. Section three reviews major Bank work on governance as reflected in successive World Development Reports and examines the Bank’s analysis of the issue of corruption, reviewing how the Bank’s thinking on this symptom of poor governance has evolved. Section four steps back to assess what the Bank got right and some of the issues it missed or failed to address adequately. Section five draws attention to the dramatic changes experienced by the developing world in these past 25 years, and points to the need to better understand the implications of these changes for the governance context facing developing countries.Publication Approaches to Governance in Fragile and Conflict Situations(World Bank, Washington, DC, 2011-07)Developing a diagnostic and action framework for donor-assisted governance reform in conflict-affected countries and fragile states was the objective of a program implemented by the World Bank's Social Development Department (SDV) and funded by the French Ministry of Foreign Affairs. The first phase of the program developed lessons and outcomes based upon a review of international experience of governance reform in fragile and conflict-affected states. A major objective was to identify specific approaches and activities that will be most effective in strengthening institutions, promoting transparency and accountability, and enhancing capacity at local and national levels. This phase also derived lessons on the utility and shortcomings of governance-related diagnostic tools in designing and evaluating country strategies and programs in fragile states. A key issue concerns methodology. What type of analytical method provides a more useful assessment: country-specific analyses of the political economy, indicators designed for purposes of cross-country comparison, indices that rank state fragility, or some combination of diagnostic tools? The second phase of the program also was in two parts. Cote d'Ivoire's poverty reduction strategy process was used as an entry point for an initiative that facilitated process and method-oriented exercises for local stakeholders on the how rather than the what of policy development in an effort to build governance capacity. One result is a model that may serve for future engagement in other fragile and conflict-affected countries. The second part of this phase is an ongoing effort to work with local partners in the Central African Republic and Chad to identify strategies that could strengthen access to justice at the local level. Activities include assessing the strengths and weaknesses of formal and informal justice systems and mapping community-based practices and informal justice systems, including some under the aegis of NGOs, as well as identifying possible linkages to state justice systems. The paper will first examine the concepts of state fragility and governance in terms of donor engagement. Part two will discuss the lessons (opportunities and constraints), diagnostic tools and entry points for governance reform. Part three will offer conclusions.