Publication: The Mismeasure of Weather: Using Remotely Sensed Earth Observation Data in Economic Contexts
Loading...
Published
2025-01-08
ISSN
Date
2025-01-08
Editor(s)
Abstract
The availability of weather data from remotely sensed Earth observation data has reduced the cost of including weather variables in econometric models. Weather variables are common instrumental variables used to predict economic outcomes and serve as an input in modeling crop yields for rainfed agriculture. The use of Earth observation data in econometric applications has only recently been met with critical assessment of the suitability and quality of these data in economics. This paper quantifies the significance and magnitude of the effect of measurement error in Earth observation data in the context of smallholder agricultural productivity. The paper shows that different Earth observation sources use different measurement methods. The findings are not robust to the choice of Earth observation dataset, and the outcomes are not simply affine transformations of one another. Thus, the paper suggests that researchers should exercise caution in using these data and include robustness checks that test alternative sources of Earth observation data.
Link to Data Set
Citation
“Josephson, Anna; Michler, Jeffrey D.; Kilic, Talip; Murray, Siobhan. 2025. The Mismeasure of Weather: Using Remotely Sensed Earth Observation Data in Economic Contexts. Policy Research Working Paper; 11015. © World Bank. http://hdl.handle.net/10986/42636 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication Direct and Indirect Impacts of Transport Mobility on Access to Jobs: Evidence from South Africa(Washington, DC: World Bank, 2025-11-12)Access to jobs is essential for economic growth. In Africa, unemployment rates are notably high. This paper reexamines the relationship between transport mobility and labor market outcomes, with a particular focus on the direct and indirect effects of transport connectivity. As predicted by theory, wages are influenced by the level of commuting deterrence. Generally, higher earnings are associated with longer commute times and/or higher commuting costs. Local accessibility is also important, especially for individuals with time constraints. Both direct and indirect impacts are found to be significant in South Africa, where job accessibility has been challenging since the end of apartheid. For the direct impact, the wage elasticity associated with commuting costs is significant. Returns on commute are particularly high for women. Local accessibility to socioeconomic facilities, such as shops and health services, is also found to have a significant impact, consistent with the concept of mobility of care. To enhance employment, therefore, it is crucial to connect people not only to job locations but also to various socioeconomic points of interest, such as markets and hospitals, in an integrated manner. This integration will enable individuals to spend more time working and commuting longer distances.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication From Policy to Practice: Lessons from the Implementation of the Refugee Work Rights Policy in Ethiopia(Washington, DC: World Bank, 2025-11-10)This paper examines the early implementation of Ethiopia’s refugee work rights policy, with a focus on the issuance of permits that enable refugees to engage in economic activities. Building on significant legal and institutional advances under the 2019 Refugee Proclamation and subsequent directives, the analysis explores how these reforms are being operationalized in practice. Using a mixed-methods approach, combining document review, administrative data analysis, and semi-structured interviews, the paper identifies both progress and remaining challenges. Permit issuance has increased since the adoption of detailed operational guidance in 2024, reflecting the Government of Ethiopia’s commitment to operationalizing its progressive legal framework and ensuring that refugees can exercise their right to work. However, take-up remains modest, with about 5.2 percent of the working-age population holding a permit. Preliminary evidence suggests that coordination gaps, limited subnational capacity, low awareness among refugees and employers, and disincentives to formalize in a largely informal labor market are contributing to the low take-up. The paper offers policy suggestions, grounded in the Ethiopian context and emerging evidence, to help translate legal commitments into improved labor market outcomes for refugees.Publication Monitoring Global Aid Flows: A Novel Approach Using Large Language Models(Washington, DC: World Bank, 2025-11-04)Effective monitoring of development aid is the foundation for assessing the alignment of flows with their intended development objectives. Existing reporting systems, such as the Organisation for Economic Co-operation and Development’s Creditor Reporting System, provide standardized classification of aid activities but have limitations when it comes to capturing new areas like climate change, digitalization, and other cross-cutting themes. This paper proposes a bottom-up, unsupervised machine learning framework that leverages textual descriptions of aid projects to generate highly granular activity clusters. Using the 2021 Creditor Reporting System data set of nearly 400,000 records, the model produces 841 clusters, which are then grouped into 80 subsectors. These clusters reveal 36 emerging aid areas not tracked in the current Creditor Reporting System taxonomy, allow unpacking of “multi-sectoral” and “sector not specified” classifications, and enable estimation of flows to new themes, including World Bank Global Challenge Programs, International Development Association–20 Special Themes, and Cross-Cutting Issues. Validation against both Creditor Reporting System benchmarks and International Development Association commitment data demonstrates robustness. This approach illustrates how machine learning and the new advances in large language models can enhance the monitoring of global aid flows and inform future improvements in aid classification and reporting. It offers a useful tool that can support more responsive and evidence-based decision-making, helping to better align resources with evolving development priorities.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Estimating the Impact of Weather on Agriculture(World Bank, Washington, DC, 2021-11)This paper quantifies the significance and magnitude of the effect of measurement error in remote sensing weather data in the analysis of smallholder agricultural productivity. The analysis leverages 17 rounds of nationally-representative, panel household survey data from six countries in Sub-Saharan Africa. These data are spatially linked with a range of geospatial weather data sources and related metrics. The paper provides systematic evidence on measurement error introduced by (1) different methods used to obfuscate the exact GPS coordinates of households, (2) different metrics used to quantify precipitation and temperature, and (3) different remote sensing measurement technologies. First, the analysis finds no discernible effect of measurement error introduced by different obfuscation methods. Second, it finds that simple weather metrics, such as total seasonal rainfall and mean daily temperature, outperform more complex metrics, such as deviations in rainfall from the long-run average or growing degree days, in a broad range of settings. Finally, the analysis finds substantial amounts of measurement error based on remote sensing products. In extreme cases, the data drawn from different remote sensing products result in opposite signs for coefficients on weather metrics, meaning that precipitation or temperature drawn from one product purportedly increases crop output while the same metrics drawn from a different product purportedly reduces crop output. The paper concludes with a set of six best practices for researchers looking to combine remote sensing weather data with socioeconomic survey data.Publication Coping or Hoping?: Livelihood Diversification and Food Insecurity in the COVID-19 Pandemic(Washington, DC: World Bank, 2025-01-07)This paper examines the impact of livelihood diversification on food insecurity amid the COVID-19 pandemic. The analysis uses household panel data from Ethiopia, Malawi, and Nigeria in which the first round was collected immediately prior to the pandemic and extends through multiple rounds of monthly data collection during the pandemic. Using this pre- and post-outbreak data, and guided by a pre-analysis plan, the paper estimates the causal effect of livelihood diversification on food insecurity. The results do not support the hypothesis that livelihood diversification boosts household resilience. Although income diversification may serve as an effective coping mechanism for small-scale shocks, the findings show that for a disaster on the scale of the pandemic, this strategy is not effective. Policy makers looking to prepare for the increased occurrence of large-scale disasters will need to grapple with the fact that coping strategies that gave people hope in the past may fail them as they try to cope with the future.Publication The Evolving Socioeconomic Impacts of COVID-19 in Four African Countries(World Bank, Washington, DC, 2021-03)The paper provides evidence on the evolving socioeconomic impacts of the COVID-19 pandemic among households in Ethiopia, Malawi, Nigeria, and Uganda. The data allow estimating the immediate economic impacts of the pandemic, beginning in April 2020, and tracking how the situation evolved through September 2020. Although households have started to see recovery in income, business revenues, and food security, the gains have been relatively modest. Additionally, households have received very little outside assistance and their ability to cope with shocks remains limited. School closures have created a vacuum in education delivery and school-aged children have struggled to receive education services remotely.Publication Socioeconomic Impacts of COVID-19 in Four African Countries(World Bank, Washington, DC, 2020-11)The coronavirus disease 2019 (COVID-19) and the attempts to limit its spread have resulted in profound economic impacts, and a significant contraction in the global economy is expected. This paper provides some of the first evidence on the socioeconomic impacts of and responses to the pandemic among households and individuals in Sub-Saharan Africa. To do so, reduced-form econometric methods are applied to longitudinal household survey data from Ethiopia, Malawi, Nigeria, and Uganda -- originating from the pre-COVID-19 face-to-face household surveys and from the novel phone surveys that are being implemented during the pandemic. The headline findings are fourfold. First, although false beliefs about COVID-19 remain prevalent, government action to limit the spread of the disease is associated with greater individual knowledge of the disease and increased uptake of precautionary measures. Second, 256 million individuals -- 77 percent of the population in the four countries -- are estimated to live in households that have lost income due to the pandemic. Third, attempts to cope with this loss are exacerbated by the inability to access medicine and staple foods among 20 to 25 percent of the households in each country, and food insecurity is disproportionately borne by households that were already impoverished prior to the pandemic. Fourth, student-teacher contact has dropped from a pre-COVID-19 rate of 96 percent to just 17 percent among households with school-age children. These findings can help inform decisions by governments and international organizations on measures to mitigate the effects of the COVID-19 pandemic and reveal the need for continued monitoring.Publication Understanding the Requirements for Surveys to Support Satellite-Based Crop Type Mapping(World Bank, Washington, DC, 2021-04)With the surge in publicly available high-resolution satellite imagery, satellite-based monitoring of smallholder agricultural outcomes is gaining momentum. This paper provides recommendations on how large-scale household surveys should be conducted to generate the data needed to train models for satellite-based crop type mapping in smallholder farming systems. The analysis focuses on maize cultivation in Malawi and Ethiopia, and leverages rich, georeferenced plot-level data from national household surveys that were conducted in 2018–20 and that are integrated with Sentinel-2 satellite imagery and complementary geospatial data. To identify the approach to survey data collection that yields optimal data for training remote sensing models, 26,250 in silico experiments are simulated within a machine learning framework. The best model is then applied to map seasonal maize cultivation from 2016 to 2019 at 10-meter resolution in both countries. The analysis reveals that smallholder plots with maize cultivation can be identified with up to 75 percent accuracy. However, the predictive accuracy varies with the approach to georeferencing plot locations and the number of observations in the training data. Collecting full plot boundaries or complete plot corner points provides the best quality of information for model training. Classification performance peaks with slightly less than 60 percent of the training data. Seemingly small erosion in accuracy under less preferable approaches to georeferencing plots results in total area under maize cultivation being overestimated by 0.16 to 0.47 million hectares (8 to 24 percent) in Malawi.
Users also downloaded
Showing related downloaded files
Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.Publication The Journey Ahead(Washington, DC: World Bank, 2024-10-31)The Journey Ahead: Supporting Successful Migration in Europe and Central Asia provides an in-depth analysis of international migration in Europe and Central Asia (ECA) and the implications for policy making. By identifying challenges and opportunities associated with migration in the region, it aims to inform a more nuanced, evidencebased debate on the costs and benefits of cross-border mobility. Using data-driven insights and new analysis, the report shows that migration has been an engine of prosperity and has helped address some of ECA’s demographic and socioeconomic disparities. Yet, migration’s full economic potential remains untapped. The report identifies multiple barriers keeping migration from achieving its full potential. Crucially, it argues that policies in both origin and destination countries can help maximize the development impacts of migration and effectively manage the economic, social, and political costs. Drawing from a wide range of literature, country experiences, and novel analysis, The Journey Ahead presents actionable policy options to enhance the benefits of migration for destination and origin countries and migrants themselves. Some measures can be taken unilaterally by countries, whereas others require close bilateral or regional coordination. The recommendations are tailored to different types of migration— forced displacement as well as high-skilled and low-skilled economic migration—and from the perspectives of both sending and receiving countries. This report serves as a comprehensive resource for governments, development partners, and other stakeholders throughout Europe and Central Asia, where the richness and diversity of migration experiences provide valuable insights for policy makers in other regions of the world.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.