Publication: Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage
Loading...
Date
2021-07
ISSN
Published
2021-07
Author(s)
Editor(s)
Abstract
Advances in agricultural data production provide ever-increasing opportunities for pushing the research frontier in agricultural economics and designing better agricultural policy. As new technologies present opportunities to create new and integrated data sources, researchers face trade-offs in survey design that may reduce measurement error or increase coverage. This paper first reviews the econometric and survey methodology literatures that focus on the sources of measurement error and coverage bias in agricultural data collection. Second, it provides examples of how agricultural data structure affects testable empirical models. Finally, it reviews the challenges and opportunities offered by technological innovation to meet old and new data demands and address key empirical questions, focusing on the scalable data innovations of greatest potential impact for empirical methods and research.
Link to Data Set
Citation
“Carletto, Calogero; Dillon, Andrew; Zezza, Alberto. 2021. Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage. Policy Research Working Paper;No. 9745. © World Bank. http://hdl.handle.net/10986/36056 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication From Tailwinds to Headwinds(Washington, DC: World Bank, 2025-07-10)The first quarter of the twenty-first century has been transformative for emerging market and developing economies (EMDEs). These economies now account for about 45 percent of global GDP, up from about 25 percent in 2000, a trend driven by robust collective growth in the three largest EMDEs—China, India, and Brazil (the EM3). Collectively, EMDEs have contributed about 60 percent of annual global growth since 2000, on average, double the share during the 1990s. Their ascendance was powered by swift global trade and financial integration, especially during the first decade of the century. Interdependence among these economies has also increased markedly. Today, nearly half of goods exports from EMDEs go to other EMDEs, compared to one-quarter in 2000. As cross-border linkages have strengthened, business cycles among EMDEs and between EMDEs and advanced economies have become more synchronized, and a distinct EMDE business cycle has emerged. Cross-border business cycle spillovers from the EM3 to other EMDEs are sizable, at about half of the magnitude of spillovers from the largest advanced economies (the United States, the euro area, and Japan). Yet EMDEs confront a host of headwinds at the turn of the second quarter of the century. Progress implementing structural reforms in many of these economies has stalled. Globally, protectionist measures and geopolitical fragmentation have risen sharply. High debt burdens, demographic shifts, and the rising costs of climate change weigh on economic prospects. A successful policy approach to accelerate growth and development should focus on boosting investment and productivity, navigating a difficult external environment, and enhancing macroeconomic stability.Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Missing(ness) in Action : Selectivity Bias in GPS-Based Land Area Measurements(World Bank, Washington, DC, 2013-06)Land area is a fundamental component of agricultural statistics, and of analyses undertaken by agricultural economists. While household surveys in developing countries have traditionally relied on farmers' own, potentially error-prone, land area assessments, the availability of affordable and reliable Global Positioning System (GPS) units has made GPS-based area measurement a practical alternative. Nonetheless, in an attempt to reduce costs, keep interview durations within reasonable limits, and avoid the difficulty of asking respondents to accompany interviewers to distant plots, survey implementing agencies typically require interviewers to record GPS-based area measurements only for plots within a given radius of dwelling locations. It is, therefore, common for as much as a third of the sample plots not to be measured, and research has not shed light on the possible selection bias in analyses relying on partial data due to gaps in GPS-based area measures. This paper explores the patterns of missingness in GPS-based plot areas, and investigates their implications for land productivity estimates and the inverse scale-land productivity relationship. Using Multiple Imputation (MI) to predict missing GPS-based plot areas in nationally-representative survey data from Uganda and Tanzania, the paper highlights the potential of MI in reliably simulating the missing data, and confirms the existence of an inverse scale-land productivity relationship, which is strengthened by using the complete, multiply-imputed dataset. The study demonstrates the usefulness of judiciously reconstructed GPS-based areas in alleviating concerns over potential measurement error in farmer-reported areas, and with regards to systematic bias in plot selection for GPS-based area measurement.Publication Fact or Artefact : The Impact of Measurement Errors on the Farm Size - Productivity Relationship(2011-12-01)This paper revisits the role of land measurement error in the inverse farm size and productivity relationship. By making use of data from a nationally representative household survey from Uganda, in which self-reported land size information is complemented by plot measurements collected using Global Position System devices, the authors reject the hypothesis that the inverse relationship may just be a statistical artifact linked to problems with land measurement error. In particular, the paper explores: (i) the determinants of the bias in land measurement, (ii) how this bias varies systematically with plot size and landholding, and (iii) the extent to which land measurement error affects the relative advantage of smallholders implied by the inverse relationship. The findings indicate that using an improved measure of land size strengthens the evidence in support of the existence of the inverse relationship.Publication Recall Length and Measurement Error in Agricultural Surveys(World Bank, Washington, DC, 2020-01)This paper assesses the relationship between the length of recall and nonrandom error in agricultural survey data. Using data from the World Bank's Living Standards Measurement Study–Integrated Surveys on Agriculture in Malawi and Tanzania, the paper shows that key input and output variables are systematically related to the length of the recall period, indicating the presence of nonrandom measurement error. With longer recall periods, farmers report greater quantities of harvest, labor, and fertilizer inputs. Farmers list fewer plots as the recall period increases. The paper argues that it is plausible that farmers overestimate plot-level outcomes, or they forget some of their more marginal plots due to longer recall periods. The analysis also finds evidence of measurement error related to the length of recall in common measures of agricultural productivity. The size of the recall effect typically varies between 2 and 5 percent per additional month of recall length, which is economically significant. With data reliability affecting policy effectiveness, improving agricultural survey data quality remains an important concern. Mainstreaming objective measures where possible and reducing the risk of recall error through shorter recall periods appear to be promising avenues to improve the quality of key variables in agricultural surveys.Publication Food Counts - Measuring Food Consumption and Expenditures in Household Consumption and Expenditure Surveys(Elsevier, 2017-10)This introductory paper presents the results of an international multi-disciplinary research project on the measurement of food consumption in national household surveys. Food consumption data from household surveys are possibly the single most important source of information on poverty, food security, and nutrition outcomes at national, sub-national and household level, and contribute building blocks to global efforts to monitor progress towards the major international development goals. The paper synthesizes case studies from a diverse set of developing and OECD countries, looking at some of the main outstanding research issues as identified by a recent international assessment of 100 existing national household surveys (Smith et al., 2014). The project mobilized expertise from different disciplines (statistics, economics, food security, nutrition) to work towards enhancing our understanding of how to improve the quality and availability of food consumption and expenditure data, while making them more valuable for a diverse set of users. The individual studies summarized in this paper analyze, both theoretically and empirically, how different surveys design options affect the quality of the data being collected and, in turn, the implications for statistical inference and policy analysis. The conclusions and recommendations derived from this collection of studies will be instrumental in advancing the methodological agenda for the collection of household level food data, and will provide national statistical offices and survey practitioners worldwide with practical insights for survey design, while providing poverty, food and nutrition policymakers with greater understanding of these issues, as well as improved tools for and better guidance in policy formulation.Publication From Guesstimates to GPStimates : Land Area Measurement and Implications for Agricultural Analysis(World Bank, Washington, DC, 2013-07)Land area measurement is a fundamental component of agricultural statistics and analysis. Yet, commonly employed self-reported land area measures used in most analysis are not only potentially measured with error, but these errors may be correlated with agricultural outcomes. Measures employing Global Positioning Systems, on the other hand, while not perfect especially on smaller plots, are likely to provide more precise measures and errors less correlated with agricultural outcomes. This paper uses data from four African countries to compare the use of self-reported and Global Positioning Systems land measures to (1) examine the differences between the measures, (2) identify the sources of the differences, and (3) assess the implications of the different measures on agricultural analysis focusing on the inverse productivity relationship. The results indicate that self-reported land areas systematically differ from Global Positioning Systems land measures and that this difference leads to potentially biased estimates of the relationship between land and productivity.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication World Development Report 1984(New York: Oxford University Press, 1984)Long-term needs and sustained effort are underlying themes in this year's report. As with most of its predecessors, it is divided into two parts. The first looks at economic performance, past and prospective. The second part is this year devoted to population - the causes and consequences of rapid population growth, its link to development, why it has slowed down in some developing countries. The two parts mirror each other: economic policy and performance in the next decade will matter for population growth in the developing countries for several decades beyond. Population policy and change in the rest of this century will set the terms for the whole of development strategy in the next. In both cases, policy changes will not yield immediate benefits, but delay will reduce the room for maneuver that policy makers will have in years to come.