Publication: Survey Measurement Errors and the Assessment of the Relationship between Yields and Inputs in Smallholder Farming Systems: Evidence from Mali
Loading...
Date
2021-11
ISSN
Published
2021-11
Author(s)
Editor(s)
Abstract
An accurate understanding of how input use affects agricultural productivity in smallholder farming systems is key to designing policies that can improve productivity, food security, and living standards in rural areas. Studies examining the relationships between agricultural productivity and inputs typically rely on land productivity measures, such as crop yields, that are informed by self-reported survey data on crop production. This paper leverages unique survey data from Mali to demonstrate that self-reported crop yields, vis-à-vis (objective) crop cut yields, are subject to non-classical measurement error that in turn biases the estimates of returns to inputs, including land, labor, fertilizer, and seeds. The analysis validates an alternative approach to estimate the relationship between crop yields and agricultural inputs using large-scale surveys, namely a within-survey imputation exercise that derives predicted, otherwise unobserved, objective crop yields that stem from a machine learning model that is estimated with a random subsample of plots for which crop cutting and self-reported yields are both available. Using data from a methodological survey experiment and a nationally representative survey conducted in Mali, the analysis demonstrates that it is possible to obtain predicted objective sorghum yields with attenuated non-classical measurement error, resulting in a less biased assessment of the relationship between yields and agricultural inputs. The discussion expands on the implications of the findings for (i) future research on agricultural intensification, and (ii) the design of future surveys in which objective data collection could be limited to a subsample to save costs, with the intention to apply the suggested machine learning approach.
Link to Data Set
Citation
“Yacoubou Djima, Ismael; Kilic, Talip. 2021. Survey Measurement Errors and the Assessment of the Relationship between Yields and Inputs in Smallholder Farming Systems: Evidence from Mali. Policy Research Working Paper;No. 9841. © World Bank. http://hdl.handle.net/10986/36553 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication Exports, Labor Markets, and the Environment(Washington, DC: World Bank, 2025-07-14)What is the environmental impact of exports? Focusing on 2000–20, this paper combines customs, administrative, and census microdata to estimate employment elasticities with respect to exports. The findings show that municipalities that faced increased exports experienced faster growth in formal employment. The elasticities were 0.25 on impact, peaked at 0.4, and remained positive and significant even 10 years after the shock, pointing to a long and protracted labor market adjustment. In the long run, informal employment responds negatively to export shocks. Using a granular taxonomy for economic activities based on their environmental impact, the paper documents that environmentally risky activities have a larger share of employment than environmentally sustainable ones, and that the relationship between these activities and exports is nuanced. Over the short run, environmentally risky employment responds more strongly to exports relative to environmentally sustainable employment. However, over the long run, this pattern reverses, as the impact of exports on environmentally sustainable employment is more persistent.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication Impact of Heat Waves on Learning Outcomes and the Role of Conditional Cash Transfers(Washington, DC: World Bank, 2025-07-14)This paper evaluates the impact of higher temperatures on learning outcomes in Peru. The results suggest that 1 degree above 20°C is equivalent to 7 and 6 percent of a standard deviation of what a student learns in a year for math and reading tests, respectively. These results hold true when the main specification is changed, splitting the sample, collapsing the data at school level, and using other climate specifications. The paper aims to improve understanding of how to deal with the impacts of climate change on learning outcomes in developing countries. The evidence suggests that conditional cash transfer programs can mitigate the negative effects of higher temperatures on students’ learning outcomes in math and reading.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Yielding Insights(Washington, DC: World Bank, 2024-11-06)This paper addresses the challenge of missing crop yield data in large-scale agricultural surveys, where crop-cutting, the most accurate method for yield measurement, is often limited due to cost constraints. Multiple imputation techniques, supported by machine learning models are used to predict missing yield data. This method is validated using survey data from Mali, which includes both crop-cut and self-reported yield information. The analysis covers several crops, providing insights into the importance of different predictors, including farmer-reported yields and geo-spatial variables, and the conditions under which the approach is valid. The findings show that machine learning-based imputations can provide accurate yield estimates, especially for crops with low intercropping rates and higher commercialization. However, survey-to-survey imputations are less accurate than within-survey imputations, suggesting limitations in extrapolating data across different survey rounds. The study contributes valuable insights into improving cost-efficiency in agricultural surveys and the potential of imputation methods.Publication Decentralized Beneficiary Targeting in Large-Scale Development Programs : Insights from the Malawi Farm Input Subsidy Program(World Bank, Washington, DC, 2013-11)This paper contributes to the long-standing debate on the merits of decentralized beneficiary targeting in the administration of development programs, focusing on the large-scale Malawi Farm Input Subsidy Program. Nationally-representative household survey data are used to systematically analyze the decentralized targeting performance of the program during the 2009-2010 agricultural season. The analysis begins with a standard targeting assessment based on the rates of program participation and the benefit amounts among the eligible and non-eligible populations, and provides decompositions of the national targeting performance into the inter-district, intra-district inter-community, and intra-district intra-community components. This approach identifies the relative contributions of targeting at each level. The results show that the Farm Input Subsidy Program is not poverty targeted and that the national government, districts, and communities are nearly uniform in their failure to target the poor, with any minimal targeting (or mis-targeting) overwhelmingly materializing at the community level. The findings are robust to the choice of the eligibility indicator and the decomposition method. The multivariate analysis of household program participation reinforces these results and reveals that the relatively well-off, rather than the poor or the wealthiest, and the locally well-connected have a higher likelihood of program participation and, on average, receive a greater number of input coupons. Since a key program objective is to increase food security and income among resource-poor farmers, the lack of targeting is a concern and should underlie considerations of alternative targeting approaches that, in part or completely, rely on proxy means tests at the local level.Publication Should African Rural Development Strategies Depend on Smallholder Farms? An Exploration of the Inverse Productivity Hypothesis(World Bank, Washington, DC, 2012-09)In Africa, most development strategies include efforts to improve the productivity of staple crops grown on smallholder farms. An underlying premise is that small farms are productive in the African context and that smallholders do not forgo economies of scale -- a premise supported by the often observed phenomenon that staple cereal yields decline as the scale of production increases. This paper explores a research design conundrum that encourages researchers who study the relationship between productivity and scale to use surveys with a narrow geographic reach, when policy would be better served with studies based on wide and heterogeneous settings. Using a model of endogenous technology choice, the authors explore the relationship between maize yields and scale using alternative data. Since rich descriptions of the decision environments that farmers face are needed to identify the applied technologies that generate the data, improvements in the location specificity of the data should reduce the likelihood of identification errors and biased estimates. However, the analysis finds that the inverse productivity hypothesis holds up well across a broad platform of data, despite obvious shortcomings with some components. It also finds surprising consistency in the estimated scale elasticities.Publication Non-traditional Crops, Traditional Constraints : Long-Term Welfare Impacts of Export Crop Adoption among Guatemalan Smallholders(2009-11-01)This study documents the long-term welfare effects of household non-traditional agricultural export (NTX) adoption. The analysis uses a unique panel dataset, which spans the period 1985-2005, and employs difference-in-differences estimation to investigate the long-term impact of non-traditional agricultural export adoption on changes in household consumption status and asset position in the Central Highlands of Guatemala. Given the heterogeneity in adoption patterns, the analysis differentiates the impact estimates based on a classification of households that takes into account the timing and duration of non-traditional agricultural export adoption. The results show that while, on average, welfare levels have improved for all households irrespective of adoption status and duration, the extent of improvement has varied across groups. Long-term adopters exhibit the smallest increase in the lapse of two decades, in spite of some early gains. Conversely, early adopters who withdrew from non-traditional agricultural export production after reaping the benefits of the boom period of the 1980s are found to have fared better and shown greater improvements in durable asset position and housing conditions than any other category.Publication Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies(World Bank, Washington, DC, 2022-01)This paper reports on a randomized experiment conducted among Malawian agricultural households to study nonclassical measurement error in self-reported plot area and farmers’ responses to new information (the objective plot area measure) that was provided to correct nonclassical measurement error. Farmers' pre-treatment self-reported plot areas exhibit considerable nonclassical measurement error, most of which follows a regression-to-mean pattern with respect to plot area, and another 18 percent of which arises from asymmetric rounding to half-acre increments. Randomized provision of GPS-based measures of true plot area generates four important findings. First, farmers incompletely update mistaken self-reports; most nonclassical measurement error persists even after the provision of true plot area measures. Second, farmers update asymmetrically in response to information, with upward corrections being far more common than downward ones even though most plot sizes were initially overestimated. Third, the magnitude of updating varies by true plot area and the magnitude and direction of initial nonclassical measurement error. Fourth, the information treatment affects self-reported information about non-land inputs, such as fertilizer and labor, indicating that the effects of measurement error and updating spill over across variables. Nonclassical measurement error reflects behavioral anomalies and carries implications for both survey data collection methods and the design of information-based interventions.
Users also downloaded
Showing related downloaded files
Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Geothermal Handbook(World Bank, Washington, DC, 2012-06)Developing countries face multiple and complex challenges in securing affordable and reliable energy supplies to support sustainable economic development. These challenges can be addressed by increased access to modern energy infrastructure, enhanced energy security through supply diversification, and transition to low carbon paths to meet rising energy demands. There is broad consensus that renewable energy has a major role to play in addressing these challenges. In recent years, support for renewable energy investment has become a mainstream activity for multilateral development banks and their clients. The World Bank, for instance, has supported geothermal development in Africa, Asia, Europe, and Latin America. Global analytical work and technical assistance on clean energy are also one of the major program areas of the Energy Sector Management Assistance Program (ESMAP). This handbook is dedicated to geothermal energy as a source of electric power for developing countries. Many developing countries are endowed with substantial geothermal resources that could be more actively put to use. On top of the benefits stemming from its renewable nature, geothermal energy has several additional advantages, including the provision of stable and reliable power at a relatively low cost, around the clock, and with few operational or technological risks.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Dominican Republic Poverty Assessment 2023(Washington, DC: World Bank, 2023-11-08)In recent decades, economic growth in the Dominican Republic (DR) has been steady. However, growth has not occurred in such a way as to make the benefits widely and evenly available. In fact, although the DR economy grew faster than that of other LAC countries before the Covid-19 pandemic, its poverty rates and social outcomes remain broadly similar to them. This report seeks to explain this conundrum, as well as to expand the knowledge base to improve the effectiveness of ongoing poverty reduction policies in the DR. The Poverty Assessment draws primarily on new analytical work conducted in the DR, structured around four background notes on: (i) trends in monetary poverty and inequality, as well as the key drivers of those changes; (ii) nonmonetary poverty and its spatial dimensions; (iii) social assistance programs and their role in mitigating poverty; and (iv) climate change and its interaction with poverty. By helping to reduce the evidence gap in each of these areas, our analysis hopes to inform government policies and the national dialogue on poverty reduction. In addition, the note integrates existing analytical work and evidence produced inside and outside the Bank, including from its operations in the country.