Publication: Survey Measurement Errors and the Assessment of the Relationship between Yields and Inputs in Smallholder Farming Systems: Evidence from Mali
Loading...
Published
2021-11
ISSN
Date
2021-11-12
Author(s)
Editor(s)
Abstract
An accurate understanding of how input use affects agricultural productivity in smallholder farming systems is key to designing policies that can improve productivity, food security, and living standards in rural areas. Studies examining the relationships between agricultural productivity and inputs typically rely on land productivity measures, such as crop yields, that are informed by self-reported survey data on crop production. This paper leverages unique survey data from Mali to demonstrate that self-reported crop yields, vis-à-vis (objective) crop cut yields, are subject to non-classical measurement error that in turn biases the estimates of returns to inputs, including land, labor, fertilizer, and seeds. The analysis validates an alternative approach to estimate the relationship between crop yields and agricultural inputs using large-scale surveys, namely a within-survey imputation exercise that derives predicted, otherwise unobserved, objective crop yields that stem from a machine learning model that is estimated with a random subsample of plots for which crop cutting and self-reported yields are both available. Using data from a methodological survey experiment and a nationally representative survey conducted in Mali, the analysis demonstrates that it is possible to obtain predicted objective sorghum yields with attenuated non-classical measurement error, resulting in a less biased assessment of the relationship between yields and agricultural inputs. The discussion expands on the implications of the findings for (i) future research on agricultural intensification, and (ii) the design of future surveys in which objective data collection could be limited to a subsample to save costs, with the intention to apply the suggested machine learning approach.
Link to Data Set
Citation
“Yacoubou Djima, Ismael; Kilic, Talip. 2021. Survey Measurement Errors and the Assessment of the Relationship between Yields and Inputs in Smallholder Farming Systems: Evidence from Mali. Policy Research Working Paper;No. 9841. © World Bank. http://hdl.handle.net/10986/36553 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Gender Gaps in the Performance of Small Firms: Evidence from Urban Peru(Washington, DC: World Bank, 2025-09-23)This paper estimates the gender gap in the performance of firms in Peru using representative data on both formal and informal firms. On average, informal female-led firms have lower sales, labor productivity, and profits compared to their male-led counterparts, with differences more pronounced when controlling for observable determinants of firm performance. However, gender gaps are only significant at the bottom of the performance distribution of informal firms, and these gaps disappear at the top of the distribution of informal firms and for formal firms. Possible explanations for the performance gaps at the bottom of the distribution include the higher likelihood of small, female-led firms being home-based, which is linked to lower profits, and their concentration in less profitable sectors. The paper provides suggestive evidence that household responsibilities play a key role in explaining the gender gap in firm performance among informal firms. Therefore, policies that promote access to care services or foster a more equal distribution of household activities may reduce gender productivity gaps and allow for a more efficient allocation of resources.Publication The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-02-05)Research on the labor market implications of artificial intelligence has focused principally on high-income countries. This paper analyzes this issue using microdata from a large set of low- and middle-income countries, applying a measure of potential artificial intelligence occupational exposure to a harmonized set of labor force surveys for 25 countries, covering a population of 3.5 billion people. The approach advances work by using harmonized microdata at the level of individual workers, which allows for a multivariate analysis of factors associated with exposure. Additionally, unlike earlier papers, the paper uses highly detailed (4 digit) occupation codes, which provide a more reliable mapping of artificial intelligence exposure to occupation. Results within countries, show that artificial intelligence exposure is higher for women, urban workers, and those with higher education. Exposure decreases by country income level, with high exposure for just 12 percent of workers in low-income countries and 15 percent of workers in lower-middle-income countries. Furthermore, lack of access to electricity limits effective exposure in low-income countries. These results suggest that for developing countries, and in particular low-income countries, the labor market impacts of artificial intelligence will be more limited than in high-income countries. While greater exposure to artificial intelligence indicates larger potential for future changes in certain occupations, it does not equate to job loss, as it could result in augmentation of worker productivity, automation of some tasks, or both.Publication Geopolitical Risks and Trade(Washington, DC: World Bank, 2025-09-23)This paper studies the impact of geopolitical risks on international trade, using the Geopolitical Risk (GPR) index of Caldara and Iacoviello (2022) and an empirical gravity model. The impact of spikes in geopolitical risk on trade is negative, strong, and heterogeneous across sectors. The findings show that increases in geopolitical risk reduce trade by about 30 to 40 percent. These effects are equivalent to an increase of global tariffs of up to 14 percent. Services trade is most vulnerable to geopolitical risks, followed by agriculture, and the impact on manufacturing trade is moderate. These negative effects are partially mitigated by cultural and geographic proximity, as well as by the presence of trade agreements.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Yielding Insights(Washington, DC: World Bank, 2024-11-06)This paper addresses the challenge of missing crop yield data in large-scale agricultural surveys, where crop-cutting, the most accurate method for yield measurement, is often limited due to cost constraints. Multiple imputation techniques, supported by machine learning models are used to predict missing yield data. This method is validated using survey data from Mali, which includes both crop-cut and self-reported yield information. The analysis covers several crops, providing insights into the importance of different predictors, including farmer-reported yields and geo-spatial variables, and the conditions under which the approach is valid. The findings show that machine learning-based imputations can provide accurate yield estimates, especially for crops with low intercropping rates and higher commercialization. However, survey-to-survey imputations are less accurate than within-survey imputations, suggesting limitations in extrapolating data across different survey rounds. The study contributes valuable insights into improving cost-efficiency in agricultural surveys and the potential of imputation methods.Publication Decentralized Beneficiary Targeting in Large-Scale Development Programs : Insights from the Malawi Farm Input Subsidy Program(World Bank, Washington, DC, 2013-11)This paper contributes to the long-standing debate on the merits of decentralized beneficiary targeting in the administration of development programs, focusing on the large-scale Malawi Farm Input Subsidy Program. Nationally-representative household survey data are used to systematically analyze the decentralized targeting performance of the program during the 2009-2010 agricultural season. The analysis begins with a standard targeting assessment based on the rates of program participation and the benefit amounts among the eligible and non-eligible populations, and provides decompositions of the national targeting performance into the inter-district, intra-district inter-community, and intra-district intra-community components. This approach identifies the relative contributions of targeting at each level. The results show that the Farm Input Subsidy Program is not poverty targeted and that the national government, districts, and communities are nearly uniform in their failure to target the poor, with any minimal targeting (or mis-targeting) overwhelmingly materializing at the community level. The findings are robust to the choice of the eligibility indicator and the decomposition method. The multivariate analysis of household program participation reinforces these results and reveals that the relatively well-off, rather than the poor or the wealthiest, and the locally well-connected have a higher likelihood of program participation and, on average, receive a greater number of input coupons. Since a key program objective is to increase food security and income among resource-poor farmers, the lack of targeting is a concern and should underlie considerations of alternative targeting approaches that, in part or completely, rely on proxy means tests at the local level.Publication Should African Rural Development Strategies Depend on Smallholder Farms? An Exploration of the Inverse Productivity Hypothesis(World Bank, Washington, DC, 2012-09)In Africa, most development strategies include efforts to improve the productivity of staple crops grown on smallholder farms. An underlying premise is that small farms are productive in the African context and that smallholders do not forgo economies of scale -- a premise supported by the often observed phenomenon that staple cereal yields decline as the scale of production increases. This paper explores a research design conundrum that encourages researchers who study the relationship between productivity and scale to use surveys with a narrow geographic reach, when policy would be better served with studies based on wide and heterogeneous settings. Using a model of endogenous technology choice, the authors explore the relationship between maize yields and scale using alternative data. Since rich descriptions of the decision environments that farmers face are needed to identify the applied technologies that generate the data, improvements in the location specificity of the data should reduce the likelihood of identification errors and biased estimates. However, the analysis finds that the inverse productivity hypothesis holds up well across a broad platform of data, despite obvious shortcomings with some components. It also finds surprising consistency in the estimated scale elasticities.Publication Non-traditional Crops, Traditional Constraints : Long-Term Welfare Impacts of Export Crop Adoption among Guatemalan Smallholders(2009-11-01)This study documents the long-term welfare effects of household non-traditional agricultural export (NTX) adoption. The analysis uses a unique panel dataset, which spans the period 1985-2005, and employs difference-in-differences estimation to investigate the long-term impact of non-traditional agricultural export adoption on changes in household consumption status and asset position in the Central Highlands of Guatemala. Given the heterogeneity in adoption patterns, the analysis differentiates the impact estimates based on a classification of households that takes into account the timing and duration of non-traditional agricultural export adoption. The results show that while, on average, welfare levels have improved for all households irrespective of adoption status and duration, the extent of improvement has varied across groups. Long-term adopters exhibit the smallest increase in the lapse of two decades, in spite of some early gains. Conversely, early adopters who withdrew from non-traditional agricultural export production after reaping the benefits of the boom period of the 1980s are found to have fared better and shown greater improvements in durable asset position and housing conditions than any other category.Publication Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies(World Bank, Washington, DC, 2022-01)This paper reports on a randomized experiment conducted among Malawian agricultural households to study nonclassical measurement error in self-reported plot area and farmers’ responses to new information (the objective plot area measure) that was provided to correct nonclassical measurement error. Farmers' pre-treatment self-reported plot areas exhibit considerable nonclassical measurement error, most of which follows a regression-to-mean pattern with respect to plot area, and another 18 percent of which arises from asymmetric rounding to half-acre increments. Randomized provision of GPS-based measures of true plot area generates four important findings. First, farmers incompletely update mistaken self-reports; most nonclassical measurement error persists even after the provision of true plot area measures. Second, farmers update asymmetrically in response to information, with upward corrections being far more common than downward ones even though most plot sizes were initially overestimated. Third, the magnitude of updating varies by true plot area and the magnitude and direction of initial nonclassical measurement error. Fourth, the information treatment affects self-reported information about non-land inputs, such as fertilizer and labor, indicating that the effects of measurement error and updating spill over across variables. Nonclassical measurement error reflects behavioral anomalies and carries implications for both survey data collection methods and the design of information-based interventions.
Users also downloaded
Showing related downloaded files
Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.