Publication: Survey Measurement Errors and the Assessment of the Relationship between Yields and Inputs in Smallholder Farming Systems: Evidence from Mali
Loading...
Published
2021-11
ISSN
Date
2021-11-12
Author(s)
Editor(s)
Abstract
An accurate understanding of how input use affects agricultural productivity in smallholder farming systems is key to designing policies that can improve productivity, food security, and living standards in rural areas. Studies examining the relationships between agricultural productivity and inputs typically rely on land productivity measures, such as crop yields, that are informed by self-reported survey data on crop production. This paper leverages unique survey data from Mali to demonstrate that self-reported crop yields, vis-à-vis (objective) crop cut yields, are subject to non-classical measurement error that in turn biases the estimates of returns to inputs, including land, labor, fertilizer, and seeds. The analysis validates an alternative approach to estimate the relationship between crop yields and agricultural inputs using large-scale surveys, namely a within-survey imputation exercise that derives predicted, otherwise unobserved, objective crop yields that stem from a machine learning model that is estimated with a random subsample of plots for which crop cutting and self-reported yields are both available. Using data from a methodological survey experiment and a nationally representative survey conducted in Mali, the analysis demonstrates that it is possible to obtain predicted objective sorghum yields with attenuated non-classical measurement error, resulting in a less biased assessment of the relationship between yields and agricultural inputs. The discussion expands on the implications of the findings for (i) future research on agricultural intensification, and (ii) the design of future surveys in which objective data collection could be limited to a subsample to save costs, with the intention to apply the suggested machine learning approach.
Link to Data Set
Citation
“Yacoubou Djima, Ismael; Kilic, Talip. 2021. Survey Measurement Errors and the Assessment of the Relationship between Yields and Inputs in Smallholder Farming Systems: Evidence from Mali. Policy Research Working Paper;No. 9841. © World Bank. http://hdl.handle.net/10986/36553 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Yielding Insights(Washington, DC: World Bank, 2024-11-06)This paper addresses the challenge of missing crop yield data in large-scale agricultural surveys, where crop-cutting, the most accurate method for yield measurement, is often limited due to cost constraints. Multiple imputation techniques, supported by machine learning models are used to predict missing yield data. This method is validated using survey data from Mali, which includes both crop-cut and self-reported yield information. The analysis covers several crops, providing insights into the importance of different predictors, including farmer-reported yields and geo-spatial variables, and the conditions under which the approach is valid. The findings show that machine learning-based imputations can provide accurate yield estimates, especially for crops with low intercropping rates and higher commercialization. However, survey-to-survey imputations are less accurate than within-survey imputations, suggesting limitations in extrapolating data across different survey rounds. The study contributes valuable insights into improving cost-efficiency in agricultural surveys and the potential of imputation methods.Publication Decentralized Beneficiary Targeting in Large-Scale Development Programs : Insights from the Malawi Farm Input Subsidy Program(World Bank, Washington, DC, 2013-11)This paper contributes to the long-standing debate on the merits of decentralized beneficiary targeting in the administration of development programs, focusing on the large-scale Malawi Farm Input Subsidy Program. Nationally-representative household survey data are used to systematically analyze the decentralized targeting performance of the program during the 2009-2010 agricultural season. The analysis begins with a standard targeting assessment based on the rates of program participation and the benefit amounts among the eligible and non-eligible populations, and provides decompositions of the national targeting performance into the inter-district, intra-district inter-community, and intra-district intra-community components. This approach identifies the relative contributions of targeting at each level. The results show that the Farm Input Subsidy Program is not poverty targeted and that the national government, districts, and communities are nearly uniform in their failure to target the poor, with any minimal targeting (or mis-targeting) overwhelmingly materializing at the community level. The findings are robust to the choice of the eligibility indicator and the decomposition method. The multivariate analysis of household program participation reinforces these results and reveals that the relatively well-off, rather than the poor or the wealthiest, and the locally well-connected have a higher likelihood of program participation and, on average, receive a greater number of input coupons. Since a key program objective is to increase food security and income among resource-poor farmers, the lack of targeting is a concern and should underlie considerations of alternative targeting approaches that, in part or completely, rely on proxy means tests at the local level.Publication Should African Rural Development Strategies Depend on Smallholder Farms? An Exploration of the Inverse Productivity Hypothesis(World Bank, Washington, DC, 2012-09)In Africa, most development strategies include efforts to improve the productivity of staple crops grown on smallholder farms. An underlying premise is that small farms are productive in the African context and that smallholders do not forgo economies of scale -- a premise supported by the often observed phenomenon that staple cereal yields decline as the scale of production increases. This paper explores a research design conundrum that encourages researchers who study the relationship between productivity and scale to use surveys with a narrow geographic reach, when policy would be better served with studies based on wide and heterogeneous settings. Using a model of endogenous technology choice, the authors explore the relationship between maize yields and scale using alternative data. Since rich descriptions of the decision environments that farmers face are needed to identify the applied technologies that generate the data, improvements in the location specificity of the data should reduce the likelihood of identification errors and biased estimates. However, the analysis finds that the inverse productivity hypothesis holds up well across a broad platform of data, despite obvious shortcomings with some components. It also finds surprising consistency in the estimated scale elasticities.Publication Non-traditional Crops, Traditional Constraints : Long-Term Welfare Impacts of Export Crop Adoption among Guatemalan Smallholders(2009-11-01)This study documents the long-term welfare effects of household non-traditional agricultural export (NTX) adoption. The analysis uses a unique panel dataset, which spans the period 1985-2005, and employs difference-in-differences estimation to investigate the long-term impact of non-traditional agricultural export adoption on changes in household consumption status and asset position in the Central Highlands of Guatemala. Given the heterogeneity in adoption patterns, the analysis differentiates the impact estimates based on a classification of households that takes into account the timing and duration of non-traditional agricultural export adoption. The results show that while, on average, welfare levels have improved for all households irrespective of adoption status and duration, the extent of improvement has varied across groups. Long-term adopters exhibit the smallest increase in the lapse of two decades, in spite of some early gains. Conversely, early adopters who withdrew from non-traditional agricultural export production after reaping the benefits of the boom period of the 1980s are found to have fared better and shown greater improvements in durable asset position and housing conditions than any other category.Publication Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies(World Bank, Washington, DC, 2022-01)This paper reports on a randomized experiment conducted among Malawian agricultural households to study nonclassical measurement error in self-reported plot area and farmers’ responses to new information (the objective plot area measure) that was provided to correct nonclassical measurement error. Farmers' pre-treatment self-reported plot areas exhibit considerable nonclassical measurement error, most of which follows a regression-to-mean pattern with respect to plot area, and another 18 percent of which arises from asymmetric rounding to half-acre increments. Randomized provision of GPS-based measures of true plot area generates four important findings. First, farmers incompletely update mistaken self-reports; most nonclassical measurement error persists even after the provision of true plot area measures. Second, farmers update asymmetrically in response to information, with upward corrections being far more common than downward ones even though most plot sizes were initially overestimated. Third, the magnitude of updating varies by true plot area and the magnitude and direction of initial nonclassical measurement error. Fourth, the information treatment affects self-reported information about non-land inputs, such as fertilizer and labor, indicating that the effects of measurement error and updating spill over across variables. Nonclassical measurement error reflects behavioral anomalies and carries implications for both survey data collection methods and the design of information-based interventions.
Users also downloaded
Showing related downloaded files
Publication The Changing Wealth of Nations 2021(Washington, DC: World Bank, 2021-10-27)It is now clear that a narrow focus on the growth of gross domestic product (GDP) is insufficient to achieve humanity’s aspirations for sustainable prosperity. Wellfunctioning ecosystems and educated populations are requisites for sustainable wellbeing. These and other too-often-neglected ingredients of national wealth must be addressed if the development path is to be sustainable. The Changing Wealth of Nations 2021: Managing Assets for the Future provides the most comprehensive accounting of the wealth of nations, an in-depth analysis of the evolution of wealth, and pathways to build wealth for the future. This report—and the accompanying global database—firmly establishes comprehensive wealth as a measure of sustainability and a key component of country analytics. It expands the coverage of wealth accounts and improves our understanding of the quality of all assets, notably, natural capital. Wealth—the stock of produced, natural, and human capital—is measured as the sum of assets that yield a stream of benefits over time. Changes in the wealth of nations matter because they reflect the change in countries’ assets that underpin future income. Countries regularly track GDP as an indicator of their economic progress, but not wealth, and national wealth has a more direct and long-term impact on people’s lives. This report provides a new set of tools and analysis to help policy makers navigate risks and to guide collective action. Wealth accounts can be applied in macroeconomic analysis to areas of major policy concern such as climate change and natural resource management. This report can be used to look beyond GDP, to gauge nations’ economic well-being, and to promote sustainable prosperity.Publication The Government Analytics Handbook(Washington, DC: World Bank, 2023-09-28)The Government Analytics Handbook presents frontier evidence and practitioner insights on how to leverage data to strengthen public administration. Covering a range of microdata sources—such as administrative data and public servant surveys—as well as tools and resources for undertaking the analytics, it transforms the ability of governments to take a data-informed approach to diagnose and improve how public organizations work. The "Handbook" is a must-have for practitioners, policy makers, academics, and government agencies. It is available as a single volume in print or digital formats, and as chapters for modular use. Additional tools, data and background information are available at worldbank.org/governmentanalytics. “Governments have long been assessed using aggregate governance indicators, giving us little insight into their diversity and how they can practically be improved. This pioneering handbook shows how microdata can be used to give scholars and practitioners granular and real insights into how states work, and practical guidance on the process of state-building.” —Francis Fukuyama, Stanford University, author of State-Building: Governance and World Order in the 21st Century - "The Government Analytics Handbook is the most comprehensive work on practically building government administration I have ever seen, helping practitioners to change public administration for the better.” —Francisco Gaetani, Special Secretary for State Transformation, Government of Brazil - “The machinery of the state is central to a country’s prosperity. This handbook provides insights and methodological tools for creating a better shared understanding of the realities of a state, to support the redesign of institutions, and improve the quality of public administration.” —James Robinson, University of Chicago, coauthor of Why Nations FailPublication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Sourcebook on the Foundations of Social Protection Delivery Systems(Washington, DC: World Bank, 2020-07-30)The Sourcebook synthesizes real-world experiences and lessons learned of social protection delivery systems from around the world, with a particular focus on social and labor benefits and services. It takes a practical approach, seeking to address concrete “how-to” questions, including: How do countries deliver social protection benefits and services? How do they do so effectively and efficiently? How do they ensure dynamic inclusion, especially for the most vulnerable and needy? How do they promote better coordination and integration—not only among social protection programs but also programs in other parts of government? How can they meet the needs of their intended populations and provide a better client experience? The Sourcebook structures itself around eight key principles that can frame the delivery systems mindset: (1) delivery systems evolve over time, do so in a non-linear fashion, and are affected by the starting point(s); (2) additional efforts should be made to “do simple well”, and to do so from the start rather than trying to remedy by after-the-fact adding-on of features or aspects; (3) quality implementation matters, and weaknesses in the design or structure of any core system element will negatively impact delivery; (4) defining the “first mile” for people interface greatly affects the system and overall delivery, and is most improved when that “first mile” is understood as the weakest link in delivery systems); (5) delivery systems do not operate in a vacuum and thus should not be developed in silos; (6) delivery systems can contribute more broadly to government’s ability to intervene in other sectors, such as health insurance subsidies, scholarships, social energy tariffs, housing benefits, and legal services; (7) there is no single blueprint for delivery systems, but there are commonalities and those common elements constitute the core of the delivery systems framework; (8) inclusion and coordination are pervasive and perennial dual challenges, and they contribute to the objectives of effectiveness and efficiency.Publication Tanzania Country Climate and Development Report(Washington, DC: World Bank Group, 2024-12-12)The Country Climate and Development Report (CCDR) for Tanzania identifies the impact of climate change on the country’s economy. The CCDR uses macroeconomic, climate, sectoral, institutional, and financial models to identify the economy’s exposure to climate risks and the opportunities to integrate climate action and development. High poverty levels and dependence on rainfed, low-productivity agriculture leaves Tanzania’s economy vulnerable to climate risks. By 2050, climate change could push an additional 2.6 million people in poverty and force up to 13 million Tanzanians to migrate internally. The CCDR presents how implementation of three multisectoral intervention areas could generate climate-positive, resilient, and inclusive growth in Tanzania by 2050. These are: integrating climate considerations when strengthening human capital and social protection; optimizing land and water use and management to boost agriculture and rural productivity, augment climate resilience, and lower greenhouses gas emissions; and prioritizing resilient and low-carbon transport, energy and digital infrastructure systems in urban areas and different sectors. The CCDR details governance arrangements for effective climate change action, presents investment needs, and describes options for mobilizing financing. Action is needed both to reduce vulnerabilities of Tanzania’s current economy and realize the country’s Vision 2050 goal of a more inclusive and sustainable growth trajectory. Targeted climate action could boost private investment and job creation, enabling Tanzania to meet its development objectives in the face of global risks. Technical background reports prepared for the CCDR are available upon request.