Publication: Decomposing Response Errors in Food Consumption Measurement: Implications for Survey Design from a Survey Experiment in Tanzania
Loading...
Published
2016-04
ISSN
Date
2016-05-04
Author(s)
Editor(s)
Abstract
There is wide variation in how consumption is measured in household surveys both across countries and over time. This variation may confound welfare comparisons in part because these alternative survey designs produce consumption estimates that are differentially influenced by contrasting types of survey response error. Although previous studies have documented the extent of net error in alternative survey designs, little is known about the relative influence of the different response errors that underpin a survey estimate. This study leverages a recent randomized food consumption survey experiment in Tanzania to shed light on the relative influence of these various error types. The observed deviation of measured household consumption from a benchmark is decomposed into item-specific consumption incidence and consumption value so as to investigate effects related to (a) the omission of any consumption and then (b) the error in value reporting conditional on positive consumption. The results show that various survey designs exhibit widely differing error decompositions, and hence a simple summary comparison of the total recorded consumption across surveys will obscure specific error patterns and inhibit the lessons for improved consumption survey design. In light of these findings, the relative performance of common survey designs is discussed, and design lessons are drawn to enhance the accuracy of item-specific consumption reporting and, consequently, the measures of total household food consumption.
Link to Data Set
Citation
“De Weerdt, Joachim; Friedman, Jed; Gibson, John; Beegle, Kathleen. 2016. Decomposing Response Errors in Food Consumption Measurement: Implications for Survey Design from a Survey Experiment in Tanzania. Policy Research working paper,no. WPS 7646;; Policy Research Working Paper;No. 7646. © World Bank. http://hdl.handle.net/10986/24220 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Gender Gaps in the Performance of Small Firms: Evidence from Urban Peru(Washington, DC: World Bank, 2025-09-23)This paper estimates the gender gap in the performance of firms in Peru using representative data on both formal and informal firms. On average, informal female-led firms have lower sales, labor productivity, and profits compared to their male-led counterparts, with differences more pronounced when controlling for observable determinants of firm performance. However, gender gaps are only significant at the bottom of the performance distribution of informal firms, and these gaps disappear at the top of the distribution of informal firms and for formal firms. Possible explanations for the performance gaps at the bottom of the distribution include the higher likelihood of small, female-led firms being home-based, which is linked to lower profits, and their concentration in less profitable sectors. The paper provides suggestive evidence that household responsibilities play a key role in explaining the gender gap in firm performance among informal firms. Therefore, policies that promote access to care services or foster a more equal distribution of household activities may reduce gender productivity gaps and allow for a more efficient allocation of resources.Publication The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-02-05)Research on the labor market implications of artificial intelligence has focused principally on high-income countries. This paper analyzes this issue using microdata from a large set of low- and middle-income countries, applying a measure of potential artificial intelligence occupational exposure to a harmonized set of labor force surveys for 25 countries, covering a population of 3.5 billion people. The approach advances work by using harmonized microdata at the level of individual workers, which allows for a multivariate analysis of factors associated with exposure. Additionally, unlike earlier papers, the paper uses highly detailed (4 digit) occupation codes, which provide a more reliable mapping of artificial intelligence exposure to occupation. Results within countries, show that artificial intelligence exposure is higher for women, urban workers, and those with higher education. Exposure decreases by country income level, with high exposure for just 12 percent of workers in low-income countries and 15 percent of workers in lower-middle-income countries. Furthermore, lack of access to electricity limits effective exposure in low-income countries. These results suggest that for developing countries, and in particular low-income countries, the labor market impacts of artificial intelligence will be more limited than in high-income countries. While greater exposure to artificial intelligence indicates larger potential for future changes in certain occupations, it does not equate to job loss, as it could result in augmentation of worker productivity, automation of some tasks, or both.Publication Geopolitical Risks and Trade(Washington, DC: World Bank, 2025-09-23)This paper studies the impact of geopolitical risks on international trade, using the Geopolitical Risk (GPR) index of Caldara and Iacoviello (2022) and an empirical gravity model. The impact of spikes in geopolitical risk on trade is negative, strong, and heterogeneous across sectors. The findings show that increases in geopolitical risk reduce trade by about 30 to 40 percent. These effects are equivalent to an increase of global tariffs of up to 14 percent. Services trade is most vulnerable to geopolitical risks, followed by agriculture, and the impact on manufacturing trade is moderate. These negative effects are partially mitigated by cultural and geographic proximity, as well as by the presence of trade agreements.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication What Does Variation in Survey Design Reveal about the Nature of Measurement Errors in Household Consumption?(World Bank, Washington, DC, 2013-02)This paper uses data from eight different consumption questionnaires randomly assigned to 4,000 households in Tanzania to obtain evidence on the nature of measurement errors in estimates of household consumption. While there are no validation data, the design of one questionnaire and the resources put into its implementation make it likely to be substantially more accurate than the others. Comparing regressions using data from this benchmark design with results from the other questionnaires shows that errors have a negative correlation with the true value of consumption, creating a non-classical measurement error problem for which conventional statistical corrections may be ineffective.Publication The Challenge of Measuring Hunger(World Bank, Washington, DC, 2014-01)There is widespread interest in the number of hungry people in the world and trends in hunger. Current global counts rely on combining each country's total food balance with information on distribution patterns from household consumption expenditure surveys. Recent research has advocated for calculating hunger numbers directly from these same surveys. For either approach, embedded in this effort are a number of important details about how household surveys are designed and how these data are then used. Using a survey experiment in Tanzania, this study finds great fragility in hunger counts stemming from alternative survey designs. As a consequence, comparable and valid hunger numbers will be lacking until more effort is made to either harmonize survey designs or better understand the consequences of survey design variation.Publication Methods of Household Consumption Measurement Through Surveys : Experimental Results from Tanzania(2010-12-01)Consumption expenditure has long been the preferred measure of household living standards. However, accurate measurement is a challenge and household expenditure surveys vary widely across many dimensions, including the level of reporting, the length of the reference period, and the degree of commodity detail. These variations occur both across countries and also over time within countries. There is little current understanding of the implications of such changes for spatially and temporally consistent measurement of household consumption and poverty. A field experiment in Tanzania tests eight alternative methods to measure household consumption on a sample of 4,000 households. There are significant differences between consumption reported by the benchmark personal diary and other diary and recall formats. Under-reporting is particularly relevant in illiterate households and for urban respondents completing household diaries; recall modules measure lower consumption than a personal diary, with larger gaps among poorer households and households with more adult members. Variations in reporting accuracy by household characteristics are also discussed and differences in measured poverty as a result of survey design are explored. The study concludes with recommendations for methods of survey based consumption measurement in low-income countries.Publication Adult Mortality and Consumption Growth in the Age of HIV/AIDS(World Bank, Washington, DC, 2006-12)The authors use a 13-year panel of individuals in Tanzania to assess how adult mortality shocks affect both short and long-run consumption growth of surviving household members. Using unique data which tracks individuals from 1991 to 2004, they examine consumption growth, controlling for a set of initial community, household and individual characteristics. The effect is identified using the sample of households in 2004 which grew out of baseline households. The authors find robust evidence that an affected household will see consumption drop 7 percent within the first five years after the adult death. With high growth in the sample over this time period, this creates a 19 percentage point growth gap with the average household. There is some evidence of persistent effects of these shocks for up to 13 years, but these effects are imprecisely estimated and not significantly different from zero. The impact of female adult death is found to be particularly severe.Publication Migration and Economic Mobility in Tanzania : Evidence from a Tracking Survey(Washington, DC: World Bank, 2008-12)This study explores the extent to which migration has contributed to improved living standards of individuals in Tanzania. Using longitudinal data on individuals, the authors estimate the impact of migration on consumption growth between 1991 and 2004. The analysis addresses concerns about heterogeneity and unobservable factors correlated with both income changes and the decision to migrate. The findings show that migration adds 36 percentage points to consumption growth, during a period of considerable growth in consumption. These results are robust to numerous tests and alternative specifications. Unpacking the findings, the analysis finds that moving out of agriculture is correlated with much higher growth than staying in agriculture, although growth is always higher in any sector if one physically moves. Economic mobility is strongly linked to geographic mobility. The puzzle is why more people do not move if returns to geographic mobility are high. The evidence is consistent with models in which exit barriers are set by home communities (through social and family norms) that prevent migration of certain categories of people.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Implementation Know-how Briefs to Support Countries to Prioritize, Connect and Scale for a Digital-in-Health Future(Washington, DC: World Bank, 2023-08-18)Technology and data are integral to daily life. As health systems face increasing demands to deliver new, more, better, and seamless services affordable to all people, data and technology are essential. With the potential and perils of innovations like artificial intelligence the future of health care is expected to be technology-embedded and data-linked. This shift involves expanding the focus from digitization of health data to integrating digital and health as one: Digital-in-Health. The World Bank’s report, Digital-in-Health: Unlocking the Value for Everyone, calls for a new digital-in-health approach where digital technology and data are infused into every aspect of health systems management and health service delivery for better health outcomes. The report proposes ten recommendations across three priority areas for governments to invest in: prioritize, connect and scale. The Implementation Know-How Briefs serve as practical guides for countries as they implement the ten recommendations. Every Implementation Know-How Brief provides practical information to start planning and implementing how to implement the recommendations. It also contains key terminologies for those not familiar with a particular topic, provides key questions to ask, and a general orientation as to typical issues in these sectors. Topics covered are: 1.) Digital health assessments; 2.) Telemedicine and virtual health care; 3.) Private sector involvement in digital health; 4.) Interoperability in health sector; 5.) Data governance for health data; 6.) Cybersecurity for health sector; 7.) Digital health records; 8.) Determining value of digital technology in health; 9.) Certification and regulatory sandboxes for digital technologies in health; 10.) Workflow mapping for digital technology (re)design in health systems.Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.