Publication: Decomposing Response Errors in Food Consumption Measurement: Implications for Survey Design from a Survey Experiment in Tanzania
Loading...
Published
2016-04
ISSN
Date
2016-05-04
Author(s)
Editor(s)
Abstract
There is wide variation in how consumption is measured in household surveys both across countries and over time. This variation may confound welfare comparisons in part because these alternative survey designs produce consumption estimates that are differentially influenced by contrasting types of survey response error. Although previous studies have documented the extent of net error in alternative survey designs, little is known about the relative influence of the different response errors that underpin a survey estimate. This study leverages a recent randomized food consumption survey experiment in Tanzania to shed light on the relative influence of these various error types. The observed deviation of measured household consumption from a benchmark is decomposed into item-specific consumption incidence and consumption value so as to investigate effects related to (a) the omission of any consumption and then (b) the error in value reporting conditional on positive consumption. The results show that various survey designs exhibit widely differing error decompositions, and hence a simple summary comparison of the total recorded consumption across surveys will obscure specific error patterns and inhibit the lessons for improved consumption survey design. In light of these findings, the relative performance of common survey designs is discussed, and design lessons are drawn to enhance the accuracy of item-specific consumption reporting and, consequently, the measures of total household food consumption.
Link to Data Set
Citation
“De Weerdt, Joachim; Friedman, Jed; Gibson, John; Beegle, Kathleen. 2016. Decomposing Response Errors in Food Consumption Measurement: Implications for Survey Design from a Survey Experiment in Tanzania. Policy Research working paper,no. WPS 7646;; Policy Research Working Paper;No. 7646. © World Bank. http://hdl.handle.net/10986/24220 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication International Activity and Female Labor Participation: New Evidence for Services Firms in Developing Countries(Washington, DC: World Bank, 2025-09-03)Using a cross-section of more than 33,000 services firms in 104 low- and middle-income countries from the World Bank’s Enterprise Surveys, this paper examines whether the female labor share premium of international firms relative to non-international firms in manufacturing also holds for services firms. Unlike the manufacturing sector, the paper finds a negative relationship between exporting and global value chain participation and the female labor share for services firms, while no relationship is found for importing or foreign ownership status, controlling for firm output, productivity, technology intensity, and fixed effects. The female labor share gap for exporters was larger before COVID-19, and the gap for global value chain participants is no longer significant after COVID-19. Controlling for sectoral relative wages between men and women does not change the findings in a smaller subsample of economies. Controlling for female top management and ownership reveals a female labor share gap for exporters, global value chain participants, and importers. Using an alternative estimator and data set confirms the female labor share gap in services firms. This may be attributed to the sectoral segregation between women and men, with women tending to pursue work opportunities in less skill- and export-intensive services sectors compared to men.Publication Children in Monetary Poor Households: Global, Regional, and Select National Trends in the Progress against Child Poverty(Washington, DC: World Bank, 2025-09-05)This paper presents the first estimates of extreme child poverty and child poverty using the World Bank’s recently revised international poverty lines. Using the international poverty line of $3.00 per day and the higher $8.30 per day poverty line (both expressed in 2021 purchasing power parity), the paper provides new results of the global and regional trends over 2014–24. The estimates show that 19.2 percent of children, approximately 412 million children, were living on less than $3.00 (2021 PPP) per day as of 2024, a reduction from 507 million children in 2014. This long-term decrease was slower than that for the general population. At the higher line of $8.30, the child poverty rate in 2024 was 65.9 percent, representing around 1.4 billion children, a drop from the 73.1 percent registered in 2014. At the regional level, the East Asia and Pacific and South Asia regions witnessed significant reductions in child poverty and extreme child poverty between 2014 and 2024, and the Europe and Central Asia and Latin America and the Caribbean regions showed reductions mostly in child poverty. In the same period, there was an increase in extreme child poverty in the Middle East and North Africa region. Sub-Saharan Africa experienced a “lost decade” of child poverty reduction between 2014 and 2024, increasing its concentration of global poverty. In 2024, Sub-Saharan Africa hosted more than three-quarters of children in extreme poor households (more than 311 million children), although its share of the global child population was around 23 percent. Country-level results show evidence of regional heterogeneity in progress against extreme child poverty.Publication Engineering Ukraine’s Wirtschaftswunder(Washington, DC: World Bank, 2025-07-29)As Ukraine emerges from the devastation of war, it faces a historic opportunity to engineer its own Wirtschaftswunder—a productivity-driven economic transformation akin to post-war West Germany. While investment-led growth may offer quick wins, it is efficiency, innovation, and institutional reform that will determine Ukraine’s long-term economic trajectory. Drawing on rich micro-level firm data spanning 25 years, this paper uncovers deep structural distortions that have suppressed creative destruction and productivity in Ukraine. It finds that business dynamism is on the decline, alongside rising market concentration among incumbent businesses, including low productivity state owned enterprises. To inform priorities for reviving business dynamism, this study develops a model of creative destruction drawing on Acemoglu et al. (2018) and Akcigit et al. (2021). The quantitative assessment highlights that policies that discipline entrenched incumbents are the bedrock for reviving business dynamism and engineer Ukraine’s Wirtschaftswunder. Policies targeting specific types of firms have limited efficacy when incumbents run wild.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication What Does Variation in Survey Design Reveal about the Nature of Measurement Errors in Household Consumption?(World Bank, Washington, DC, 2013-02)This paper uses data from eight different consumption questionnaires randomly assigned to 4,000 households in Tanzania to obtain evidence on the nature of measurement errors in estimates of household consumption. While there are no validation data, the design of one questionnaire and the resources put into its implementation make it likely to be substantially more accurate than the others. Comparing regressions using data from this benchmark design with results from the other questionnaires shows that errors have a negative correlation with the true value of consumption, creating a non-classical measurement error problem for which conventional statistical corrections may be ineffective.Publication The Challenge of Measuring Hunger(World Bank, Washington, DC, 2014-01)There is widespread interest in the number of hungry people in the world and trends in hunger. Current global counts rely on combining each country's total food balance with information on distribution patterns from household consumption expenditure surveys. Recent research has advocated for calculating hunger numbers directly from these same surveys. For either approach, embedded in this effort are a number of important details about how household surveys are designed and how these data are then used. Using a survey experiment in Tanzania, this study finds great fragility in hunger counts stemming from alternative survey designs. As a consequence, comparable and valid hunger numbers will be lacking until more effort is made to either harmonize survey designs or better understand the consequences of survey design variation.Publication Methods of Household Consumption Measurement Through Surveys : Experimental Results from Tanzania(2010-12-01)Consumption expenditure has long been the preferred measure of household living standards. However, accurate measurement is a challenge and household expenditure surveys vary widely across many dimensions, including the level of reporting, the length of the reference period, and the degree of commodity detail. These variations occur both across countries and also over time within countries. There is little current understanding of the implications of such changes for spatially and temporally consistent measurement of household consumption and poverty. A field experiment in Tanzania tests eight alternative methods to measure household consumption on a sample of 4,000 households. There are significant differences between consumption reported by the benchmark personal diary and other diary and recall formats. Under-reporting is particularly relevant in illiterate households and for urban respondents completing household diaries; recall modules measure lower consumption than a personal diary, with larger gaps among poorer households and households with more adult members. Variations in reporting accuracy by household characteristics are also discussed and differences in measured poverty as a result of survey design are explored. The study concludes with recommendations for methods of survey based consumption measurement in low-income countries.Publication Adult Mortality and Consumption Growth in the Age of HIV/AIDS(World Bank, Washington, DC, 2006-12)The authors use a 13-year panel of individuals in Tanzania to assess how adult mortality shocks affect both short and long-run consumption growth of surviving household members. Using unique data which tracks individuals from 1991 to 2004, they examine consumption growth, controlling for a set of initial community, household and individual characteristics. The effect is identified using the sample of households in 2004 which grew out of baseline households. The authors find robust evidence that an affected household will see consumption drop 7 percent within the first five years after the adult death. With high growth in the sample over this time period, this creates a 19 percentage point growth gap with the average household. There is some evidence of persistent effects of these shocks for up to 13 years, but these effects are imprecisely estimated and not significantly different from zero. The impact of female adult death is found to be particularly severe.Publication Niger : Food Security and Safety Nets(World Bank, Washington, DC, 2009-02)This study aims to assist the Government of Niger in developing a multi-sectoral approach to reducing the population s vulnerability to food insecurity. The study reviews food security policies and programs in Niger, and provides an action plan for strengthening the existing system and developing an effective safety net strategy. The study finds that targeting of food aid has been either weak with significant leakages. Moreover, although the need to support poor and food insecure households is substantial, safety nets are small, receive limited funding, and are designed for emergency food crises. The study recommends to improve the efficiency and scope of safety net programs in Niger and to promote effective strategies to improve food availability and the emergency response systems.
Users also downloaded
Showing related downloaded files
Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Implementation Know-how Briefs to Support Countries to Prioritize, Connect and Scale for a Digital-in-Health Future(Washington, DC: World Bank, 2023-08-18)Technology and data are integral to daily life. As health systems face increasing demands to deliver new, more, better, and seamless services affordable to all people, data and technology are essential. With the potential and perils of innovations like artificial intelligence the future of health care is expected to be technology-embedded and data-linked. This shift involves expanding the focus from digitization of health data to integrating digital and health as one: Digital-in-Health. The World Bank’s report, Digital-in-Health: Unlocking the Value for Everyone, calls for a new digital-in-health approach where digital technology and data are infused into every aspect of health systems management and health service delivery for better health outcomes. The report proposes ten recommendations across three priority areas for governments to invest in: prioritize, connect and scale. The Implementation Know-How Briefs serve as practical guides for countries as they implement the ten recommendations. Every Implementation Know-How Brief provides practical information to start planning and implementing how to implement the recommendations. It also contains key terminologies for those not familiar with a particular topic, provides key questions to ask, and a general orientation as to typical issues in these sectors. Topics covered are: 1.) Digital health assessments; 2.) Telemedicine and virtual health care; 3.) Private sector involvement in digital health; 4.) Interoperability in health sector; 5.) Data governance for health data; 6.) Cybersecurity for health sector; 7.) Digital health records; 8.) Determining value of digital technology in health; 9.) Certification and regulatory sandboxes for digital technologies in health; 10.) Workflow mapping for digital technology (re)design in health systems.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication MIGA Annual Report 2021(Washington, DC: Multilateral Investment Guarantee Agency, 2021-10-01)In FY21, MIGA issued 5.2 billion US Dollars in new guarantees across 40 projects. These projects are expected to provide 784,000 people with new or improved electricity service, create over 14,000 jobs, generate over 362 million US Dollars in taxes for the host countries, and enable about 1.3 billion US Dollars in loans to businesses—critical as countries around the world work to keep their economies afloat. Of the 40 projects supported during FY21, 85 percent addressed at least one of the strategic priority areas, namely, IDA-eligible countries (lower-income), fragile and conflict affected situations (FCS), and climate finance. As of June 2021, MIGA has also issued 5.6 billion US Dollars of guarantees through our COVID-19 Response Program and anticipate an expansion to 10–12 billion US Dollars over the coming years, a testament to the countercyclical role that MIGA can play in mobilizing private investment in the face of the pandemic. A member of the World Bank Group, MIGA is committed to strong development impact and promoting projects that are economically, environmentally, and socially sustainable. MIGA helps investors mitigate the risks of restrictions on currency conversion and transfer, breach of contract by governments, expropriation, and war and civil disturbance, as well as offering credit enhancement on sovereign obligations.