Publication: Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania
Loading...
Date
2010-01-01
ISSN
Published
2010-01-01
Author(s)
Editor(s)
Abstract
Labor market statistics are critical for assessing and understanding economic development. In practice, widespread variation exists in how labor statistics are measured in household surveys in low-income countries. Little is known whether these differences have an effect on the labor statistics they produce. This paper analyzes these effects by implementing a survey experiment in Tanzania that varied two key dimensions: the level of detail of the questions and the type of respondent. Significant differences are observed across survey designs with respect to different labor statistics. Labor force participation rates, for example, vary by as much as 10 percentage points across the four survey assignments. Using a short labor module without screening questions on employment generates lower female labor force participation and lower rates of wage employment for both men and women. Response by proxy rather than self-report yields lower male labor force participation, lower female working hours, and lower employment in agriculture for men. The differences between proxy and self reporting seem to come from information imperfections within the household, especially with the distance in age between respondent and subject playing an important role, while gender and educational differences seem less important.
Link to Data Set
Citation
“Bardasi, Elena; Beegle, Kathleen; Dillon, Andrew; Serneels, Pieter. 2010. Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania. Paper is funded by the Knowledge for Change
Program (KCP),Policy Research working paper ; no. WPS 5192. © World Bank. http://hdl.handle.net/10986/3700 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania(World Bank, 2011-10-18)Labor market statistics are critical for assessing and understanding economic development. However, widespread variation exists in how labor statistics are collected in household surveys. This paper analyzes the effects of alternative survey design on employment statistics by implementing a randomized survey experiment in Tanzania. Two features of the survey design are assessed – the level of detail of the employment questions and the type of respondent. It turns out that both features have relevant and statistically significant effects on employment statistics. Using a short labor module without screening questions induces many individuals to adopt a broad definition of employment, incorrectly including domestic duties. But after reclassifying those in domestic work as ‘not working’ in order to obtain the correct ILO classification, the short module turns out to generate lower female employment rates, higher working hours for both men and women who are employed, and lower rates of wage employment than the detailed module. Response by proxy rather than self-report has no effect on female labor statistics but yields substantially lower male employment rates, mostly due to underreporting of agricultural activity. The large impacts of proxy responses on male employment rates are attenuated when proxy informants are spouses and individuals with some schooling.Publication Explaining Variation in Child Labor Statistics(2010-09-01)Child labor statistics are critical for assessing the extent and nature of child labor activities in developing countries. In practice, widespread variation exists in how child labor is measured. Questionnaire modules vary across countries and within countries over time along several dimensions, including respondent type and the structure of the questionnaire. Little is known about the effect of these differences on child labor statistics. This paper presents the results from a randomized survey experiment in Tanzania focusing on two survey aspects: different questionnaire design to classify children work and proxy response versus self-reporting. Use of a short module compared with a more detailed questionnaire has a statistically significant effect, especially on child labor force participation rates, and, to a lesser extent, on working hours. Proxy reports do not differ significantly from a child s self-report. Further analysis demonstrates that survey design choices affect the coefficient estimates of some determinants of child labor in a child labor supply equation. The results suggest that low-cost changes to questionnaire design to clarify the concept of work for respondents can improve the data collected.Publication Employment and Shared Growth : Rethinking the Role of Labor Mobility for Development(Washington, DC: World Bank, 2007)This edited volume brings together the papers presented at the conference, "Rethinking the Role of Jobs for Shared Growth," held in Washington, DC, in June 2006. The common theme is that of mobility in the labor market. As growth is related to sectoral shifts in economic activity, the mobility of labor plays a crucial role in ensuring sustainable growth whose benefits are shared amongst all individuals. The papers in this volume focus on selected priority issues at the frontier of research in the microeconomics of labor markets in developing countries, multi-segmented labor markets, the role of informal employment and self-employment, the effect of worker mobility on income, and the impact of firm dynamics on growth and employment. These are important parts of the puzzle and contribute to a better understanding of the role of employment in the economic development of low-income countries.Publication Health Information, Treatment, and Worker Productivity : Experimental Evidence from Malaria Testing and Treatment among Nigerian Sugarcane Cutters(World Bank Group, Washington, DC, 2014-11)Agricultural and other physically demanding sectors are important sources of growth in developing countries but prevalent diseases such as malaria adversely impact the productivity, labor supply, and choice of job tasks among workers by reducing physical capacity. This study identifies the impact of malaria on worker earnings, labor supply, and daily productivity by randomizing the temporal order at which piece-rate workers at a large sugarcane plantation in Nigeria are offered malaria testing and treatment. The results indicate a significant and substantial intent to treat effect of the intervention -- the offer of a workplace-based malaria testing and treatment program increases worker earnings by approximately 10 percent over the weeks following the offer. The study further investigates the effect of health information by contrasting program effects by workers' revealed health status. For workers who test positive for malaria, the treatment of illness increases labor supply, leading to higher earnings. For workers who test negative, and especially for those workers most likely to be surprised by the healthy diagnosis, the health information also leads to increased earnings via increased productivity. Possible mechanisms for this response include selection into higher return tasks within the plantation as a result of changes in the perceived cost of effort. A model of the worker labor decision that allows health expectations partly to determine the supply of effort suggests that, in endemic settings with poor quality health services, inaccurate health perceptions may lead workers to suboptimal labor allocation decisions. The results underline the importance of medical treatment, but also of access to improved information about one's health status, as the absence of either may lead workers to deliver lower effort in lower return jobs.Publication Do Returns to Education Depend on How and Whom You Ask?(Elsevier, 2017-10)Returns to education remain an important parameter of interest in economic analysis. A large literature estimates these returns, often carefully addressing issues such as selection into wage employment and endogeneity in terms of completed schooling. There has been much less exploration of whether the estimates of Mincerian returns depend on how information about wage work is collected. Relying on a survey experiment in Tanzania, this paper finds that estimates of the returns to education vary by questionnaire design, but not by whether the information on employment and wages is self-reported or collected by a proxy respondent. The differences derived from questionnaire type are substantial, varying from higher returns of 5 percentage points among the most well educated men to 16 percentage points among the least well educated women. These differences are at magnitudes similar to the bias in ordinary least squares estimation, which receives considerable attention in the literature. The findings demonstrate that survey design matters in the estimation of returns to schooling and that care is needed in comparing across contexts and over time, particularly if the data are generated through different surveys.
Users also downloaded
Showing related downloaded files
Publication Supporting Youth at Risk(World Bank, Washington, DC, 2008)The World Bank has produced this policy Toolkit in response to a growing demand from our government clients and partners for advice on how to create and implement effective policies for at-risk youth. The author has highlighted 22 policies (six core policies, nine promising policies, and seven general policies) that have been effective in addressing the following five key risk areas for young people around the world: (i) youth unemployment, underemployment, and lack of formal sector employment; (ii) early school leaving; (iii) risky sexual behavior leading to early childbearing and HIV/AIDS; (iv) crime and violence; and (v) substance abuse. The objective of this Toolkit is to serve as a practical guide for policy makers in middle-income countries as well as professionals working within the area of youth development on how to develop and implement an effective policy portfolio to foster healthy and positive youth development.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication The Power of Survey Design : A User's Guide for Managing Surveys, Interpreting Results, and Influencing Respondents(Washington, DC: World Bank, 2006)The vast majority of data used for economic research, analysis, and policy design comes from surveys-surveys of households, firms, schools, hospitals, and market participants, and, the accuracy of the estimate will depend on how well the survey is done. This innovative book is both a 'how-to' go about carrying out high-quality surveys, especially in the challenging environment of developing countries, and a 'user's guide' for anyone who uses statistical data. Reading this book will provide data users with a wealth of insight into what kinds of problems, or biases to look for in different data sources, based on the underlying survey approaches that were used to generate the data. In that sense the book is an invaluable 'skeptics guide to data'. Yet, the broad storyline of the book is something that should be absorbed by statistical data users. The book will teach and show how difficult it often is to obtain reliable estimates of important social and economic facts, and, therefore encourages you to approach all estimates with sensible caution.Publication Zimbabwe(World Bank, Washington, DC, 2019-03-01)This report presents an assessment of Zimbabwe’s agriculture sector disaster risk and management capacity. The findings indicate that Zimbabwe is highly exposed to agricultural risks and has limited capacity to manage risk at various levels. The report shows that disaster-related shocks along Zimbabwe’s agricultural supply chains directly translate to volatility in agricultural GDP. Such shocks have a substantial impact on economic growth, food security, and fiscal balance. When catastrophic disasters occur, the economy absorbs the shocks, without benefiting from any instruments that transfer the risk to markets and coping ability. The increasing prevalence of ‘shock recovery-shock’ cycles impairs Zimbabwe’s ability to plan and pursue a sustainable development path. The findings presented here confirm that it is highly pertinent for Zimbabwe to strengthen the capacity to manage risk at various levels, from the smallholder farmer, to other participants along the supply chain, to consumers (who require a reliable, safe food supply), and ultimately to the government to manage natural disasters. The assessment provides the following evidence on sources of risks and plausible risk management solutions. It is our hope that the report contributes to action by the Government of Zimbabwe to adopt a proactive and integrated risk management strategy appropriate to the current structure of the agricultural sector.Publication World Development Report 2019(Washington, DC: World Bank, 2019)Work is constantly reshaped by technological progress. New ways of production are adopted, markets expand, and societies evolve. But some changes provoke more attention than others, in part due to the vast uncertainty involved in making predictions about the future. The 2019 World Development Report will study how the nature of work is changing as a result of advances in technology today. Technological progress disrupts existing systems. A new social contract is needed to smooth the transition and guard against rising inequality. Significant investments in human capital throughout a person’s lifecycle are vital to this effort. If workers are to stay competitive against machines they need to train or retool existing skills. A social protection system that includes a minimum basic level of protection for workers and citizens can complement new forms of employment. Improved private sector policies to encourage startup activity and competition can help countries compete in the digital age. Governments also need to ensure that firms pay their fair share of taxes, in part to fund this new social contract. The 2019 World Development Report presents an analysis of these issues based upon the available evidence.