Publication: Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania
Loading...
Published
2010-01-01
ISSN
Date
2012-03-19
Author(s)
Editor(s)
Abstract
Labor market statistics are critical for assessing and understanding economic development. In practice, widespread variation exists in how labor statistics are measured in household surveys in low-income countries. Little is known whether these differences have an effect on the labor statistics they produce. This paper analyzes these effects by implementing a survey experiment in Tanzania that varied two key dimensions: the level of detail of the questions and the type of respondent. Significant differences are observed across survey designs with respect to different labor statistics. Labor force participation rates, for example, vary by as much as 10 percentage points across the four survey assignments. Using a short labor module without screening questions on employment generates lower female labor force participation and lower rates of wage employment for both men and women. Response by proxy rather than self-report yields lower male labor force participation, lower female working hours, and lower employment in agriculture for men. The differences between proxy and self reporting seem to come from information imperfections within the household, especially with the distance in age between respondent and subject playing an important role, while gender and educational differences seem less important.
Link to Data Set
Citation
“Bardasi, Elena; Beegle, Kathleen; Dillon, Andrew; Serneels, Pieter. 2010. Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania. Paper is funded by the Knowledge for Change
Program (KCP),Policy Research working paper ; no. WPS 5192. © World Bank. http://hdl.handle.net/10986/3700 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania(World Bank, 2011-10-18)Labor market statistics are critical for assessing and understanding economic development. However, widespread variation exists in how labor statistics are collected in household surveys. This paper analyzes the effects of alternative survey design on employment statistics by implementing a randomized survey experiment in Tanzania. Two features of the survey design are assessed – the level of detail of the employment questions and the type of respondent. It turns out that both features have relevant and statistically significant effects on employment statistics. Using a short labor module without screening questions induces many individuals to adopt a broad definition of employment, incorrectly including domestic duties. But after reclassifying those in domestic work as ‘not working’ in order to obtain the correct ILO classification, the short module turns out to generate lower female employment rates, higher working hours for both men and women who are employed, and lower rates of wage employment than the detailed module. Response by proxy rather than self-report has no effect on female labor statistics but yields substantially lower male employment rates, mostly due to underreporting of agricultural activity. The large impacts of proxy responses on male employment rates are attenuated when proxy informants are spouses and individuals with some schooling.Publication Explaining Variation in Child Labor Statistics(2010-09-01)Child labor statistics are critical for assessing the extent and nature of child labor activities in developing countries. In practice, widespread variation exists in how child labor is measured. Questionnaire modules vary across countries and within countries over time along several dimensions, including respondent type and the structure of the questionnaire. Little is known about the effect of these differences on child labor statistics. This paper presents the results from a randomized survey experiment in Tanzania focusing on two survey aspects: different questionnaire design to classify children work and proxy response versus self-reporting. Use of a short module compared with a more detailed questionnaire has a statistically significant effect, especially on child labor force participation rates, and, to a lesser extent, on working hours. Proxy reports do not differ significantly from a child s self-report. Further analysis demonstrates that survey design choices affect the coefficient estimates of some determinants of child labor in a child labor supply equation. The results suggest that low-cost changes to questionnaire design to clarify the concept of work for respondents can improve the data collected.Publication Employment and Shared Growth : Rethinking the Role of Labor Mobility for Development(Washington, DC: World Bank, 2007)This edited volume brings together the papers presented at the conference, "Rethinking the Role of Jobs for Shared Growth," held in Washington, DC, in June 2006. The common theme is that of mobility in the labor market. As growth is related to sectoral shifts in economic activity, the mobility of labor plays a crucial role in ensuring sustainable growth whose benefits are shared amongst all individuals. The papers in this volume focus on selected priority issues at the frontier of research in the microeconomics of labor markets in developing countries, multi-segmented labor markets, the role of informal employment and self-employment, the effect of worker mobility on income, and the impact of firm dynamics on growth and employment. These are important parts of the puzzle and contribute to a better understanding of the role of employment in the economic development of low-income countries.Publication Health Information, Treatment, and Worker Productivity : Experimental Evidence from Malaria Testing and Treatment among Nigerian Sugarcane Cutters(World Bank Group, Washington, DC, 2014-11)Agricultural and other physically demanding sectors are important sources of growth in developing countries but prevalent diseases such as malaria adversely impact the productivity, labor supply, and choice of job tasks among workers by reducing physical capacity. This study identifies the impact of malaria on worker earnings, labor supply, and daily productivity by randomizing the temporal order at which piece-rate workers at a large sugarcane plantation in Nigeria are offered malaria testing and treatment. The results indicate a significant and substantial intent to treat effect of the intervention -- the offer of a workplace-based malaria testing and treatment program increases worker earnings by approximately 10 percent over the weeks following the offer. The study further investigates the effect of health information by contrasting program effects by workers' revealed health status. For workers who test positive for malaria, the treatment of illness increases labor supply, leading to higher earnings. For workers who test negative, and especially for those workers most likely to be surprised by the healthy diagnosis, the health information also leads to increased earnings via increased productivity. Possible mechanisms for this response include selection into higher return tasks within the plantation as a result of changes in the perceived cost of effort. A model of the worker labor decision that allows health expectations partly to determine the supply of effort suggests that, in endemic settings with poor quality health services, inaccurate health perceptions may lead workers to suboptimal labor allocation decisions. The results underline the importance of medical treatment, but also of access to improved information about one's health status, as the absence of either may lead workers to deliver lower effort in lower return jobs.Publication Do Returns to Education Depend on How and Whom You Ask?(Elsevier, 2017-10)Returns to education remain an important parameter of interest in economic analysis. A large literature estimates these returns, often carefully addressing issues such as selection into wage employment and endogeneity in terms of completed schooling. There has been much less exploration of whether the estimates of Mincerian returns depend on how information about wage work is collected. Relying on a survey experiment in Tanzania, this paper finds that estimates of the returns to education vary by questionnaire design, but not by whether the information on employment and wages is self-reported or collected by a proxy respondent. The differences derived from questionnaire type are substantial, varying from higher returns of 5 percentage points among the most well educated men to 16 percentage points among the least well educated women. These differences are at magnitudes similar to the bias in ordinary least squares estimation, which receives considerable attention in the literature. The findings demonstrate that survey design matters in the estimation of returns to schooling and that care is needed in comparing across contexts and over time, particularly if the data are generated through different surveys.
Users also downloaded
Showing related downloaded files
Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication South Asia Development Update, October 2024: Women, Jobs, and Growth(Washington, DC: World Bank, 2024-10-10)South Asia’s growth is on track to exceed earlier expectations, in a broad-based upturn. The region is expected to remain the fastest-growing among emerging market and developing economies (EMDEs). Several risks could upend this generally promising outlook, including extreme weather events, social unrest, and policy missteps, such as reform delays. But South Asian countries also have considerable untapped potential that could help them further boost productivity growth and employment and adapt to climate change. In particular, with about two-thirds of the region’s working-age women out of the labor force, raising female employment rates to those of men could increase per capita income by as much as one-half. Measures to accelerate job creation, remove obstacles to women working, and equalize gender rights would be more effective if combined with a shift toward social norms that looked more favorably on working women. Also, most South Asian countries rank among the EMDEs least open to global trade and investment. Greater openness could boost women’s employment, spur the growth of firms, and allow the region to take better advantage of the reshaping of global supply chains and trade. Reducing the cost of conducting business could help the region better harness large-scale remittance inflows.Publication Remarks to the G20 Finance Ministers and Central Bank Governors Meeting(World Bank, Washington, DC, 2020-11-20)World Bank Group President David Malpass said that while some countries are recovering, the pandemic is still taking a terrible toll, with poverty levels rising sharply. He highlighted on the health emergency response programs in one hundred twelve countries using a fast-track mechanism that is now able to access a further window of twelve billion in funding for vaccine purchases and delivery. He also mentioned that the World Bank is already at work in cooperation with WHO, UNICEF, the Global Fund and GAVI on rapid vaccine deployment readiness assessments for one hundred countries. He spoke about IFC working in coordination with CEPI to invest a further four billion in manufacturing and distribution of vaccines and products that support vaccination programs. He recognized that fragile conflict and violence (FCV) states are most in need, and World Bank's engagement with them. Under his Presidency, the World Bank Group has invested more in climate finance than at any time in its history. He mentioned that IDA is frontloading its financing to make more resources available for the poorest countries. He highlighted on an important step that the G20 call on DSSI beneficiary countries to commit to disclose all public sector financial commitments. The Development Committee that asked the Bank and the IMF to propose more actions to address the unsustainable debt burdens of low- and middle-income countries. He concluded that the fuller transparency is the only way to balance the interests of the people with the interests of those signing the debt and investment contracts.Publication The Innovation Paradox(Washington, DC: World Bank, 2017-10-03)Since Schumpeter, economists have argued that vast productivity gains can be achieved by investing in innovation and technological catch-up. Yet, as this volume documents, developing country firms and governments invest little to realize this potential, which dwarfs international aid flows. Using new data and original analytics, the authors uncover the key to this innovation paradox in the lack of complementary physical and human capital factors, particularly firm managerial capabilities, that are needed to reap the returns to innovation investments. Hence, countries need to rebalance policy away from R&D-centered initiatives – which are likely to fail in the absence of sophisticated private sector partners – toward building firm capabilities, and embrace an expanded concept of the National Innovation System that incorporates a broader range of market and systemic failures. The authors offer guidance on how to navigate the resulting innovation policy dilemma: as the need to redress these additional failures increases with distance from the frontier, government capabilities to formulate and implement the policy mix become weaker. This book is the first volume of the World Bank Productivity Project, which seeks to bring frontier thinking on the measurement and determinants of productivity to global policy makers.