Publication: A Comparison of CAPI and PAPI through a Randomized Field Experiment
Loading...
Published
2010-11
ISSN
Date
2020-05-05
Author(s)
Editor(s)
Abstract
This paper reports on a randomized survey experiment among one thousand eight hundred and forty households, designed to compare pen-and-paper interviewing (PAPI) to computer-assisted personal interviewing (CAPI). The authors find that PAPI data contain a large number of errors, which can be avoided in CAPI. The authors show that error counts are not randomly distributed across the sample, but are correlated with household characteristics, potentially introducing sample bias in analysis if dubious observations need to be dropped. The authors demonstrate a tendency for the mean and spread of total measured consumption to be higher on paper compared to CAPI, translating into significantly lower measured poverty, higher measured inequality and higher income elasticity estimates. Investigating further the nature of PAPI’s measurement error for consumption, the authors fail to reject the hypothesis that it is classical: it attenuates the coefficient on consumption when used as explanatory variable and the authors find no evidence of bias when consumption is used as dependent variable. Finally, CAPI and PAPI are compared in terms of interview length, costs and respondents’ perceptions.
Link to Data Set
Citation
“Caeyers, Bet; Chalmers, Neil; De Weerdt, Joachim. 2010. A Comparison of CAPI and PAPI through a Randomized Field Experiment. © World Bank. http://hdl.handle.net/10986/33699 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Methods of Household Consumption Measurement Through Surveys : Experimental Results from Tanzania(2010-12-01)Consumption expenditure has long been the preferred measure of household living standards. However, accurate measurement is a challenge and household expenditure surveys vary widely across many dimensions, including the level of reporting, the length of the reference period, and the degree of commodity detail. These variations occur both across countries and also over time within countries. There is little current understanding of the implications of such changes for spatially and temporally consistent measurement of household consumption and poverty. A field experiment in Tanzania tests eight alternative methods to measure household consumption on a sample of 4,000 households. There are significant differences between consumption reported by the benchmark personal diary and other diary and recall formats. Under-reporting is particularly relevant in illiterate households and for urban respondents completing household diaries; recall modules measure lower consumption than a personal diary, with larger gaps among poorer households and households with more adult members. Variations in reporting accuracy by household characteristics are also discussed and differences in measured poverty as a result of survey design are explored. The study concludes with recommendations for methods of survey based consumption measurement in low-income countries.Publication Decomposing Response Errors in Food Consumption Measurement(World Bank, Washington, DC, 2016-04)There is wide variation in how consumption is measured in household surveys both across countries and over time. This variation may confound welfare comparisons in part because these alternative survey designs produce consumption estimates that are differentially influenced by contrasting types of survey response error. Although previous studies have documented the extent of net error in alternative survey designs, little is known about the relative influence of the different response errors that underpin a survey estimate. This study leverages a recent randomized food consumption survey experiment in Tanzania to shed light on the relative influence of these various error types. The observed deviation of measured household consumption from a benchmark is decomposed into item-specific consumption incidence and consumption value so as to investigate effects related to (a) the omission of any consumption and then (b) the error in value reporting conditional on positive consumption. The results show that various survey designs exhibit widely differing error decompositions, and hence a simple summary comparison of the total recorded consumption across surveys will obscure specific error patterns and inhibit the lessons for improved consumption survey design. In light of these findings, the relative performance of common survey designs is discussed, and design lessons are drawn to enhance the accuracy of item-specific consumption reporting and, consequently, the measures of total household food consumption.Publication Employment and Own-Use Production in Household Surveys(World Bank, Washington, DC, 2021-08)Labor statistics provide essential information for macroeconomic planning and policy formulation on employment creation, vocational training, income generation, and poverty reduction. A clear understanding and accurate comparability of labor indicators are therefore crucial for promoting efficient policies across countries and require the consistent application of international standards in collecting employment data in multi-topic household surveys. This Living Standards Measurement Study (LSMS) guidebook provides informed advice to statisticians and survey practitioners on the accurate measurement of employment and work in accordance with standards of the 19th International conference of labor statisticians (ICLS) and in the context of multi-topic household surveys.Publication Using Paradata to Assess Respondent Burden and Interviewer Effects in Household Surveys(World Bank, Washington, DC, 2023-06-15)Over the past decade, national statistical offices in low- and middle-income countries have increasingly transitioned to computer-assisted personal interviewing and computer-assisted telephone interviewing for the implementation of household surveys. The byproducts of these types of data collection are survey paradata, which can unlock objective, module- and question-specific, actionable insights on respondent burden, survey costs, and interviewer effects. This study does precisely that, using paradata generated by the Survey Solutions computer-assisted personal interviewing platform in recent national household surveys implemented by the national statistical offices in Cambodia, Ethiopia, and Tanzania. Across countries, the average household interview, based on a socioeconomic household questionnaire, ranges from 82 to 120 minutes, while the average interview with an adult household member, based on a multi-topic individual questionnaire, takes between 13 to 25 minutes. Using a multilevel model that is estimated for each household and individual questionnaire module, the paper shows that interviewer effects on module duration are significantly larger than the estimates from high-income contexts. Food consumption, household roster, and non-farm enterprises consistently emerge among the top five household questionnaire modules in terms of total variance in duration, with 5 to 50 percent of the variability being attributable to interviewers. Similarly, labor, health, and land ownership appear among the top five individual questionnaire modules in terms of total variance in duration, with 6 to 50 percent of the variability being attributable to interviewers. These findings, particularly by module, point to where additional interviewer training, fieldwork supervision, and data quality monitoring may be needed in future surveys.Publication Capturing What Matters(World Bank, Washington, DC, 2021-12)The World Bank is an international leader in the methodology and implementation of household surveys, working in close partnership with national statistics offices (NSOs) around the world. This guidebook is a consolidation of field-tested best practices to implement, improve, and modernize nationally representative multi-topic household surveys for monitoring welfare and poverty. Offered as a reference guide for task team leaders (TTLs) within the World Bank, the guidebook is intended as a powerful tool for any survey practitioners (such as NSOs, development partners, educators, researchers, and students) implementing household surveys in low- and middle-income countries. This guidebook starts with survey design, the first step in any survey undertaking, with careful attention given to minimizing non-sampling errors. Subsequent sections are sampling; questionnaire modules, which form the core of this guidebook; followed by geographic information systems (GIS); computer-assisted personal interviewing (CAPI); and finally, documentation and dissemination of the resulting data.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2008(Washington, DC, 2007)The world's demand for food is expected to double within the next 50 years, while the natural resources that sustain agriculture will become increasingly scarce, degraded, and vulnerable to the effects of climate change. In many poor countries, agriculture accounts for at least 40 percent of GDP and 80 percent of employment. At the same time, about 70 percent of the world's poor live in rural areas and most depend on agriculture for their livelihoods. World Development Report 2008 seeks to assess where, when, and how agriculture can be an effective instrument for economic development, especially development that favors the poor. It examines several broad questions: How has agriculture changed in developing countries in the past 20 years? What are the important new challenges and opportunities for agriculture? Which new sources of agricultural growth can be captured cost effectively in particular in poor countries with large agricultural sectors as in Africa? How can agricultural growth be made more effective for poverty reduction? How can governments facilitate the transition of large populations out of agriculture, without simply transferring the burden of rural poverty to urban areas? How can the natural resource endowment for agriculture be protected? How can agriculture's negative environmental effects be contained? This year's report marks the 30th year the World Bank has been publishing the World Development Report.Publication Poverty, Prosperity, and Planet Report 2024(Washington, DC: World Bank, 2024-10-15)The Poverty, Prosperity, and Planet Report 2024 is the latest edition of the series formerly known as Poverty and Shared Prosperity. The report emphasizes that reducing poverty and increasing shared prosperity must be achieved in ways that do not come at unacceptably high costs to the environment. The current “polycrisis”—where the multiple crises of slow economic growth, increased fragility, climate risks, and heightened uncertainty have come together at the same time—makes national development strategies and international cooperation difficult. Offering the first post-Coronavirus (COVID)-19 pandemic assessment of global progress on this interlinked agenda, the report finds that global poverty reduction has resumed but at a pace slower than before the COVID-19 crisis. Nearly 700 million people worldwide live in extreme poverty with less than US$2.15 per person per day. Progress has essentially plateaued amid lower economic growth and the impacts of COVID-19 and other crises. Today, extreme poverty is concentrated mostly in Sub-Saharan Africa and fragile settings. At a higher standard more typical of upper-middle-income countries—US$6.85 per person per day—almost one-half of the world is living in poverty. The report also provides evidence that the number of countries that have high levels of income inequality has declined considerably during the past two decades, but the pace of improvements in shared prosperity has slowed, and that inequality remains high in Latin America and the Caribbean and Sub-Saharan Africa. Worldwide, people’s incomes today would need to increase fivefold on average to reach a minimum prosperity threshold of US$25 per person per day. Where there has been progress in poverty reduction and shared prosperity, there is evidence of an increasing ability of countries to manage natural hazards, but climate risks are significantly higher in the poorest settings. Nearly one in five people globally is at risk of experiencing welfare losses due to an extreme weather event from which they will struggle to recover. The interconnected issues of climate change and poverty call for a united and inclusive effort from the global community. Development cooperation stakeholders—from governments, nongovernmental organizations, and the private sector to communities and citizens acting locally in every corner of the globe—hold pivotal roles in promoting fair and sustainable transitions. By emphasizing strategies that yield multiple benefits and diligently monitoring and addressing trade-offs, we can strive toward a future that is prosperous, equitable, and resilient.Publication Quantitative Analysis of Road Transport Agreements (QuARTA)(Washington, DC: World Bank, 2013-04-13)Road freight transport is indispensable to international economic cooperation and foreign trade. Across all continents, it is commonly used for short and medium distances and in long distance haulage when minimizing time is important. In all instances governments play a critical role in ensuring the competitive advantage of private sector operators. Countries often have many opportunities to minimize the physical or administrative barriers that increase costs, take measures to enhance the attractiveness and competitiveness of road transport, or generally nurture the integral role of international road freight transport in the global trade logistics industry. Road freight transport is critical to domestic and international trade. It is the dominant mode of transport for overland movement of trade traffic, carrying more than 80 percent of traffic in most regions. Generally, nearly all trade traffic is carried by road at some point. Therefore, the cost and quality of road transport services is of critical importance to trade competitiveness of countries and regions within countries. In fact, road transport is fundamental to modern international division of labor and supply-chain management.Publication Expanding Opportunities: Toward Inclusive Growth(World Bank, Washington, DC, 2023-04-04)South Asia’s outlook is shaped by both good and bad news in the global economy. Lower commodity prices, a strong recovery in the services sector, and reduced disruptions in value chains are aiding South Asia’s recovery but rising interest rates and uncertainty in financial markets are putting downward pressure on the region’s economies. Countries in South Asia, especially those with large external debt, face difficult tradeoffs as they respond to these pressures. Growth prospects have weakened, with large downside risks in most countries given limited fiscal space and depleting foreign reserves. Going forward, broad reform programs, including a sustainable fiscal outlook, are needed to put South Asia on a more robust and inclusive growth path. Inequality of opportunity, which is higher in South Asia than in other regions of the world, is both unfair and inefficient. Reducing inequality of opportunity and increasing economic mobility will help broaden countries’ tax base and boost support from the population for the critical reforms.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.