Publication: A Comparison of CAPI and PAPI through a Randomized Field Experiment
Loading...
Published
2010-11
ISSN
Date
2020-05-05
Author(s)
Editor(s)
Abstract
This paper reports on a randomized survey experiment among one thousand eight hundred and forty households, designed to compare pen-and-paper interviewing (PAPI) to computer-assisted personal interviewing (CAPI). The authors find that PAPI data contain a large number of errors, which can be avoided in CAPI. The authors show that error counts are not randomly distributed across the sample, but are correlated with household characteristics, potentially introducing sample bias in analysis if dubious observations need to be dropped. The authors demonstrate a tendency for the mean and spread of total measured consumption to be higher on paper compared to CAPI, translating into significantly lower measured poverty, higher measured inequality and higher income elasticity estimates. Investigating further the nature of PAPI’s measurement error for consumption, the authors fail to reject the hypothesis that it is classical: it attenuates the coefficient on consumption when used as explanatory variable and the authors find no evidence of bias when consumption is used as dependent variable. Finally, CAPI and PAPI are compared in terms of interview length, costs and respondents’ perceptions.
Link to Data Set
Citation
“Caeyers, Bet; Chalmers, Neil; De Weerdt, Joachim. 2010. A Comparison of CAPI and PAPI through a Randomized Field Experiment. © World Bank. http://hdl.handle.net/10986/33699 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Methods of Household Consumption Measurement Through Surveys : Experimental Results from Tanzania(2010-12-01)Consumption expenditure has long been the preferred measure of household living standards. However, accurate measurement is a challenge and household expenditure surveys vary widely across many dimensions, including the level of reporting, the length of the reference period, and the degree of commodity detail. These variations occur both across countries and also over time within countries. There is little current understanding of the implications of such changes for spatially and temporally consistent measurement of household consumption and poverty. A field experiment in Tanzania tests eight alternative methods to measure household consumption on a sample of 4,000 households. There are significant differences between consumption reported by the benchmark personal diary and other diary and recall formats. Under-reporting is particularly relevant in illiterate households and for urban respondents completing household diaries; recall modules measure lower consumption than a personal diary, with larger gaps among poorer households and households with more adult members. Variations in reporting accuracy by household characteristics are also discussed and differences in measured poverty as a result of survey design are explored. The study concludes with recommendations for methods of survey based consumption measurement in low-income countries.Publication Decomposing Response Errors in Food Consumption Measurement(World Bank, Washington, DC, 2016-04)There is wide variation in how consumption is measured in household surveys both across countries and over time. This variation may confound welfare comparisons in part because these alternative survey designs produce consumption estimates that are differentially influenced by contrasting types of survey response error. Although previous studies have documented the extent of net error in alternative survey designs, little is known about the relative influence of the different response errors that underpin a survey estimate. This study leverages a recent randomized food consumption survey experiment in Tanzania to shed light on the relative influence of these various error types. The observed deviation of measured household consumption from a benchmark is decomposed into item-specific consumption incidence and consumption value so as to investigate effects related to (a) the omission of any consumption and then (b) the error in value reporting conditional on positive consumption. The results show that various survey designs exhibit widely differing error decompositions, and hence a simple summary comparison of the total recorded consumption across surveys will obscure specific error patterns and inhibit the lessons for improved consumption survey design. In light of these findings, the relative performance of common survey designs is discussed, and design lessons are drawn to enhance the accuracy of item-specific consumption reporting and, consequently, the measures of total household food consumption.Publication Employment and Own-Use Production in Household Surveys(World Bank, Washington, DC, 2021-08)Labor statistics provide essential information for macroeconomic planning and policy formulation on employment creation, vocational training, income generation, and poverty reduction. A clear understanding and accurate comparability of labor indicators are therefore crucial for promoting efficient policies across countries and require the consistent application of international standards in collecting employment data in multi-topic household surveys. This Living Standards Measurement Study (LSMS) guidebook provides informed advice to statisticians and survey practitioners on the accurate measurement of employment and work in accordance with standards of the 19th International conference of labor statisticians (ICLS) and in the context of multi-topic household surveys.Publication Using Paradata to Assess Respondent Burden and Interviewer Effects in Household Surveys(World Bank, Washington, DC, 2023-06-15)Over the past decade, national statistical offices in low- and middle-income countries have increasingly transitioned to computer-assisted personal interviewing and computer-assisted telephone interviewing for the implementation of household surveys. The byproducts of these types of data collection are survey paradata, which can unlock objective, module- and question-specific, actionable insights on respondent burden, survey costs, and interviewer effects. This study does precisely that, using paradata generated by the Survey Solutions computer-assisted personal interviewing platform in recent national household surveys implemented by the national statistical offices in Cambodia, Ethiopia, and Tanzania. Across countries, the average household interview, based on a socioeconomic household questionnaire, ranges from 82 to 120 minutes, while the average interview with an adult household member, based on a multi-topic individual questionnaire, takes between 13 to 25 minutes. Using a multilevel model that is estimated for each household and individual questionnaire module, the paper shows that interviewer effects on module duration are significantly larger than the estimates from high-income contexts. Food consumption, household roster, and non-farm enterprises consistently emerge among the top five household questionnaire modules in terms of total variance in duration, with 5 to 50 percent of the variability being attributable to interviewers. Similarly, labor, health, and land ownership appear among the top five individual questionnaire modules in terms of total variance in duration, with 6 to 50 percent of the variability being attributable to interviewers. These findings, particularly by module, point to where additional interviewer training, fieldwork supervision, and data quality monitoring may be needed in future surveys.Publication Capturing What Matters(World Bank, Washington, DC, 2021-12)The World Bank is an international leader in the methodology and implementation of household surveys, working in close partnership with national statistics offices (NSOs) around the world. This guidebook is a consolidation of field-tested best practices to implement, improve, and modernize nationally representative multi-topic household surveys for monitoring welfare and poverty. Offered as a reference guide for task team leaders (TTLs) within the World Bank, the guidebook is intended as a powerful tool for any survey practitioners (such as NSOs, development partners, educators, researchers, and students) implementing household surveys in low- and middle-income countries. This guidebook starts with survey design, the first step in any survey undertaking, with careful attention given to minimizing non-sampling errors. Subsequent sections are sampling; questionnaire modules, which form the core of this guidebook; followed by geographic information systems (GIS); computer-assisted personal interviewing (CAPI); and finally, documentation and dissemination of the resulting data.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.