Publication: Doing the Survey Two-Step: The Effects of Reticence on Estimates of Corruption in Two-Stage Survey Questions
Loading...
Published
2015-05
ISSN
Date
2015-06-02
Author(s)
Editor(s)
Abstract
This paper develops a structural approach for modeling how respondents answer survey questions and uses it to estimate the proportion of respondents who are reticent in answering corruption questions, as well as the extent to which reticent behavior biases down conventional estimates of corruption. The context is a common two-step survey question, first inquiring whether a government official visited a business, and then asking about bribery if a visit was acknowledged. Reticence is a concern for both steps, since denying a visit sidesteps the bribe question. This paper considers two alternative models of how reticence affects responses to two-step questions, with differing assumptions on how reticence affects the first question about visits. Maximum-likelihood estimates are obtained for seven countries using data on interactions with tax officials. Different models work best in different countries, but cross-country comparisons are still valid because both models use the same structural parameters. On average, 40 percent of corruption questions are answered reticently, with much variation across countries. A statistic reflecting how much standard measures underestimate the proportion of all respondents who had a bribe interaction is developed. The downward bias in standard measures is highly statistically significant in all countries, varying from 12 percent in Nigeria to 90 percent in Turkey. The source of bias varies widely across countries, between denying a visit and denying a bribe after admitting a visit.
Link to Data Set
Citation
“Karalashvili, Nona; Kraay, Aart; Murrell, Peter. 2015. Doing the Survey Two-Step: The Effects of Reticence on Estimates of Corruption in Two-Stage Survey Questions. Policy Research Working Paper;No. 7276. © World Bank. http://hdl.handle.net/10986/22008 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Gender Gaps in the Performance of Small Firms: Evidence from Urban Peru(Washington, DC: World Bank, 2025-09-23)This paper estimates the gender gap in the performance of firms in Peru using representative data on both formal and informal firms. On average, informal female-led firms have lower sales, labor productivity, and profits compared to their male-led counterparts, with differences more pronounced when controlling for observable determinants of firm performance. However, gender gaps are only significant at the bottom of the performance distribution of informal firms, and these gaps disappear at the top of the distribution of informal firms and for formal firms. Possible explanations for the performance gaps at the bottom of the distribution include the higher likelihood of small, female-led firms being home-based, which is linked to lower profits, and their concentration in less profitable sectors. The paper provides suggestive evidence that household responsibilities play a key role in explaining the gender gap in firm performance among informal firms. Therefore, policies that promote access to care services or foster a more equal distribution of household activities may reduce gender productivity gaps and allow for a more efficient allocation of resources.Publication The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-02-05)Research on the labor market implications of artificial intelligence has focused principally on high-income countries. This paper analyzes this issue using microdata from a large set of low- and middle-income countries, applying a measure of potential artificial intelligence occupational exposure to a harmonized set of labor force surveys for 25 countries, covering a population of 3.5 billion people. The approach advances work by using harmonized microdata at the level of individual workers, which allows for a multivariate analysis of factors associated with exposure. Additionally, unlike earlier papers, the paper uses highly detailed (4 digit) occupation codes, which provide a more reliable mapping of artificial intelligence exposure to occupation. Results within countries, show that artificial intelligence exposure is higher for women, urban workers, and those with higher education. Exposure decreases by country income level, with high exposure for just 12 percent of workers in low-income countries and 15 percent of workers in lower-middle-income countries. Furthermore, lack of access to electricity limits effective exposure in low-income countries. These results suggest that for developing countries, and in particular low-income countries, the labor market impacts of artificial intelligence will be more limited than in high-income countries. While greater exposure to artificial intelligence indicates larger potential for future changes in certain occupations, it does not equate to job loss, as it could result in augmentation of worker productivity, automation of some tasks, or both.Publication Geopolitical Risks and Trade(Washington, DC: World Bank, 2025-09-23)This paper studies the impact of geopolitical risks on international trade, using the Geopolitical Risk (GPR) index of Caldara and Iacoviello (2022) and an empirical gravity model. The impact of spikes in geopolitical risk on trade is negative, strong, and heterogeneous across sectors. The findings show that increases in geopolitical risk reduce trade by about 30 to 40 percent. These effects are equivalent to an increase of global tariffs of up to 14 percent. Services trade is most vulnerable to geopolitical risks, followed by agriculture, and the impact on manufacturing trade is moderate. These negative effects are partially mitigated by cultural and geographic proximity, as well as by the presence of trade agreements.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication A New Cross-National Measure of Corruption(World Bank, Washington, DC, 2015-07)A new measure of cross-national corruption is constructed based on the geographic distribution of public officials involved in cross-border corruption cases. A comparison is made between the Public Administration Corruption Index (PACI) and perception-based measures, considers the extent to which differences between them are driven by systematic factors, and concludes that they are not. As more data on cases of cross-border bribery incidents become available, the PACI will provide an increasingly valid cross-national measure of corruption.Publication Misunderestimating Corruption(World Bank, Washington, DC, 2013-05)Estimates of the extent of corruption rely largely on self-reports of individuals, business managers, and government officials. Yet it is well known that survey respondents are reticent to tell the truth about activities to which social and legal stigma are attached, implying a downward bias in survey-based estimates of corruption. This paper develops a method to estimate the prevalence of reticent behavior, in order to isolate rates of corruption that fully reflect respondent reticence in answering sensitive questions. The method is based on a statistical model of how respondents behave when answering a combination of conventional and random-response survey questions. The responses to these different types of questions reflect three probabilities -- that the respondent has done the sensitive act in question, that the respondent exhibits reticence in answering sensitive questions, and that a reticent respondent is not candid in answering any specific sensitive question. These probabilities can be estimated using a method-of-moments estimator. Evidence from the 2010 World Bank Enterprise survey in Peru suggests reticence-adjusted estimates of corruption that are roughly twice as large as indicated by responses to standard questions. Reticence-adjusted estimates of corruption are also substantially higher in a set of ten Asian countries covered in the Gallup World Poll.Publication Surveying Justice : A Practical Guide to Household Surveys(World Bank, Washington, DC, 2010-01)Though household surveys have long been an established part of development practice and regularly used to gather data on poverty incidence and the range of associated indicators, they have not yet become a common tool of justice reform practitioners. This guide aims to be a practical starting point for integrating justice work and household data collection, targeted both towards justice practitioners interested in survey design, as well as survey researchers interested in incorporating justice questions into their work. It provides guidance on designing a survey, suggested topics and questions, and ideas to facilitate a constructive engagement in discussions around justice in development practice. Household survey data can be beneficial to understanding justice questions as household surveys ordinarily cover a large, randomly selected cross-section of people - including the rich and poor, urban and rural dwellers - capturing a population's most common justice issues. Household survey questions commonly ask respondents about their most frequently experienced justice issues, issues when seeking redress, and knowledge and opinions of the law. Household surveys thus complement data collection techniques more familiar to justice practitioners (such as user surveys or sector assessments) that tend to focus on institutions of the justice sector and hence capture only the views of those who manage to access such institutions and privilege the perspectives of system incumbents. Household surveys have their limitations - not least significant cost, time and complexity implications. In addition, the standardized nature of surveys limits the type of information that can be gleaned and hence household surveys are generally most useful for gaining a picture of the "what" when it comes to justice issues, with complementary research methods often needed to properly understand the "why." Nevertheless, surveys can represent a useful starting point for engagement in a particular context, providing a snap shot of the justice landscape from which more detailed qualitative and quantitative studies can be undertaken.Publication Changing Norms is Key to Fighting Everyday Corruption(World Bank, Washington, DC, 2011-10)One of the biggest impediments to anticorruption efforts is the fact that corrupt practices have become so institutionalized in everyday society that citizens view them as fixed and incontestable. To break down such an entrenched mind-set, the public s ignorance of their rights, cynicism, fear of reprisal, and mentality of submission to the status quo must first be defeated. Perhaps most important, the efficacy challenge needs to be addressed. Citizens generally must believe that they can actually do something about corruption in order to summon the courage to act upon that belief. Based on CommGAP s interactions with the global anticorruption community as well as earlier research, we were able to collate 18 representative instances (case studies) from around the world, with real-life examples of citizens coming together to speak up against corruption and social norms vis-à-vis corruption or to change public services affected by corrupt practices. This report is a one-step-up analysis of the collated case studies, which is intended to shed light on practical approaches, tools, and techniques that have been successful in bringing citizens together to stand against the daunting phenomenon of corruption.Publication Estimating the Gravity Model When Zero Trade Flows are Frequent and Economically Determined(World Bank, Washington, DC, 2015-06)This paper evaluates the performance of alternative estimators of the gravity equation when zero trade flows result from economically-based data-generating processes with heteroscedastic residuals and potentially-omitted variables. In a standard Monte Carlo analysis, the paper finds that this combination can create seriously biased estimates in gravity models with frequencies of zero frequently observed in real-world data, and that Poisson Pseudo-Maximum-Likelihood models can be important in solving this problem. Standard threshold–Tobit estimators perform well in a Tobit-based data-generating process only if the analysis deals with the heteroscedasticity problem. When the data are generated by a Heckman sample selection model, the Zero-Inflated Poisson model appears to have the lowest bias. When the data are generated by a Helpman, Melitz, and Rubinstein-type model with heterogeneous firms, a Zero-Inflated Poisson estimator including firm numbers appears to provide the best results. Testing on real-world data for total trade throws up additional puzzles with truncated Poisson Pseudo-Maximum-Likelihood and Poisson Pseudo-Maximum-Likelihood estimators being very similar, and Zero-Inflated Poisson and truncated Poisson Pseudo-Maximum-Likelihood identical. Repeating the Monte Carlo analysis taking into account the high frequency of very small predicted trade flows in real-world data reconciles these findings and leads to specific recommendations for estimators.
Users also downloaded
Showing related downloaded files
Publication The Journey Ahead(Washington, DC: World Bank, 2024-10-31)The Journey Ahead: Supporting Successful Migration in Europe and Central Asia provides an in-depth analysis of international migration in Europe and Central Asia (ECA) and the implications for policy making. By identifying challenges and opportunities associated with migration in the region, it aims to inform a more nuanced, evidencebased debate on the costs and benefits of cross-border mobility. Using data-driven insights and new analysis, the report shows that migration has been an engine of prosperity and has helped address some of ECA’s demographic and socioeconomic disparities. Yet, migration’s full economic potential remains untapped. The report identifies multiple barriers keeping migration from achieving its full potential. Crucially, it argues that policies in both origin and destination countries can help maximize the development impacts of migration and effectively manage the economic, social, and political costs. Drawing from a wide range of literature, country experiences, and novel analysis, The Journey Ahead presents actionable policy options to enhance the benefits of migration for destination and origin countries and migrants themselves. Some measures can be taken unilaterally by countries, whereas others require close bilateral or regional coordination. The recommendations are tailored to different types of migration— forced displacement as well as high-skilled and low-skilled economic migration—and from the perspectives of both sending and receiving countries. This report serves as a comprehensive resource for governments, development partners, and other stakeholders throughout Europe and Central Asia, where the richness and diversity of migration experiences provide valuable insights for policy makers in other regions of the world.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication Europe and Central Asia Economic Update, Fall 2024: Better Education for Stronger Growth(Washington, DC: World Bank, 2024-10-17)Economic growth in Europe and Central Asia (ECA) is likely to moderate from 3.5 percent in 2023 to 3.3 percent this year. This is significantly weaker than the 4.1 percent average growth in 2000-19. Growth this year is driven by expansionary fiscal policies and strong private consumption. External demand is less favorable because of weak economic expansion in major trading partners, like the European Union. Growth is likely to slow further in 2025, mostly because of the easing of expansion in the Russian Federation and Turkiye. This Europe and Central Asia Economic Update calls for a major overhaul of education systems across the region, particularly higher education, to unleash the talent needed to reinvigorate growth and boost convergence with high-income countries. Universities in the region suffer from poor management, outdated curricula, and inadequate funding and infrastructure. A mismatch between graduates' skills and the skills employers are seeking leads to wasted potential and contributes to the region's brain drain. Reversing the decline in the quality of education will require prioritizing improvements in teacher training, updated curricula, and investment in educational infrastructure. In higher education, reforms are needed to consolidate university systems, integrate them with research centers, and provide reskilling opportunities for adult workers.