Publication: The Power of Survey Design : A User's Guide for Managing Surveys, Interpreting Results, and Influencing Respondents
Loading...
Other Files
15,386 downloads
Date
2006
ISSN
Published
2006
Author(s)
Editor(s)
Abstract
The vast majority of data used for economic research, analysis, and policy design comes from surveys-surveys of households, firms, schools, hospitals, and market participants, and, the accuracy of the estimate will depend on how well the survey is done. This innovative book is both a 'how-to' go about carrying out high-quality surveys, especially in the challenging environment of developing countries, and a 'user's guide' for anyone who uses statistical data. Reading this book will provide data users with a wealth of insight into what kinds of problems, or biases to look for in different data sources, based on the underlying survey approaches that were used to generate the data. In that sense the book is an invaluable 'skeptics guide to data'. Yet, the broad storyline of the book is something that should be absorbed by statistical data users. The book will teach and show how difficult it often is to obtain reliable estimates of important social and economic facts, and, therefore encourages you to approach all estimates with sensible caution.
Link to Data Set
Citation
“Iarossi, Giuseppe. 2006. The Power of Survey Design : A User's Guide for Managing Surveys, Interpreting Results, and Influencing Respondents. © World Bank. http://hdl.handle.net/10986/6975 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Does Respondent Reticence Affect the Results of Corruption Surveys? Evidence from the World Bank Enterprise Survey for Nigeria(2010-09-01)A potential concern with survey-based data on corruption is that respondents may not be fully candid in their responses to sensitive questions. If reticent respondents are less likely to admit to involvement in corrupt acts, and if the proportion of reticent respondents varies across groups of interest, comparisons of reported corruption across those groups can be misleading. This paper implements a variant on random response techniques that allows for identification of reticent respondents in the World Bank s Enterprise Survey for Nigeria fielded in 2008 and 2009. The authors find that 13.1 percent of respondents are highly likely to be reticent, and that these reticent respondents admit to sensitive acts at a significantly lower rate than possibly candid respondents when survey questions are worded in a way that implies personal wrongdoing on the part of the respondent.Publication Governance and Anti-corrupton Diagnostics : Guidance and Tools for Implementation, Monitoring, and Assessment in the Field(World Bank, Washington, DC, 2010-09)This guide focuses on one of the more granular approaches to governance improvement, the governance and anti-corruption diagnostic. Governance and anti-corruption diagnostics are used as an initial strategy to identify the nature of governance problems, to target the key sources or institutions associated with these problems, and to establish a baseline and indicators which can be used to make reforms and to measure progress over time. Increasingly, these diagnostics are becoming sectoral in nature, meaning they are customized to assess governance and anti-corruption in a targeted sector. If conducted properly, the diagnostic process informs and catalyzes stakeholders to demand reform. If repeated periodically, these diagnostics can become useful tools to monitor governance and anti-corruption over time. More specifically, governance and anti-corruption diagnostics: 1) Unbundle corruption by type - administrative, capture of the state, bidding, theft of goods and public resources, purchase of licenses and regulations; 2) Identify both weak institutions (which are in need of reform) and strong institutions (which provide examples of good governance); 3) Assess the cost of each type of corruption on different groups of stakeholders; 4) Provide insight into the relationship between corruption, service quality and access, and trust in public institutions; 5) Identify key determinants of good governance; and 6) Serve as a strong foundation for policy recommendations and reform.Publication Measuring Financial Capability : Questionnaires and Implementation Guidance for Low-, and Middle-Income Countries(World Bank, Washington, DC, 2013-06)This manual is designed to provide guidance to institutions, researchers, and survey firms on how to measure financial capability in middle, and low income countries using a new survey instrument that was developed and tested, from start to finish, in middle- and low-income countries. This new survey was developed as part of a larger project financed by the Russia Financial Literacy and Education Trust Fund (RTF) and implemented by the World Bank that encompassed both measurement of financial capability and evaluation of financial literacy programs. The development of the new RTF Financial Capability Survey (FCS) was done in collaboration with a team of external experts and teams from a total of 12 low- and middle-income countries. The full description of how the survey was developed can be found in Kempson, Perotti, and Scott (2013) along with findings from the first wave of surveys that have been done. In this manual we briefly summarize reasons why the FCS might be of interest to a country, provide a detailed outline of the issues related to implementing the survey successfully, and demonstrate how to analyze the resulting data. The first chapter of the manual lays out the reasons why this survey could be of use to policy makers. Chapter two describes the FCS questionnaires and their goals and objectives. Topics related to fieldwork, or the implementation of the survey, are covered in chapter three. Guidance on how to analyze the survey is provided in chapter four. The survey instruments can be found in the appendixes of this manual, and related documents, interviewer and supervisor manuals, can be found on the Trust Fund website www.finlitedu.org.Publication Challenges and Opportunities of Mobile Phone-Based Data Collection : Evidence from South Sudan(World Bank, Washington, DC, 2013-01)The proliferation of mobile phones in developing countries has generated a wave of interest in collecting high-frequency socioeconomic surveys using this technology. This paper considers lessons from one such survey effort in a difficult environment -- the South Sudan Experimental Phone Survey, which gathered data on living conditions, access to services, and citizen attitudes via monthly interviews by phones provided to respondents. Non-response, particularly in later rounds of the survey, was a substantial problem, largely due to erratic functioning of the mobile network. However, selection due to non-response does not appear to have markedly affected survey results. Response rates were much higher for respondents who owned their own phones. Both compensation provided to respondents in the form of airtime and the type of phone (solar-charged or traditional) were varied experimentally. The type of phone was uncorrelated with response rates and, contrary to expectation, attrition was slightly higher for those receiving the higher level of compensation. The South Sudan Experimental Phone Survey experience suggests that mobile phones can be a viable means of data collection for some purposes, that calling people on their own phones is preferred to handing out phones, and that careful attention should be given to the potential for selective non-response.Publication Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania(2010-01-01)Labor market statistics are critical for assessing and understanding economic development. In practice, widespread variation exists in how labor statistics are measured in household surveys in low-income countries. Little is known whether these differences have an effect on the labor statistics they produce. This paper analyzes these effects by implementing a survey experiment in Tanzania that varied two key dimensions: the level of detail of the questions and the type of respondent. Significant differences are observed across survey designs with respect to different labor statistics. Labor force participation rates, for example, vary by as much as 10 percentage points across the four survey assignments. Using a short labor module without screening questions on employment generates lower female labor force participation and lower rates of wage employment for both men and women. Response by proxy rather than self-report yields lower male labor force participation, lower female working hours, and lower employment in agriculture for men. The differences between proxy and self reporting seem to come from information imperfections within the household, especially with the distance in age between respondent and subject playing an important role, while gender and educational differences seem less important.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Impact Evaluation in Practice, Second Edition(Washington, DC: Inter-American Development Bank and World Bank, 2016-09-13)The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.Publication Poverty and Shared Prosperity 2022(Washington, DC : World Bank, 2022)Poverty and Shared Prosperity 2022: Correcting Course provides the first comprehensive analysis of the pandemic’s toll on poverty in developing countries. It identifies how governments can optimize fiscal policy to help correct course. Fiscal policies offset the impact of COVID-19 on poverty in many high-income countries, but those policies offset barely one quarter of the pandemic’s impact in low-income countries and lower-middle-income countries. Improving support to households as crises continue will require reorienting protective spending away from generally regressive and inefficient subsidies and toward a direct transfer support system—a first key priority. Reorienting fiscal spending toward supporting growth is a second key priority identified by the report. Some of the highest-value public spending often pays out decades later. Amid crises, it is difficult to protect such investments, but it is essential to do so. Finally, it is not enough just to spend wisely - when additional revenue does need to be mobilized, it must be done in a way that minimizes reductions in poor people’s incomes. The report highlights how exploring underused forms of progressive taxation and increasing the efficiency of tax collection can help in this regard. Poverty and Shared Prosperity is a biennial series that reports on global trends in poverty and shared prosperity. Each report also explores a central challenge to poverty reduction and boosting shared prosperity, assessing what works well and what does not in different settings. By bringing together the latest evidence, this corporate flagship report provides a foundation for informed advocacy around ending extreme poverty and improving the lives of the poorest in every country in the world. For more information, please visit worldbank.org/poverty-and-shared-prosperity.