Publication: Surveying Justice : A Practical Guide to Household Surveys
Loading...
Date
2010-01
ISSN
Published
2010-01
Author(s)
Editor(s)
Abstract
Though household surveys have long been an established part of development practice and regularly used to gather data on poverty incidence and the range of associated indicators, they have not yet become a common tool of justice reform practitioners. This guide aims to be a practical starting point for integrating justice work and household data collection, targeted both towards justice practitioners interested in survey design, as well as survey researchers interested in incorporating justice questions into their work. It provides guidance on designing a survey, suggested topics and questions, and ideas to facilitate a constructive engagement in discussions around justice in development practice. Household survey data can be beneficial to understanding justice questions as household surveys ordinarily cover a large, randomly selected cross-section of people - including the rich and poor, urban and rural dwellers - capturing a population's most common justice issues. Household survey questions commonly ask respondents about their most frequently experienced justice issues, issues when seeking redress, and knowledge and opinions of the law. Household surveys thus complement data collection techniques more familiar to justice practitioners (such as user surveys or sector assessments) that tend to focus on institutions of the justice sector and hence capture only the views of those who manage to access such institutions and privilege the perspectives of system incumbents. Household surveys have their limitations - not least significant cost, time and complexity implications. In addition, the standardized nature of surveys limits the type of information that can be gleaned and hence household surveys are generally most useful for gaining a picture of the "what" when it comes to justice issues, with complementary research methods often needed to properly understand the "why." Nevertheless, surveys can represent a useful starting point for engagement in a particular context, providing a snap shot of the justice landscape from which more detailed qualitative and quantitative studies can be undertaken.
Link to Data Set
Citation
“Himelein, Kristen; Menzies, Nicholas; Woolcock, Michael. 2010. Surveying Justice : A Practical Guide to Household Surveys. Justice and development working paper series;no. 11. © http://hdl.handle.net/10986/18104 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Governance and Anti-corrupton Diagnostics : Guidance and Tools for Implementation, Monitoring, and Assessment in the Field(World Bank, Washington, DC, 2010-09)This guide focuses on one of the more granular approaches to governance improvement, the governance and anti-corruption diagnostic. Governance and anti-corruption diagnostics are used as an initial strategy to identify the nature of governance problems, to target the key sources or institutions associated with these problems, and to establish a baseline and indicators which can be used to make reforms and to measure progress over time. Increasingly, these diagnostics are becoming sectoral in nature, meaning they are customized to assess governance and anti-corruption in a targeted sector. If conducted properly, the diagnostic process informs and catalyzes stakeholders to demand reform. If repeated periodically, these diagnostics can become useful tools to monitor governance and anti-corruption over time. More specifically, governance and anti-corruption diagnostics: 1) Unbundle corruption by type - administrative, capture of the state, bidding, theft of goods and public resources, purchase of licenses and regulations; 2) Identify both weak institutions (which are in need of reform) and strong institutions (which provide examples of good governance); 3) Assess the cost of each type of corruption on different groups of stakeholders; 4) Provide insight into the relationship between corruption, service quality and access, and trust in public institutions; 5) Identify key determinants of good governance; and 6) Serve as a strong foundation for policy recommendations and reform.Publication Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development(2010-03-01)This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Does Respondent Reticence Affect the Results of Corruption Surveys? Evidence from the World Bank Enterprise Survey for Nigeria(2010-09-01)A potential concern with survey-based data on corruption is that respondents may not be fully candid in their responses to sensitive questions. If reticent respondents are less likely to admit to involvement in corrupt acts, and if the proportion of reticent respondents varies across groups of interest, comparisons of reported corruption across those groups can be misleading. This paper implements a variant on random response techniques that allows for identification of reticent respondents in the World Bank s Enterprise Survey for Nigeria fielded in 2008 and 2009. The authors find that 13.1 percent of respondents are highly likely to be reticent, and that these reticent respondents admit to sensitive acts at a significantly lower rate than possibly candid respondents when survey questions are worded in a way that implies personal wrongdoing on the part of the respondent.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.
Users also downloaded
Showing related downloaded files
Publication Commodity Markets Outlook, October 2024(Washington, DC: World Bank, 2024-10-29)Commodity prices are expected to decrease by 5 percent in 2025 and 2 percent in 2026. The projected declines are led by oil prices but tempered by price increases for natural gas and a stable outlook for metals and agricultural raw materials. The possibility of escalating conflict in the Middle East represents a substantial near-term upside risk to energy prices, with potential knock-on consequences for other commodities. However, over the forecast horizon, longer-term dynamics—including decelerating global oil demand, diversifying oil production, and ample oil supply capacity—suggest sizable downside risks to oil prices, especially if OPEC+ unwinds its latest production cuts. There are also dual risks to industrial commodity demand stemming from economic activity. On the one hand, concerted stimulus in China and above-trend growth in the United States could push commodity prices higher. On the other, weaker-than-anticipated global industrial activity could dampen them. Following several overlapping global shocks in the early 2020s, which drove parallel swings in commodity prices, commodity markets appear to be departing from a period of tight synchronization. A Special Focus analyzes commodity price synchronization over time and considers the relative importance across commodity cycles of a wide range of demand and supply shocks, including global demand shocks and shocks specific to different commodity markets. It concludes that, while supply shocks were the dominant commodity price driver in the early 2000s and around the global financial crisis, post-pandemic price movements have been more substantially shaped by commodity-specific shocks, such as those related to conflicts.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.