Publication: Weighting Justice Reform Costs and Benefits Using Machine Learning and Modern Data Science
Loading...
Date
2023-05-22
ISSN
Published
2023-05-22
Author(s)
Editor(s)
Abstract
Can the impact of justice processes be enhanced with the inclusion of a heterogeneous component into an existing cost-benefit analysis app that demonstrates how benefactors and beneficiaries are affected Such a component requires (i) moving beyond the traditional cost-benefit conceptual framework of utilizing averages, (ii) identification of social group or population-specific variation, (iii) identification of how justice processes differ across groups/populations, (iv) distribution of costs and benefits according to the identified variations, and (v) utilization of empirically informed statistical techniques to gain new insights from data and maximize the impact for beneficiaries. This paper outlines a method for capturing heterogeneity. The paper tests the method and the cost-benefit analysis online app that was developed using primary data collected from a developmental crime prevention intervention in Australia. The paper identifies how subgroups in the intervention display different behavioral adjustments across the reference period, revealing the heterogeneous distribution of costs and benefits. Finally, the paper discusses the next version of the cost-benefit analysis app, which incorporates an artificial intelligence-driven component that reintegrates individual cost-benefit analysis projects using machine learning and other modern data science techniques. The paper argues that the app enhances cost-benefit analysis, development outcomes, and policy making efficiency for optimal prioritization of criminal justice resources. Further, the app advances the policy accessibility of enhanced, social group-specific data, illuminating optimal policy orientation for more inclusive, just, and resilient societal outcomes—an approach with potential across broader public policy.
Link to Data Set
Citation
“Mahony, Chris; Manning, Matthew; Wong, Gabriel. 2023. Weighting Justice Reform Costs and Benefits Using Machine Learning and Modern Data Science. Policy Research Working Papers; 10449. © World Bank. http://hdl.handle.net/10986/39832 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Applying Machine Learning and Geolocation Techniques to Social Media Data (Twitter) to Develop a Resource for Urban Planning(World Bank, Washington, DC, 2020-12)With all the recent attention focused on big data, it is easy to overlook that basic vital statistics remain difficult to obtain in most of the world. This project set out to test whether an openly available dataset (Twitter) could be transformed into a resource for urban planning and development. The hypothesis is tested by creating road traffic crash location data, which are scarce in most resource-poor environments but essential for addressing the number one cause of mortality for children over age five and young adults. The research project scraped 874,588 traffic-related tweets in Nairobi, Kenya, applied a machine learning model to capture the occurrence of a crash, and developed an improved geoparsing algorithm to identify its location. The project geolocated 32,991 crash reports in Twitter for 2012-20 and clustered them into 22,872 unique crashes to produce one of the first crash maps for Nairobi. A motorcycle delivery service was dispatched in real-time to verify a subset of crashes, showing 92 percent accuracy. Using a spatial clustering algorithm, portions of the road network (less than 1 percent) were identified where 50 percent of the geolocated crashes occurred. Even with limitations in the representativeness of the data, the results can provide urban planners useful information to target road safety improvements where resources are limited.Publication Tools for Assessing the Costs and Benefits of Green Growth : The U.S. and Mexico(World Bank, Washington, DC, 2012-10)This paper examines the processes used in the United States and Mexico to assess the economic costs and benefits of environmental improvement, the kinds of information obtained from these procedures, and the additional knowledge that is needed about both elements to improve understanding of the problems and prospects of advancing a green growth agenda. Because environmental and other development needs are large and resources are limited, it is important to choose the best projects, those with the highest returns on both public investments and private resources harnessed by regulation. The United States is well-established as a world leader in the use of quantitative methods to evaluate options for environmental regulation and policy. Mexico represents a case where a developing country has made clear advances in reforming its economy and in introducing transparency in its regulatory processes for environmental and other policy areas.Publication Program Targeting with Machine Learning and Mobile Phone Data(World Bank, Washington, DC, 2022-12)Can mobile phone data improve program targeting By combining rich survey data from the baseline of a “big push” anti-poverty program in Afghanistan implemented in 2016 with detailed mobile phone logs from program beneficiaries, this paper studies the extent to which machine learning methods can accurately differentiate ultra-poor households eligible for program benefits from ineligible households. The paper shows that machine learning methods leveraging mobile phone data can identify ultra-poor households nearly as accurately as survey-based measures of consumption and wealth; and that combining survey-based measures with mobile phone data produces classifications more accurate than those based on a single data source.Publication Strategic Environmental Assessment in Policy and Sector Reform : Conceptual Model and Operational Guidance(World Bank, 2011)Around the world, it is increasingly being recognized that for sustainability goals to be reached, efforts need to go beyond complying with standards and mitigating adverse impacts, to identifying environmental sustainability as an objective of the development process. This approach requires the integration of environmental, sustainability, and climate change considerations into policy and sector reform. Because sector reform brings about significant policy change involving adjustments in laws, policies, regulations, and institutions, it is a sensitive political process often driven by strong economic interests. Policy makers are subject to a number of political pressures that originate in vested interests. The recommendations of environmental assessment are often of little relevance unless there are constituencies that support them and have sufficient political power to make their voices heard in the policy process. While strong constituencies are important during the design of sector reform, they are even more important during implementation. It follows that effective environmental assessment in policy and sector reform requires strong constituencies backing up recommendations, a system to hold policy makers accountable for their decisions, and institutions that can balance competing and, sometimes, conflicting interests.Publication Cost-Benefit Analysis in World Bank Projects(Washington, DC: World Bank, 2010)This report has been prepared in the context of a major global effort in the past eight years to better measure results in development assistance. The agenda for this effort was articulated and refined in a series of international conferences, beginning with the international conference on financing for development in Monterrey in 2002 and continuing through the Accra agenda for action in 2008. Cost-benefit analysis entails measuring results, valuing results, and comparing results with costs, and hence is highly relevant to the results agenda. Cost-benefit analysis can provide a comprehensive picture of the net impact of projects and help direct funds to where their development effectiveness is highest. This study draws two broad conclusions. First, the bank needs to revisit its policy for cost-benefit analysis in a way that recognizes the legitimate difficulties in quantifying benefits while preserving a high degree of rigor in justifying projects. Second, the bank needs to ensure that cost-benefit analysis is done with quality, rigor, and objectivity: poor data and analysis misinform, and do not improve, results. Reforms are required to project-appraisal procedures to ensure objectivity, improve both the analysis and the use of evidence at appraisal, and ensure effective use of cost benefit analysis in decision making.
Users also downloaded
Showing related downloaded files
Publication Gender Assessment of São Tomé and Príncipe Tourism Sector(Washington, DC: World Bank, 2025-01-29)The assessment presents findings from comprehensive desk research, semi-structured interviews, and key informant interviews conducted in-person in São Tomé and Príncipe in September 2023. The report is structured as follows: Section 2 presents the methodology, including the assessment framework, data collection method and key stakeholders. Section 3 provides background on the country context and the status of gender equality in São Tomé and Príncipe. Section 4 presents a gender gap analysis in women’s employment, entrepreneurship, and leadership. Section 5 dives into the ecosystem and stakeholder assessment. Finally, Section 6 lists priority areas for women in tourism and provides recommendations to be considered in the context of the upcoming World Bank projects.Publication Improving Access to Medicines in Developing Countries : Application of New Institutional Economics to the Analysis of Manufacturing and Distribution Issues(World Bank, Washington, DC, 2005-03)This paper examines alternative frameworks for empirical analysis of supply side activities, namely, the manufacture and distribution of medicine, through the application of New Institutional Economics (NIE) concepts. Attention is focused particularly upon the potential utility of ideas from agency theory, transaction cost analysis and contemporary ideas from strategy theory. The major purpose of this paper is to use these theoretical frameworks to provide insight for policy makers, when faced with specific situations, whether in an international agency, or a private company, or in defining a national strategy. The analysis attempts to show the importance of distinctions between ideas of 'make' or 'buy', between 'national self sufficiency' and 'international purchasing' strategies, the limitations of contractual agreements under market governance and the crucial linkages between strategy formulation, strategy implementation and the necessary capabilities to achieve successful performance in practice. The current international situation on the investment, location and capacity of pharmaceutical manufacturing is reviewed and likely future scenarios suggested. Correspondingly current patterns of trade in medicines and their likely development within the context of the WTO and bilateral trade agreements are discussed. Against this background the promise and the pitfalls for new forms of public-private partnerships, which may offer attractive alternatives to conventional structures are evaluated. The implications of alternative future strategic options for national governments in setting the balance between health and industrial policies are examined and in particular the extent to which a national manufacturing capability should be developed or sustained. Similarly the scope for improving low cost distribution systems for medicines, based upon a mix of public and private sector channels, is assessed. We conclude with suggestions for further development of a transaction-based framework.Publication Case Study 2 - Andhra Pradesh, India : Participation in Macroeconomic Policy Making and Reform(Washington, DC, 2003-03)For the past six years, the State of Andhra Pradesh in India has been at the vanguard of efforts to modernize the economy and the state while pursuing policies to improve the lives of the poorest. The Chief Minister and head of the ruling Telugu Desam Party (TDP), Mr. Chandra Babu Naidu, is known by some as the "Laptop Minister" for his modernizing initiatives. He has reached out to international organizations and investors but has also maintained his base of support at home, in part through expanded programs in education, health, and rural development. "I have initiated so many things," Naidu said. "They are going on and will pay off after some time. But people need something today." The challenges facing the government are daunting. Andhra Pradesh (AP) is one of the largest and poorest states in India. Its population of almost 80 million approaches that of the Philippines, the 13th most populous country in the world. Even as its high-tech industries develop rapidly, AP's overall literacy rate remains a modest 44% and one-third of the population lives in poverty.Publication Strategic Planning for Poverty Reduction in Vietnam : Progress and Challenges for Meeting the Localized Millennium Development Goals(World Bank, Washington, DC, 2003-01)This paper discusses the progress that Vietnam has made toward meeting a core set of development goals that the government recently adopted as part of its Comprehensive Poverty Reduction and Growth Strategy (CPRGS). These goals are strongly related to the Millennium Development Goals (MDGs), but are adapted and expanded to reflect Vietnam's national challenges and the government's ambitious development plans. For each Vietnam Development Goal, the authors describe recent trends in relation to the trajectories implied by the MDGs, outline the intermediate targets identified by the government, and discuss the challenges involved in meeting these. Relative to other countries of similar per capita expenditures, Vietnam has made rapid progress in a number of key areas. Poverty has halved over the 1990s, enrollment rates in primary education have risen to 91 percent (although there is a quality problem), indicators of gender equity have been strengthened, child mortality has been reduced, maternal health has improved, and real progress has been made in combating malaria and other communicable diseases. In contrast, Vietnam scores worse than other comparable countries in the areas of child malnutrition, access to clean water, and combating HIV/AIDS. A number of important crosscutting issues emerge from this analysis that need to be addressed. One such challenge is improving equity, both in terms of ensuring that the benefits of growth are distributed evenly across the population and in terms of access to public services. This will involve addressing the affordability of education and curative health care for poor households. Improvements in public expenditure planning are needed to align resources better to stated desired outcomes and to link nationally-defined targets to subnational planning and budgeting processes. There is also a need to address capacity and data gaps which will be crucial for effective monitoring.Publication Kingdom of Morocco : Poverty Update, Volume 1. Main Report(Washington, DC, 2001-03-30)According to the 1998-99 Living Standards Measurement Survey conducted in Moroocco, poverty showed a disturbing increase during the 1990s, regardless of how poverty is measured. This report updates the poverty profile for Morocco following the comprehensive approach suggested by the latest World Development Report (see report no. 20888 for an overview of this report). It presents a detailed analysis of 1) Poverty trends in the 1990s (Chapter 2), 2) which factors are key in explaining the observed increase in poverty (Chapter 3), and 3) the support given to the poor by Government intervention (Chapter 4). An overview of the main initiatives taken by the authorities as well as by nongovernmental organizations and private businesses in the late 1990s is presented in the first chapter; their effects, though not captured by the 1998/99 data, are likely to have a significant impact on poverty reduction in the coming years.