Publication: Fewer Questions, More Answers: Truncated Early Stopping for Proxy Means Testing
Loading...
Date
2022-12
ISSN
Published
2022-12
Editor(s)
Abstract
The assignment of social programmes to their target population, known as targeting, is key to effective policy implementation. Proxy means testing is a widely used targeting approach where means testing is infeasible due to economic informality. This paper proposes a novel, practically feasible assessment approach that aims to reduce average proxy means test data collection costs, or allow more extensive data collection within a given resource envelope. Combining variable selection and prediction intervals, it develops a household-level truncated early stopping algorithm, which can reduce average interview length while maintaining predictive accuracy close to a standard proxy means test baseline. Applying the approach to Indonesian data, simulation of a 40 percent population coverage programme shows that targeting questionnaires could be shortened by 61 percent while maintaining PMT-level accuracy. A case study of a large health insurance programme in an urban area suggests that the share of intended beneficiaries who are among the targeted population can potentially be increased from 65.6 percent to 78.3 percent if enumerators conducted more of the shorter surveys that the truncated early stopping algorithm generates.
Link to Data Set
Citation
“Julian, Tim; Pinxten, Juul; Fricke, Daniel; Caccioli, Fabio. 2022. Fewer Questions, More Answers: Truncated Early Stopping for Proxy Means Testing. Policy Research Working Papers;10255. © World Bank. http://hdl.handle.net/10986/38437 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Evaluating the Impact of Conditional Cash Transfer Programs(Oxford University Press on behalf of the World Bank, 2005-03-01)Several developing economies have recently introduced conditional cash transfer programs, which provide money to poor families contingent on certain behavior, usually investments in human capital, such as sending children to school or bringing them to health centers. The approach is both an alternative to more traditional social assistance programs and a demand-side complement to the supply of health and education services. Unlike most development initiatives, conditional cash transfer programs have been subject to rigorous evaluations of their effectiveness using experimental or quasi-experimental methods. Evaluation results for programs launched in Colombia, Honduras, Jamaica, Mexico, Nicaragua, and Turkey reveal successes in addressing many of the failures in delivering social assistance, such as weak poverty targeting, disincentive effects, and limited welfare impacts. There is clear evidence of success from the first generation of programs in Colombia, Mexico, and Nicaragua in increasing enrollment rates, improving preventive health care, and raising household consumption. Many questions remain unanswered, however, including the potential of conditional cash transfer programs to function well under different conditions, to address a broader range of challenges among poor and vulnerable populations, and to prevent the intergenerational transmission of poverty.Publication Social Assistance Transfers in Bosnia and Herzegovina : Moving Toward a More Sustainable and Better-Targeted Safety Net(Washington, DC, 2009-04-30)Public expenditures on non-insurance social protection cash transfers absorb a huge share of the entities' respective budgets. This level of spending requires buoyant public revenues. However, public revenues will be under continuing pressure in view of the impending economic crisis. Moreover, devoting a large proportion of public funds to social transfers has the effect of crowding out resources that could be devoted to public investments which will be increasingly needed to stimulate growth as the economy begins to sag under the impact of the world economic crisis. In addition, there is evidence that some rights based programs create disincentives for employment. This situation is fiscally unsustainable, economically inefficient, and socially inequitable. Bosnia and Herzegovina (BH) needs to completely overhaul it s non-insurance social protection cash transfer programs. There are many ways in which BH could reform these programs and put in place measures aimed at developing a social safety net that is: (a) less of a burden on public resources, (b) more efficient, and (c) better targeted to the poor. Specifically, it is recommended that the governments in BH consider a three pronged approach with measures to: 1) improve and introduce targeting mechanisms to better channel resources to the poor; 2) strengthen benefits administration and beneficiary registry systems; and, 3) rationalize disability-related benefit schemes. An increasingly widespread recognition of the need for rationalization of the non-insurance social protection cash benefits is discernible in both the decision-making circles and in the public discourse in BH.Publication Eligibility Thresholds for Minimum Living Guarantee Programs : International Practices and Implications for China(World Bank, Washington, DC, 2013-11)Using a simple framework, this paper discusses the underlying reason of the variation of threshold level in developed countries, from the least generous 20 percent to around 60 percent of median wage, with an average of 35 percent. The generosity of minimum guarantee social assistance programs is deeply rooted in social values and principles that further underpin the policy objectives. Many Organizations for Economic Cooperation and Development (OECD) countries set their policy targets for minimum living standard programs beyond basic needs and aim to guarantee a minimum socially acceptable level for a decent living. Thresholds are also refined to reflect the differences in family size and demographic structure, difference in regional cost of living and changes in prices and local wages. In some countries the thresholds show some regional variation due to local discretionary powers of sub-national authorities to set the threshold depending on the co-financing mechanisms. These lessons are valuable for China as the Chinese government has made efforts to standardize the implementation and management of its own minimum income guarantee (Di Bao) programs. The policy recommendations for China include accelerating the convergence of localized approaches, raising the administrative level for setting thresholds to higher level, defining the roles of central and local governments in financing and management, and establishing a transparent budgetary management system to transfer and allocate social assistance funds.Publication Regional Study on Targeting Systems and Practices : Draft Policy Note(World Bank, Washington, DC, 2010-06-28)This policy note aims to take stock of regional experiences in the area of targeting, both in the context of government systems and the World Bank's operational work, in South Asia. The main objectives are to review targeting systems and practices in the context of government programs; to critically review the role for and impact of targeting in the WB's operational work; and to extract lessons that can be used to deepen the relevance and impact of the WB's operational work in South Asia. The evidence presented in this note will serve as a resource for those interested in and/or planning some work on targeting related work in the region. In this sense, by presenting information on both country systems and performance of WB-led work, the note targets both practitioners and managers. The analysis focuses first on the architecture of targeting systems in South Asia, and on the determinants of targeting effectiveness, including the choice and design of the targeting tool, implementation and monitoring of the targeting tool, and the design, implementation and monitoring of the targeted program. The note concludes that international evidence a large fraction of the observed differences in targeting effectiveness across systems and programs, can be attributed to factors related to implementation and monitoring. This implies that investments aimed at correcting resource, capacity and logistic limitations in government systems could go a long way in improving targeting outcomes in the region.Publication Albania : Social Safety Net Review(Washington, DC, 2004-12-29)In 1989, Albania's rigid political and socioeconomic structure shattered beyond repair. Turbulence soon invaded every domain of life. As the state imploded, so did the state-run economy. This review explores ongoing consequences of this difficult transformation that took place since 1989 and of policy initiatives to mitigate or ameliorate its effects. Albania has been much studied; the review addresses important information gaps. It establishes, from the representative 2002 Living Standards Measurement Survey (LSMS), which kinds of families receive public income transfers and private income flows in what amounts and from what sources. It estimates the impact that these public and private income flows have in mitigating pre-transfer and post-transfer poverty among households. It does this by type of family and source of income flow, for all Albanian households and for various subsets of them. This review analyzes the relative importance of pensions and social assistance in alleviating poverty among rural households with aged members. This review also documents and links data on expenditures under social programs with data on program beneficiaries for recent years and it identifies current tradeoffs among the multiple objectives of social safety net policies, including those relating to coverage, adequacy, work incentives, equity, and effective government spending. Finally, it suggests options for future development of social safety net policies, including ways to strengthen overall policy linkages and programmatic coordination among social programs.
Users also downloaded
Showing related downloaded files
Publication Remarks at the United Nations Biodiversity Conference(World Bank, Washington, DC, 2021-10-12)World Bank Group President David Malpass discussed biodiversity and climate change being closely interlinked, with terrestrial and marine ecosystems serving as critically important carbon sinks. At the same time climate change acts as a direct driver of biodiversity and ecosystem services loss. The World Bank has financed biodiversity conservation around the world, including over 116 million hectares of Marine and Coastal Protected Areas, 10 million hectares of Terrestrial Protected Areas, and over 300 protected habitats, biological buffer zones and reserves. The COVID pandemic, biodiversity loss, climate change are all reminders of how connected we are. The recovery from this pandemic is an opportunity to put in place more effective policies, institutions, and resources to address biodiversity loss.Publication World Development Report 2023: Migrants, Refugees, and Societies(Washington, DC : World Bank, 2023-04-25)Migration is a development challenge. About 184 million people—2.3 percent of the world’s population—live outside of their country of nationality. Almost half of them are in low- and middle-income countries. But what lies ahead? As the world struggles to cope with global economic imbalances, diverging demographic trends, and climate change, migration will become a necessity in the decades to come for countries at all levels of income. If managed well, migration can be a force for prosperity and can help achieve the United Nations’ Sustainable Development Goals. World Development Report 2023 proposes an innovative approach to maximize the development impacts of cross-border movements on both destination and origin countries and on migrants and refugees themselves. The framework it offers, drawn from labor economics and international law, rests on a “Match and Motive Matrix” that focuses on two factors: how closely migrants’ skills and attributes match the needs of destination countries and what motives underlie their movements. This approach enables policy makers to distinguish between different types of movements and to design migration policies for each. International cooperation will be critical to the effective management of migration.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Media and Messages for Nutrition and Health(World Bank, Washington, DC, 2020-06)The Lao People’s Democratic Republic (Lao PDR) has experienced rapid and significant economic growth over the past decade. However, poor nutritional outcomes remain a concern. Rates of childhood undernutrition are particularly high in remote, rural, and upland areas. Media have the potential to play an important role in shaping health and nutrition–related behaviors and practices as well as in promoting sociocultural and economic development that might contribute to improved nutritional outcomes. This report presents the results of a media audit (MA) that was conducted to inform the development and production of mass media advocacy and communication strategies and materials with a focus on maternal and child health and nutrition that would reach the most people from the poorest communities in northern Lao PDR. Making more people aware of useful information, essential services and products and influencing them to use these effectively is the ultimate goal of mass media campaigns, and the MA measures the potential effectiveness of media efforts to reach this goal. The effectiveness of communication channels to deliver health and nutrition messages to target beneficiaries to ensure maximum reach and uptake can be viewed in terms of preferences, satisfaction, and trust. Overall, the four most accessed media channels for receiving information among communities in the study areas were village announcements, mobile phones, television, and out-of-home (OOH) media. Of the accessed media channels, the top three most preferred channels were village announcements (40 percent), television (26 percent), and mobile phones (19 percent). In terms of trust, village announcements were the most trusted source of information (64 percent), followed by mobile phones (14 percent) and television (11 percent). Hence of all the media channels, village announcements are the most preferred, have the most satisfied users, and are the most trusted source of information in study communities from four provinces in Lao PDR with some of the highest burden of childhood undernutrition.Publication Economic Recovery(World Bank, Washington, DC, 2021-04-06)World Bank Group President David Malpass spoke about the world facing major challenges, including COVID, climate change, rising poverty and inequality and growing fragility and violence in many countries. He highlighted vaccines, working closely with Gavi, WHO, and UNICEF, the World Bank has conducted over one hundred capacity assessments, many even more before vaccines were available. The World Bank Group worked to achieve a debt service suspension initiative and increased transparency in debt contracts at developing countries. The World Bank Group is finalizing a new climate change action plan, which includes a big step up in financing, building on their record climate financing over the past two years. He noted big challenges to bring all together to achieve GRID: green, resilient, and inclusive development. Janet Yellen, U.S. Secretary of the Treasury, mentioned focusing on vulnerable people during the pandemic. Kristalina Georgieva, Managing Director of the International Monetary Fund, focused on giving everyone a fair shot during a sustainable recovery. All three commented on the importance of tackling climate change.