Publication: Using Twitter to Evaluate the Perception of Service Delivery in Data-Poor Environments
Loading...
Date
2021-03
ISSN
Published
2021-03
Author(s)
Editor(s)
Abstract
Evaluating service delivery needs in data-poor environments presents a particularly difficult problem for policymakers. The places where the need for social services are most acute are often the very same places where assessing policy interventions is the most challenging. This paper uses Twitter data to gain insights into service delivery needs in a data-poor environment. Specifically, it examines the development priorities of citizens in the north- western region of Pakistan between 2007 and 2020, using natural language processing techniques (NLP) and sentiment analysis of 9.5 million tweets generated by 20,000 unique Twitter users. The analysis reveals that service delivery priorities in this context are centered on access to education, healthcare, food, and clean water. The findings provide baseline data for future on-the-ground research and development initiatives. In addition, the methodology used in this paper demonstrates both current resources and areas in need of future work in the use of NLP techniques in analyzing social media data in other contexts.
Link to Data Set
Citation
“Braley, Alia; Fraiberger, Samuel P.; Tas, Emcet O.. 2021. Using Twitter to Evaluate the Perception of Service Delivery in Data-Poor Environments. Policy Research Working Paper;No. 9575. © World Bank. http://hdl.handle.net/10986/35253 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Central America : Big Data in Action for Development(Washington, DC, 2014)This report stemmed from a World Bank pilot activity to explore the potential of big data to address development challenges in Central American countries. As part of this activity we collected and analyzed a number of examples of leveraging big data for development. Because of the growing interest in this topic this report makes available to a broader audience those examples as well as the underlying conceptual framework to think about big data for development. To make effective use of big data, many practitioners emphasize the importance of beginning with a question instead of the data itself. A question clarifies the purpose of utilizing big data, whether it is for awareness, understanding, and/or forecasting. In addition, a question suggests the kinds of real-world behaviors or conditions that are of interest. These behaviors are encoded into data through some generating process which includes the media through which behavior is captured. Then various data sources are accessed, prepared, consolidated and analyzed. This ultimately gives rise to insights into the question of interest, which are implemented to effect changes in the relevant behaviors. Utilizing big data for any given endeavor requires a host of capabilities. Hardware and software capabilities are needed for interaction of data from a variety of sources in a way which is efficient and scalable. Human capabilities are needed not only to make sense of data but to ensure a question-centered approach, so that insights are actionable and relevant. To this end, cooperation between development experts as well as social scientists and computer scientists is extremely important.Publication Evaluation of Harm Reduction Service Delivery in Cebu City, Philippines (2013–2015)(World Bank, Washington, DC, 2016-04-07)The Kamagayan Comprehensive Care Center (KC3) clients report being very satisfied with the comprehensive package of health services offered under the BCP and they feel welcome and accepted at the KC3. Community members in Kamagayan, including family members of the KC3 clients, also praise the service as an excellent intervention. Virtually all key stakeholders interviewed noted that the KC3 team had performed especially well in building trust between clients and their health service providers, families, and community. In that sense, community-based advocacy efforts were successful at generating an enabling environment for service delivery. The KC3 clients, family members, and community representatives also appreciated efforts from the KC3 team to promote demand reduction through counseling, Narcotics Anonymous (NA) sessions, and privileged access to the Argao Treatment and Rehabilitation Center (TRC). There is great demand and genuine interest among the KC3 clients and patients’ clients to become peer educators and provide support to PWID. The professionalization of PWID through peer educator roles has also reportedly reduced stigma and discrimination and increased acceptance of PWID in the community. Should services for PWID be scaled up in Cebu and beyond, recruiting a workforce of peer educators should not be a critical challenge, an important lesson learned for future harm reduction projects in the Philippines.Publication Using Locational Data from Mobile Phones to Enhance the Science of Delivery(World Bank, Washington, DC, 2014-06)The objective of this report is to examine the potential of locational data for the 'science of delivery' in the field of development. The 'science of delivery' is a term popularized by the World Bank President, Jim Yong Kim, and refers to using evidence-based experimentation to improve development outcomes (Walji, 2013). In this context, locational data is a new tool that is starting to be used in a variety of development fields including health, education, disaster risk management, traffic planning etc. this broad introduction to the topic in chapter one, the next chapter explores the technology behind locational data. Chapter three presents the methodology followed in this research and chapter four, which is the heart of this report, then presents a series of mini case studies of how it is actually being used in a representative sample of different development fields. This is the 'evidence-based experimentation' which can be harnessed to improve the 'science of delivery', and examples of both active and passive collection of locational data are presented. Finally, chapter five examines, in broader terms, the longer term potential of locational data as a development tool, once smartphone ownership becomes more widespread.Publication Community-Driven Approaches in Lao PDR : Moving Beyond Service Delivery, Volume 2. Main Report(Washington, DC, 2008-04)This report reviews Community Driven Development (CDD) projects in Lao People's Democratic Republic (PDR) to determine their effectiveness in channeling resources to communities for poverty reduction. The study examines three CDD projects in depth: the Poverty Reduction Fund, the Village Investment for the Poor (both supported by the World Bank), and the Government-financed Village Development Fund. Through close analysis of these projects and cursory analysis of other CDD projects, the report concludes that overall, the CDD approach in Lao PDR improves the well-being of communities in a cost-effective manner. The study, however, identifies three challenges that remain for CDD projects to be wholly successful. The first challenge is a call for harmonization of CDD mechanisms within the country. CDD approaches are not currently coordinated geographically, technically, or financially. This leaves communities who need help without resources, an excess of skills in some areas and a dearth of skills in others, and funding allocated towards operations, which could be redirected to communities. The report recommends coordinating and consolidating CDD approaches. The second challenge is the achievement of inclusive participation. While empowerment has proven to improve the well-being of communities, not all local officials recognize the benefits of a participatory approach. The report recommends operating in districts on a long-term basis to develop sustained empowerment and extensive training to local officials and communities on participatory approaches. The final challenge for CDD projects is the funding of livelihood activities, which is necessary for sustained poverty reduction. Evidence has demonstrated that CDD backing of livelihood activities through loans, however, is unsuccessful. The report recommends administering grants for livelihood activities and ensuring technical support along with a participatory approach.Publication Community-Driven Approaches in Lao PDR : Moving Beyond Service Delivery - Summary Overview(World Bank, Washington, DC, 2008-10)This report reviews Community Driven Development (CDD) projects in Lao People's Democratic Republic (PDR) to determine their effectiveness in channeling resources to communities for poverty reduction. The study examines three CDD projects in depth: the Poverty Reduction Fund, the Village Investment for the Poor (both supported by the World Bank), and the Government-financed Village Development Fund. Through close analysis of these projects and cursory analysis of other CDD projects, the report concludes that overall, the CDD approach in Lao PDR improves the well-being of communities in a cost-effective manner. The study, however, identifies three challenges that remain for CDD projects to be wholly successful. The first challenge is a call for harmonization of CDD mechanisms within the country. CDD approaches are not currently coordinated geographically, technically, or financially. This leaves communities who need help without resources, an excess of skills in some areas and a dearth of skills in others, and funding allocated towards operations, which could be redirected to communities. The report recommends coordinating and consolidating CDD approaches. The second challenge is the achievement of inclusive participation. While empowerment has proven to improve the well-being of communities, not all local officials recognize the benefits of a participatory approach. The report recommends operating in districts on a long-term basis to develop sustained empowerment and extensive training to local officials and communities on participatory approaches. The final challenge for CDD projects is the funding of livelihood activities, which is necessary for sustained poverty reduction. Evidence has demonstrated that CDD backing of livelihood activities through loans, however, is unsuccessful. The report recommends administering grants for livelihood activities and ensuring technical support along with a participatory approach.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication Tanzania(World Bank, Washington, DC, 2015-06)This study aims to achieve a better understanding of the agricultural risk and risk management situation in Tanzania with a view to identifying key solutions to reduce current gross domestic product (GDP) growth volatility. For the purpose of this assessment, risk is defined as the probability that an uncertain event will occur that can potentially produce losses to participants along the supply chain. Persistence of unmanaged risks in agriculture is a cause of great economic losses for farmers and other actors along the supply chains (for example, traders, processors, and exporters), affecting export earnings and food security. The agricultural sector risk assessment is a straightforward methodology based on a three-phase sequential process. Phase analyzes the chronological occurrence of inter-seasonal agricultural risks with a view to identify and prioritize the risks that are the drivers of agricultural GDP volatility. This report contains the findings and recommendations of the first phase and includes the identification, analysis, and prioritization of major risks facing the agricultural sector in Tanzania, as well as recommendations regarding key solutions. Chapter one gives introduction and context. Chapter two contains an overview of the agricultural sector and its performance, as well as a discussion of key agro-climatic, weather, and policy restrictions and opportunities. Chapter three includes an assessment of major risks (that is, production, market, and enabling environment risks) facing key export and food crops. Chapter four presents an estimate of historical losses due to realized production risks and a correlation of such losses with production volatility. Chapter five provides insights into the exposure to risks by different stakeholders and their actual capacities, vulnerabilities, and potential to manage agricultural risks. Chapter six presents a risk prioritization by different supply chains and discusses the possible solutions, as well as specific recommendations for the agricultural sector development program (ASDP).Publication World Development Report 1984(New York: Oxford University Press, 1984)Long-term needs and sustained effort are underlying themes in this year's report. As with most of its predecessors, it is divided into two parts. The first looks at economic performance, past and prospective. The second part is this year devoted to population - the causes and consequences of rapid population growth, its link to development, why it has slowed down in some developing countries. The two parts mirror each other: economic policy and performance in the next decade will matter for population growth in the developing countries for several decades beyond. Population policy and change in the rest of this century will set the terms for the whole of development strategy in the next. In both cases, policy changes will not yield immediate benefits, but delay will reduce the room for maneuver that policy makers will have in years to come.Publication Africa's Future, Africa's Challenge : Early Childhood Care and Development in Sub-Saharan Africa(Washington, DC : World Bank, 2008)This book seeks to achieve a balance, describing challenges that are being faced as well as developments that are underway. It seeks a balance in terms of the voices heard, including not just voices of the North commenting on the South, but voices from the South, and in concert with the North. It seeks to provide the voices of specialists and generalists, of those from international and local organizations, from academia and the field. It seeks a diversity of views and values. Such diversity and complexity are the reality of Sub-Saharan Africa (SSA) today. The major focus of this book is on SSA from the Sahel south. Approximately 130 million children between birth and age 6 live in SSA. Every year 27 million children are born, and every year 4.7 million children under age 5 die. Rates of birth and of child deaths are consistently higher in SSA than in any other part of the world; the under-5 mortality rate of 163 per 1,000 is twice that of the rest of the developing world and 30 times that of industrialized countries (UNICEF 2006). Of the children who are born, 65 percent will experience poverty, 14 million will be orphans affected by HIV/AIDS directly and within their families and one-third will experience exclusion because of their gender or ethnicity.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.