Publication: A Toolkit for the Evaluation of Financial Capability Programs in Low-, and Middle-Income Countries
Loading...
Published
2013
ISSN
Date
2013-11-18
Editor(s)
Abstract
When resources are scarce and social safety nets are weak, households' ability to manage income and assets wisely may be an important determinant of economic security. However, many open questions remain about how households in low and middle-income countries gain and exercise financial capability, and the best ways for governments and the private and nonprofit sector to help increase this capability. With the exception of a small but important number of studies that have recently been completed or are currently under way, robust evidence regarding the efficacy of financial capability interventions is relatively sparse compared to the level of interest and programmatic activity. One reason for this is a lack of systematic evaluation. The toolkit draws from past experience and the experience of the Russia Financial Literacy and Education Trust Fund pilot projects to provide concrete and tangible examples for the reader that illustrate the specific circumstances and challenges in this field. This toolkit is designed for researchers who are interested in conducting an evaluation of a financial capability program and for policy makers and practitioners interested in commissioning an evaluation. It will also be useful to evaluation researchers who want to brush up on a research technique they are less familiar with or who are new to the area of financial capability and financial education, particularly in Low, and Middle-Income Countries (LMIC). This toolkit is intended to be a practical, hands-on guide to designing, conducting, and analyzing financial capability evaluations, with a focus on doing so in LMICs. The toolkit covers a wide range of material on how to design, conduct and analyze evaluations, material that is spread out over the 13 chapters that follow. The chapters are contained within four overarching parts: setting the stage for monitoring and evaluation (M&E): understanding the M&E process and concepts (chapters 2-3); conducting M&E for financial capability programs (chapters 4-7); collecting and analyzing M&E Data for Financial Capability Programs (chapters 8-10); and other Issues in conducting M&E for financial capability programs (chapters 11-14).
Link to Data Set
Citation
“Yoong, Joanne; Mihaly, Kata; Bauhoff, Sebastian; Rabinovich, Lila; Hung, Angela. 2013. A Toolkit for the Evaluation of Financial Capability Programs in Low-, and Middle-Income Countries. © World Bank. http://hdl.handle.net/10986/16294 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Financial Literacy around the World : An Overview of the Evidence with Practical Suggestions for the Way Forward(World Bank, Washington, DC, 2012-06)Financial literacy programs are fast becoming a key ingredient in financial policy reform worldwide. Yet, what is financial literacy exactly and what do we know of its effectiveness? This paper collects insights from the literature thus far and summarizes global evidence on financial literacy, its correlates, and existing and upcoming causal investigations. The authors conclude with a synthesis of policy advice and practical suggestions for the way forward in this fast growing area of research.Publication Why Is Voluntary Financial Education So Unpopular? Experimental Evidence from Mexico(World Bank, Washington, DC, 2013-05)Take-up of voluntary financial education programs is typically extremely low. This paper reports on randomized experiments around a large financial literacy course offered in Mexico City to understand the reasons for low take-up, and to measure the impact of financial education. It documents that the general public displays little interest in such courses and that participation is low even among individuals who express interest in financial education. The paper experimentally investigates barriers to take-up, and finds no impact of relaxing reputational or logistical constraints and no evidence that time inconsistency is the reason for limited participation. Even relatively sizeable monetary incentives get less than 40 percent of interested individuals invited to training to attend. Using a randomized encouragement design, the authors measure the impact of the course on financial knowledge and behavior. Attending training results in a 9 percentage point increase in financial knowledge and a 9 percentage point increase in saving outcomes, but no impact on borrowing behavior. Administrative data indicate that the savings impact is relatively short-lived. The results suggest people are making optimal choices not to attend financial education courses, and point to the limits of using general purpose courses to improve financial behavior for the general population.Publication Harnessing Emotional Connections to Improve Financial Decisions: Evaluating the Impact of Financial Education in Mainstream Media(World Bank, Washington, D.C., 2013-04)This paper exploits the emotional connections and viewer attentiveness of mainstream media to evaluate the economic impact of financial education messages on debt management delivered through a popular television soap opera in South Africa. The study uses a symmetric encouragement design to compare outcomes of individuals who were randomly assigned to watch a soap opera with financial messages, "Scandal!" to those of individuals who were invited to watch a similar soap opera without financial messages, "Muvhango." Both shows overlapped in evening primetime and had similar past viewership profiles. The financial storyline spanned two months and featured one of the leading characters of the show borrowing excessively and irresponsibly through hire-purchase, gambling, and ending up in financial distress; and eventually seeking help to find her way out. Two intermediate and one final follow-up surveys were conducted as part of the study. The analysis finds individuals assigned to watch Scandal had significantly higher financial knowledge of the issues highlighted in the soap opera storyline, in particular messages delivered by the leading character. On behavior, Scandal viewers were almost twice more likely to borrow from formal sources, less likely to engage in gambling, and less prone to enter hire purchase agreements. Messages promoting a national debt mediation helpline delivered by an external character did not sustain traction beyond immediate interest. Three qualitative focus groups highlight the importance of emotional connections with the leading character in motivating behavior change.Publication Improving Gender and Development Outcomes through Agency : Policy Lessons from Three Peruvian Experiences(Lima: World Bank, 2013-07)Peruvian public policy is currently focused on economic growth with social inclusion. The Ministry of Development and Social Inclusion (MIDIS)-created in October 2011-leads the sector and promotes evidence-based public policy using three strategic guidelines: 1) matching criteria and mechanisms for the selection of areas and target population, 2) generation of instruments for inter-sectorial and inter-governmental result-based coordination, and 3) activation of monitoring and evaluation procedures to measure interventions' progress and results. This study is about the incredible and frequently underestimated role of agency-the ability to make choices to achieve desired outcomes-in economic development. The authors share the view that agency has inherent value for development: it is an attribute and manifestation of development, or using Sen's words, it is constituent to development. This study however, focuses on the instrumental role of agency for more tangible manifestations of development, such as, poverty reduction and economic growth. It attempts to show that expanding individual agency is a powerful catalyst for improving welfare, as measured by these concrete and widely used metrics of policy success. Moreover, it argues that in many cases, improving development outcomes through agency is highly cost-effective. This study centers on several policy initiatives in Peru, which as will be subsequently shown, have improved the agency of their beneficiaries. The purpose of this study is twofold. First, it aims at bridging this information gap, providing a review of evidence that shows how the psychological components of agency, such as aspirations and self-esteem, can effectively contribute to more traditional development objectives-ranging from higher investments in human capital to increased income. Second, the study reviews and synthesizes research on several policy interventions in Peru, which have empowered their beneficiaries. In this way, the study aims to derive practical recommendations on how to incorporate psychological elements of agency into policy interventions in order to achieve better development outcomes. The study is structured as follows: the next section discusses the concept of agency, providing examples of its broad role in achieving development objectives. The following section reviews the quantitative and qualitative research that served as the basis for this study and elaborates on the methodologies used to derive the conclusions presented in the ensuing section. The last section synthesizes the conclusions of the review of different interventions in Peru into six practical 'policy lessons'.Publication Uruguay : Strengthening Participatory Monitoring and Evaluation of Social Policy(Washington, DC, 2007-06-22)The Uruguay Non-lending Technical Assistance (UY NLTA) for Uruguay was undertaken at the request of the Government of Uruguay's Ministry of Social Development (MIDES). Following a devastating financial and macroeconomic crisis in 2002, MIDES was established with a view to coordinating social programs and providing a safety net program for Uruguayans affected by the crisis: the National Assistance Plan of Social Emergency (PANES), which was established in 2005. The objectives of the UY NLTA are to: (i) evaluate the impact of PANES social emergency programs; (ii) inform a dialogue about the future role of social emergency programs and of MIDES as the lead authority responsible for the coordination and oversight of social policy in Uruguay, and (iii) strengthen MIDES capacity to assess, monitor and evaluate social policy in Uruguay, with considerable weight on participatory approaches to monitoring and evaluation.
Users also downloaded
Showing related downloaded files
Publication Mental Health Patterns and Consequences : Results from Survey Data in Five Developing Countries(World Bank, 2009-02-28)The social and economic consequences of poor mental health in the developing world are presumed to be significant, yet remain underresearched. This study uses data from nationally representative surveys in Bosnia and Herzegovina, Indonesia, and Mexico and from special surveys in India and Tonga to show similar patterns of association between mental health and socioeconomic characteristics. Individuals who are older, female, widowed, and report poor physical health are more likely to report worse mental health. Individuals living with others with poor mental health are also significantly more likely to report worse mental health themselves. In contrast, there is little observed relation between mental health and consumption poverty or education, two common measures of socioeconomic status. Indeed, the results here suggest instead that economic and multidimensional shocks, such as illness or crisis, can have a greater impact on mental health than poverty. This may have important implications for social protection policy. Also significant, the associations between poor mental health and lower labor force participation (especially for women) and more frequent visits to health centers suggest that poor mental health can have economic consequences for households and the health system. Mental health modules could usefully be added to multipurpose household surveys in developing countries. Finally, measures of mental health appear distinct from general subjective measures of welfare such as happiness.Publication Looking Beyond the Horizon(World Bank, Washington, DC, 2017-06)The story of how the PVH Corp. (referred to throughout this document as PVH) came to leada group of its top suppliers to build factories and a fabric mill in Ethiopia’s Hawassa IndustrialPark (HIP) is the study of a strong collaboration between a private company looking to optimizeits business model and a government aiming to transform its economy through global strategic repositioning. The success of this story hinges upon the intersection of their goals and a shared vision of development that includes a strong commitment to social and environmental goals.PVH was motivated to invest in Ethiopia to respond to shifts in the global apparel sector, its growing desire to retool its business model and to address its concerns about compliance with social and environmental standards in its traditional sourcing locations. PVH had decided to rethink its business model and to look beyond the horizon towards a new region in which tolocate its manufacturing base. To have better oversight and enforcement, PVH moved to adopta fully integrated vertical supply chain, including direct investment in one of the manufacturingfacilities.Key to Ethiopia’s success in attracting this important investor was the government’s ability and willingness to strategically evaluate its foreign direct investment (FDI) needs and strategy and to take steps to evolve into an attractive location for higher value-added export-oriented investment.This case study explains a private investor’s site selection process. It assesses the elements PVH prioritized when deciding to commit to Ethiopia, and specifically to HIP. The case study further assesses the government of Ethiopia’s strategy, level of readiness, interest, and commitment, and sets out some key challenges that lie ahead for this partnership. The case study is structured in ten sections. Section second offers a brief background on the textile and apparel industry, including an explanation of its value chain. It provides a brief corporate profile of PVH and its current global footprint and business model. Section third describes the site selection process: PVH´s initial explorations in Africa, its consideration of several African countries, and its initial conversations and negotiations with Ethiopian authorities. Section fourth discusses the Ethiopian government’s strategy to attract and expand export-oriented investments, including efforts to bolster the country’s competitiveness. This section attempts to offer some explanation why Ethiopia was the right fit at the right time and its level of readiness to land such an investment. It provides a brief profile of PVH’s Africa point of entry, the HIP. Section sixth covers the challenges that lie ahead for this-project---potential setbacks that will affect not only the consolidation and growth of the textiles and apparel industry in Ethiopia, but also the government’s vision of becoming the “manufacturing powerhouse of Africa.” Section eighth concludes with some key lessons from PVH’s decision to invest in Ethiopia. Such lessons may be relevant to countries or regions interested inattracting FDI and may be of particular interest to other African countries in their quest to attract major investments in the textile and apparel sector.Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication A Cost Effective Solution to Reduce Disaster Losses in Developing Countries : Hydro-Meteorological Services, Early Warning, and Evacuation(World Bank, Washington, DC, 2012-05)In Europe, it can be estimated that hydro-meteorological information and early warning systems save several hundreds of lives per year, avoid between 460 million and 2.7 billion Euros of disaster asset losses per year, and produce between 3.4 and 34 billion of additional benefits per year through the optimization of economic production in weather-sensitive sectors (agriculture, energy, etc.). The potential for similar benefits in the developing world is not only proportional to population, but also to increased hazard risk due to climate and geography, as well as increased exposure to weather due to the state of infrastructure. This analysis estimates that the potential benefits from upgrading to developed-country standards the hydro-meteorological information production and early warning capacity in all developing countries include: (i) between 300 million and 2 billion USD per year of avoided asset losses due to natural disasters; (ii) an average of 23,000 saved lives per year, which is valued between 700 million and 3.5 billion USD per year using the Copenhagen Consensus guidelines; and (iii) between 3 and 30 billion USD per year of additional economic benefits. The total benefits would reach between 4 and 36 billion USD per year. Because some of the most expensive components of early warning systems have already been built (e.g., earth observation satellites, global weather forecasts), these investments are relatively modest, estimated here around 1 billion US per year, reaching benefit-cost ratios between 4 and 36.Publication Causes of Deforestation of the Brazilian Amazon(Washington, DC: World Bank, 2004)The worldwide concern with deforestation of Brazilian Amazonia is motivated not only by the irreversible loss of this natural wealth, but also by the perception that it is a destructive process in which the social and economic gains are smaller than the environmental losses. This perception also underlies the diagnosis, formulation and evaluation of public policies proposed by government and non-governmental organizations working in the region, including the World Bank. The present work suggests that a fuller understanding is necessary with regard to the motivations and identity of the agents responsible for deforestation, the evaluation of the social and economic benefits from the process and the resulting implications of public policies for the region. The objective of the report is to show that, in contrast to the 1970s and 1980s when occupation of Brazilian Amazonia was largely induced by government policies and subsidies, recent deforestation in significant parts of the region is basically caused by medium- and large-scale cattle ranching. Following a private rationale, the dynamics of the occupation process gradually became autonomous, as is suggested by the significant increase in deforestation in the 1990s despite the substantial reduction of subsidies and incentives by government. Among the causes of the transformation are technological and managerial changes and the adaptation of cattle ranching to the geo-ecological conditions of eastern Amazonia which allowed for productivity gains and cost reductions. The fact that cattle ranching is viable from the private perspective does not mean that the activity is socially desirable or environmentally sustainable. Private gain needs to be contrasted with the environmental (social) costs associated with cattle ranching and deforestation. From the social perspective, it is legitimate to argue that the private benefits from large-scale cattle ranching are largely exclusive, having contributed little to alleviate social and economic inequalities. The study notes, however, that decreases in the price of beef in national markets and increases in exports caused by the expansion of cattle ranching in Eastern Amazonia may imply social benefits that go beyond sectoral and regional boundaries.