Publication: Adding Value to Evaluations : Applying the Governmental Learning Spiral for Evaluation-Based Learning
Loading...
Published
2013-10
ISSN
Date
2014-01-29
Author(s)
Editor(s)
Abstract
Governmental learning has a multidisciplinary research tradition and a plethora of literature exists on organizational as well as policy learning. Different concepts for structured learning from evaluation results on the governmental level exist. It is common to all that they depend on a careful selection of participants and that the political, cultural, and institutional environment is key to the ultimate success of many governmental learning activities. Policy learning can be fostered by various types of organized activities, which range from peer review frameworks often focused on accountability to international learning processes based on concepts like the governmental learning spiral. This paper discusses and analyzes four examples of evaluation-based governmental learning organized in the framework of the World Bank. This contribution will reflect on different streams of learning theories for the governmental level, as they represent assumptions and motivations for organized learning in governments. The governmental learning spiral, an eight-stage approach to learning from evaluation, is presented, including in the case studies. This article will conclude by reflecting on the concept of the governmental learning spiral and its relation to different levels of learning. This paper is organized as follows: chapter one is introduction; chapter two gives learning theories for the governmental level; chapter three presents concept of the governmental learning spiral; chapter four gives four case studies; chapter five presents lessons; and chapter six presents outlook.
Link to Data Set
Citation
“Nashat, Bidjan; Speer, Sandra; Blindenbacher, Raoul. 2013. Adding Value to Evaluations : Applying the Governmental Learning Spiral for Evaluation-Based Learning. Independent Evaluation Group (IEG) working
paper series;no. 2013/1. © World Bank. http://hdl.handle.net/10986/16666 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Global Scaling Up Handwashing Project : Global Learning Strategy(World Bank, Washington, DC, 2008-09)The purpose of this learning strategy is to develop a structured process for generating, sharing, capturing, and disseminating knowledge about what works in scaling up and sustaining handwashing programs. The authors are undertaking this learning process to enable policy-makers to make evidence-based decisions and to enable the implementation of large-scale programs. Key outcomes of the learning will be knowledge products that can be used both for advocacy and for putting into action cost-effective approaches and tools to ease replication. The learning in this project will benefit not only current stakeholders but also future stakeholders interested in and committed to promoting effective handwashing behavior-change programs. The remainder of this strategy paper is divided into five sections: project background; learning goals and principles; learning culture, tools, and platforms; learning processes; and organizational aspects of learning.Publication The Art of Knowledge Exchange : A Primer for Government Officials and Development Practitioners(Washington, DC, 2013-01)In 2009, in the midst of the financial crisis, analysts were concerned that banks in Nepal were dangerously overexposed to inflated real estate and equity markets. Nepal's Central Bank (NRB) decided to evaluate its commercial banks, but needed outside expertise and assistance for stress-testing its banks and assessing the damages that could result from economic shocks. Standard International Monetary Fund (IMF) models for evaluating banks in developed economies, however, proved too complex and were unsuitable for the circumstances of a small developing country. Meanwhile, the State Bank of Pakistan (SBP) had been carrying out quarterly stress-testing of banks in Pakistan. Upon hearing about SBP's capabilities from the World Bank, NRB leadership was eager to learn how to apply Pakistan's regulatory analysis in Nepal. The World Bank facilitated and funded a knowledge exchange between the two central banks so that NRB staff could learn to use a simplified stress-testing, scenario-based model to evaluate the financial stability of Nepal's banks, develop regulations to maintain the stability of banking institutions, and establish contingency plans in the case of failure of a Nepalese bank. This story demonstrates the power of doing development differently. Nepal is very motivated to solve a pressing problem. It actively shops for a solution: the standard model is not suitable, but the Pakistani model is. Pakistan is eager to share its model with Nepal. Nepal adopts and adapts it, and it works.Publication Learning and Results in World Bank Operations(World Bank, Washington, DC, 2015-01)This report is the second in a program of evaluations that the independent evaluation group (IEG) is conducting on the learning that takes place through World Bank projects. Learning and knowledge are treated as parts of a whole and are presumed to be mutually reinforcing. The evaluation program addresses the following overarching questions: how well has the World Bank learned in its lending operations?; and what is the scope for improving how it generates, accesses, and uses learning and knowledge in these operations? Evaluation two includes findings from seven country case studies and interviews with Bank staff about their early experience of working within the Bank’s new global practices structure, which became operational on July 1, 2014. The aim is to assess the pre-FY2015 evidence in light of the new structure and roles, and to ask how long-term trends are likely to be modified as reforms evolve. Surveys and interviews reveal that, when it comes to managing projects, Bank staff rely first and foremost on a process of informal learning, leading to a gradual accumulation of tacit knowledge. Informal learning and tacit knowledge are built on the behaviors that flow from mindsets and from the characteristics and operating rules of the groups that individuals belong to. These behavioral underpinnings are mediated by incentives that institutions like the Bank provide to staff. The Bank has launched several important learning initiatives, such as the operational core curriculum. Chapter one presents approach. Chapter two mines the academic and management literature to examine the behavioral underpinnings of informal learning and tacit knowledge. Chapter three examines how individual and team behavior is mediated by the incentives that the Bank offers staff. Chapters four, five, and six examine three operational orientations of particular relevance to the new Bank: balancing of global and local focus, adaptiveness, and results focus. Chapter seven presents recommendations.Publication Learning and Results in World Bank Operations : How the Bank Learns, Evaluation 1(World Bank Group, Washington, DC, 2014-07)Knowledge, learning, and innovation are one of eight objectives that will be monitored in the Bank's new strategy. The independent evaluation group (IEG) is conducting a program of learning and results evaluations to promote a better understanding of how the World Bank acquires, captures, and transfers knowledge and learning in its lending operations, and what scope there is for improving. The objective of the program is to delineate attributes of effective learning in World Bank lending. These attributes refer to learning into lending (inputs into project design); learning while lending (feedback and modifications of design and implementation while the project is underway); and learning from lending (lessons from the project that were transmitted to other projects). The evaluation program will assess how the Bank can become better at generating, accessing, and using learning and knowledge in its lending operations. It acknowledges the importance of the feedback from knowledge to learning and from learning back to enhanced knowledge. The report is organized as follows: chapter one gives approach and context. Chapter two explores two essential aspects of learning - knowledge exploitation and knowledge exploration and the factors influencing them. Chapter three examines the contribution of mentoring. Chapter four addresses the extent to which incentives, leadership, and culture are aligned to promote learning in lending. Chapter five considers the implications of the report's findings, for the Bank's change process, for IEG, and for the design of the second evaluation in IEG's learning and results series.Publication The Matrix System at Work : An Evaluation of the World Bank's Organizational Effectiveness(Washington, DC: World Bank, 2012-04)The 1997 Bank reforms that introduced the matrix management concept aimed to adapt the organization to changing circumstances and address concerns among external stakeholders about the role of aid in development. The reforms were motivated largely by widespread recognition that the Bank's development programs were excessively driven by a culture of lending, with insufficient attention to client needs and the quality of results, which are crucial to development effectiveness. A previous round of reforms in 1987 had strengthened the country focus, but quality remained a concern. Furthermore, access of developing countries to development finance from the private sector had increased significantly, leading to a decreasing share of official development aid, including Bank financing, in total flows to developing countries. This trend has continued after slight interruption by the Asian financial crisis. In 1987, World Bank lending represented 15 percent of all external financing for developing countries. By 2002 Bank lending had declined to 4 percent of external financing (organizational effectiveness task force: final report, 2005). Changes in the external environment indicate that the matrix system is even more relevant today than when it was introduced. Client needs have diversified, with greater differentiation among countries, even within the regions; the growth of global public goods and corporate priorities is creating tensions and has given rise to new challenges which need to be reconciled with the country model; demand for cutting-edge knowledge is growing, both to enhance quality of lending and as a business line for policy and program advice to clients; and new global practices have emerged to meet needs such as information, communication and technology, and disaster management. The Bank's ability to renew itself and function as a truly global Bank is critical to its success.
Users also downloaded
Showing related downloaded files
Publication Kyrgyz Republic Country Climate and Development Report(Washington, DC: World Bank, 2025-11-03)This Country Climate and Development Report (CCDR) on the Kyrgyz Republic aims to support the country’s development goals amid a changing climate. The CCDR considers two policy scenarios up to 2050: the business-as-usual (BAU) and high-growth scenarios. As it quantifies the likely impacts of climate change on the Kyrgyz economy between now and 2050, the report highlights key government actions to best prepare for and adapt to climate impacts (referred to as “with adaptation” measures), with a particular focus on the time horizon up to 2030. The CCDR also outlines a path to net zero emissions by 2050 (referred to as “with mitigation” measures, “decarbonization,” or, simply, “net zero 2050”), highlighting associated development co-benefits.Publication Mongolia Country Climate and Development Report(Washington, DC: World Bank, 2024-10-22)Mongolia’s development prospects are uniquely challenged by both the impacts of climate change and the global shift toward a low-carbon economy. The country’s efforts toward decarbonization pose significant challenges given the structurally high-emission intensity of its economy. While challenging, climate action also presents Mongolia with opportunities to achieve important development benefits. The effects of climate risks and the shift away from coal will have diverse impacts across different regions, communities, and socioeconomic levels. The report assesses the critical interconnections between Mongolia’s development ambitions and climate change action and identifies ways to transition to a more economically diversified, inclusive, and resilient development path. It highlights key climate and transition risks affecting Mongolia’s future development and presents a pathway to enhance climate mitigation and adaptation. The report also makes a case for strengthening policies to enhance resilience to climate change and ensure a just transition, particularly for the most vulnerable. The report is structured as follows: section 1 gives introduction. Section 2 delves into the linkages between development and climate in Mongolia and presents model-based findings on the economic and poverty impacts of climate change under different scenarios. Section 3 covers four in-depth sectoral analyses. The first two mainly focus on adaptation to climate change in the agriculture and water sectors. The third considers prospects for the extraction sector, while the fourth sectoral analysis focuses on decarbonizing power and heat generation. Section 4 shifts the focus to how the government can boost resilience for climate-vulnerable populations. Section 5 outlines options for mobilizing private and public financing and private investments to support the green transition. Section 6 examines the existing institutional and governance structure for climate action and presents recommendations to improve its effectiveness, and section 7 concludes with a framework for prioritizing the policy actions outlined in this report.Publication Comoros Country Climate and Development Report(Washington, DC: World Bank, 2025-06-18)The Union of the Comoros (The Comoros) has significant vulnerability to climate change-related risks but has considerable opportunities to strengthen preparedness and resilience against these challenges. According to the Notre Dame Global Adaptation Index, the Comoros is the 29th-most vulnerable country to climate change and the 163rd most ready to adapt (out of 191). The Comoros archipelago is exposed to many natural hazards that adversely affect the country’s natural capital, people, and physical infrastructure. In 2014, the economic cost of climate-related disasters was estimated at 5.7 million dollars annually, equivalent to 9.2 percent of Gross Domestic Product (GDP). Between 2018 and 2023, as many as 11 tropical depressions or cyclones impacted the country, with Cyclone Kenneth causing the greatest damage, equivalent to 14 percent of GDP, resulting in total economic growth falling from 3.6 percent in 2018 to 1.9 percent in 2019. More than 345,000 people (40 percent of the population) were affected by the cyclone, with 185,000 people experiencing severe impacts and 12,000 people displaced. However, there is an opportunity for the country to grow more robust and shock-responsive, and to establish pre-positioned funding mechanisms to enhance future crisis response efforts. For the Comoros, adaptation and climate-resilient development are the key climate change focus areas, with the country projected to face 836 million dollars 2050 in additional costs due to climate-related impacts. Current plans to adapt to the impacts of climate change in the Comoros include efforts to improve water management, strengthen coastal protection, and develop climate-smart agriculture practices. Given the country’s reliance on its natural resource base for economic growth and mobility, protection of these resources from climate change will be essential for promoting resilient growth and development. In addition to growing the adaptive capacity of the country’s natural resource sectors, strategic economic diversification will be important to help minimize future climate impacts, and development activities will need to be undertaken in such a way as to attract low-carbon co-benefits. The Union of the Comoros is committed to addressing climate change through its Nationally Determined Contribution (NDC) and national priorities. The country’s NDC (which was revised in 2021 for a ten-year horizon) sets ambitious targets, with a goal of reducing greenhouse gas emissions by 23 percent by 2030. The country also plans to significantly increase the share of renewable energy in its energy portfolio, reaching 33 MW by 2030. This will not only promote low-carbon development but also reduce the country’s dependency on imported oil and coal, which currently make up 95 percent of the energy mix. Additionally, the Comoros has declared its intention to increase CO2 removals by 47 percent by 2030, compared to BAU.Publication Tajikistan Country Climate and Development Report(Washington, DC: World Bank, 2025-03-28)The Tajikistan Country Climate and Development Report (CCDR) explores the impact of climate change and global decarbonization on Tajikistan’s development. It identifies key areas to enhance climate resilience and deepen decarbonization and outlines priority recommendations for a successful green transition in Tajikistan, requiring structural reforms, climate-conscious policies, and inclusive strategies for a resilient and sustainable future. Despite economic growth and poverty reduction over the past two decades, Tajikistan's reliance on natural resources and remittances has led to unsustainable development, depleting natural capital and limiting job creation. The government’s green transition plan focuses on renewable energy, promising energy security, economic growth, and regional electricity exports. However, further efforts are needed for a resilient development path, including a complementary reform program to bring significant economic benefits, climate adaptation, and low-carbon development that will benefit Tajikistan and Central Asia's electricity systems. Climate change poses significant risks, threatening water security, agricultural productivity, and infrastructure, potentially reducing GDP per capita by 5-6% by mid-century and pushing 100,000 people into poverty. Additional adaptation measures are crucial, focusing on water management, resilient landscapes, climate-smart agriculture, and disaster risk management. A low-carbon development pathway offers a more resilient and prosperous future, with near net-zero emissions in energy and waste sectors by 2050, boosting economic growth, and job creation and reducing air pollution. Achieving these goals requires substantial investments and institutional reforms to mobilize private capital and attract green foreign investment. Development partners can provide financial assistance, technical expertise, and capacity building.Publication Guinea-Bissau Country Climate and Development Report(Washington, DC: World Bank, 2024-10-23)Guinea-Bissau is endowed with a wealth of natural resources, with the highest natural capital per capita in West Africa (US3,874 dollars per capita), which could be leveraged for sustainable and resilient growth. However, Guinea-Bissau faces significant development hurdles, such as high poverty rates, political instability, and economic challenges, including an over-reliance on cashew nuts. Rural poverty has increased, and the nation's infrastructure, education, and health care systems are underdeveloped. Climate change poses a severe threat, potentially impacting agriculture, fisheries, and infrastructure. Without adaptation, it could lead to a significant cut in real GDP per capita (minus 7.3 percent by 2050) and increase in poverty (with up to over 200,000 additional poor by 2050, that is, 5 percent of the expected population, in the worst scenario). The country's low greenhouse gas emissions are expected to rise, mainly due to agriculture and land-use changes, with deforestation being a major contributing factor. Although Guinea-Bissau is a low emitter, it has high mitigation ambitions, targeting a 30 percent reduction in greenhouse gas emissions by 2030. The Nationally Determined Contribution outlines significant climate actions, with initiatives focused on forest conservation, sustainable agriculture, and community development. However, the country's political instability, institutional weaknesses, and limited financial resources pose challenges to implementing these climate commitments, which depend heavily on external funding. The financial sector's underdevelopment and vulnerability to external shocks limit its ability to support green investments, though reforms could enhance resilience. Guinea-Bissau must consider its climate financing as development financing and vice-versa, engage the private sector, and integrate climate goals with national development plans to ensure a sustainable future. Concessional climate financing is vital due to the underdeveloped financial sector and the government’s limited borrowing capacity. Addressing Guinea-Bissau's vulnerability to climate change and its structural issues requires a cohesive approach that integrates development and climate strategies. This could involve improving governance, diversifying the economy, protecting natural capital, developing human capital, and investing in sustainable agriculture and infrastructure. The transition to a more sustainable and inclusive development pathway that supports economic growth is possible, but requires focusing on key strategic sectors, enhancing institutional capacity, and creating the conditions to mobilize finance. As a highly vulnerable country, there are myriad needs in the different sectors; however, to be more efficient and effective, Guinea-Bissau should prioritize actions in a few sectors, especially actions on biodiversity, agriculture, and social protection. Low carbon development, especially in energy and forestry sectors, could provide cost-efficient solutions and attract climate finance, including from the private sector, which will support the overall development agenda.