Publication: Adding Value to Evaluations : Applying the Governmental Learning Spiral for Evaluation-Based Learning
Loading...
Date
2013-10
ISSN
Published
2013-10
Author(s)
Editor(s)
Abstract
Governmental learning has a multidisciplinary research tradition and a plethora of literature exists on organizational as well as policy learning. Different concepts for structured learning from evaluation results on the governmental level exist. It is common to all that they depend on a careful selection of participants and that the political, cultural, and institutional environment is key to the ultimate success of many governmental learning activities. Policy learning can be fostered by various types of organized activities, which range from peer review frameworks often focused on accountability to international learning processes based on concepts like the governmental learning spiral. This paper discusses and analyzes four examples of evaluation-based governmental learning organized in the framework of the World Bank. This contribution will reflect on different streams of learning theories for the governmental level, as they represent assumptions and motivations for organized learning in governments. The governmental learning spiral, an eight-stage approach to learning from evaluation, is presented, including in the case studies. This article will conclude by reflecting on the concept of the governmental learning spiral and its relation to different levels of learning. This paper is organized as follows: chapter one is introduction; chapter two gives learning theories for the governmental level; chapter three presents concept of the governmental learning spiral; chapter four gives four case studies; chapter five presents lessons; and chapter six presents outlook.
Link to Data Set
Citation
“Nashat, Bidjan; Speer, Sandra; Blindenbacher, Raoul. 2013. Adding Value to Evaluations : Applying the Governmental Learning Spiral for Evaluation-Based Learning. Independent Evaluation Group (IEG) working
paper series;no. 2013/1. © World Bank. http://hdl.handle.net/10986/16666 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Global Scaling Up Handwashing Project : Global Learning Strategy(World Bank, Washington, DC, 2008-09)The purpose of this learning strategy is to develop a structured process for generating, sharing, capturing, and disseminating knowledge about what works in scaling up and sustaining handwashing programs. The authors are undertaking this learning process to enable policy-makers to make evidence-based decisions and to enable the implementation of large-scale programs. Key outcomes of the learning will be knowledge products that can be used both for advocacy and for putting into action cost-effective approaches and tools to ease replication. The learning in this project will benefit not only current stakeholders but also future stakeholders interested in and committed to promoting effective handwashing behavior-change programs. The remainder of this strategy paper is divided into five sections: project background; learning goals and principles; learning culture, tools, and platforms; learning processes; and organizational aspects of learning.Publication The Art of Knowledge Exchange : A Primer for Government Officials and Development Practitioners(Washington, DC, 2013-01)In 2009, in the midst of the financial crisis, analysts were concerned that banks in Nepal were dangerously overexposed to inflated real estate and equity markets. Nepal's Central Bank (NRB) decided to evaluate its commercial banks, but needed outside expertise and assistance for stress-testing its banks and assessing the damages that could result from economic shocks. Standard International Monetary Fund (IMF) models for evaluating banks in developed economies, however, proved too complex and were unsuitable for the circumstances of a small developing country. Meanwhile, the State Bank of Pakistan (SBP) had been carrying out quarterly stress-testing of banks in Pakistan. Upon hearing about SBP's capabilities from the World Bank, NRB leadership was eager to learn how to apply Pakistan's regulatory analysis in Nepal. The World Bank facilitated and funded a knowledge exchange between the two central banks so that NRB staff could learn to use a simplified stress-testing, scenario-based model to evaluate the financial stability of Nepal's banks, develop regulations to maintain the stability of banking institutions, and establish contingency plans in the case of failure of a Nepalese bank. This story demonstrates the power of doing development differently. Nepal is very motivated to solve a pressing problem. It actively shops for a solution: the standard model is not suitable, but the Pakistani model is. Pakistan is eager to share its model with Nepal. Nepal adopts and adapts it, and it works.Publication Learning and Results in World Bank Operations(World Bank, Washington, DC, 2015-01)This report is the second in a program of evaluations that the independent evaluation group (IEG) is conducting on the learning that takes place through World Bank projects. Learning and knowledge are treated as parts of a whole and are presumed to be mutually reinforcing. The evaluation program addresses the following overarching questions: how well has the World Bank learned in its lending operations?; and what is the scope for improving how it generates, accesses, and uses learning and knowledge in these operations? Evaluation two includes findings from seven country case studies and interviews with Bank staff about their early experience of working within the Bank’s new global practices structure, which became operational on July 1, 2014. The aim is to assess the pre-FY2015 evidence in light of the new structure and roles, and to ask how long-term trends are likely to be modified as reforms evolve. Surveys and interviews reveal that, when it comes to managing projects, Bank staff rely first and foremost on a process of informal learning, leading to a gradual accumulation of tacit knowledge. Informal learning and tacit knowledge are built on the behaviors that flow from mindsets and from the characteristics and operating rules of the groups that individuals belong to. These behavioral underpinnings are mediated by incentives that institutions like the Bank provide to staff. The Bank has launched several important learning initiatives, such as the operational core curriculum. Chapter one presents approach. Chapter two mines the academic and management literature to examine the behavioral underpinnings of informal learning and tacit knowledge. Chapter three examines how individual and team behavior is mediated by the incentives that the Bank offers staff. Chapters four, five, and six examine three operational orientations of particular relevance to the new Bank: balancing of global and local focus, adaptiveness, and results focus. Chapter seven presents recommendations.Publication Learning and Results in World Bank Operations : How the Bank Learns, Evaluation 1(World Bank Group, Washington, DC, 2014-07)Knowledge, learning, and innovation are one of eight objectives that will be monitored in the Bank's new strategy. The independent evaluation group (IEG) is conducting a program of learning and results evaluations to promote a better understanding of how the World Bank acquires, captures, and transfers knowledge and learning in its lending operations, and what scope there is for improving. The objective of the program is to delineate attributes of effective learning in World Bank lending. These attributes refer to learning into lending (inputs into project design); learning while lending (feedback and modifications of design and implementation while the project is underway); and learning from lending (lessons from the project that were transmitted to other projects). The evaluation program will assess how the Bank can become better at generating, accessing, and using learning and knowledge in its lending operations. It acknowledges the importance of the feedback from knowledge to learning and from learning back to enhanced knowledge. The report is organized as follows: chapter one gives approach and context. Chapter two explores two essential aspects of learning - knowledge exploitation and knowledge exploration and the factors influencing them. Chapter three examines the contribution of mentoring. Chapter four addresses the extent to which incentives, leadership, and culture are aligned to promote learning in lending. Chapter five considers the implications of the report's findings, for the Bank's change process, for IEG, and for the design of the second evaluation in IEG's learning and results series.Publication The Matrix System at Work : An Evaluation of the World Bank's Organizational Effectiveness(Washington, DC: World Bank, 2012-04)The 1997 Bank reforms that introduced the matrix management concept aimed to adapt the organization to changing circumstances and address concerns among external stakeholders about the role of aid in development. The reforms were motivated largely by widespread recognition that the Bank's development programs were excessively driven by a culture of lending, with insufficient attention to client needs and the quality of results, which are crucial to development effectiveness. A previous round of reforms in 1987 had strengthened the country focus, but quality remained a concern. Furthermore, access of developing countries to development finance from the private sector had increased significantly, leading to a decreasing share of official development aid, including Bank financing, in total flows to developing countries. This trend has continued after slight interruption by the Asian financial crisis. In 1987, World Bank lending represented 15 percent of all external financing for developing countries. By 2002 Bank lending had declined to 4 percent of external financing (organizational effectiveness task force: final report, 2005). Changes in the external environment indicate that the matrix system is even more relevant today than when it was introduced. Client needs have diversified, with greater differentiation among countries, even within the regions; the growth of global public goods and corporate priorities is creating tensions and has given rise to new challenges which need to be reconciled with the country model; demand for cutting-edge knowledge is growing, both to enhance quality of lending and as a business line for policy and program advice to clients; and new global practices have emerged to meet needs such as information, communication and technology, and disaster management. The Bank's ability to renew itself and function as a truly global Bank is critical to its success.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Global Economic Prospects, January 2024(Washington, DC: World Bank, 2024-01-09)Note: Chart 1.2.B has been updated on January 18, 2024. Chart 2.2.3 B has been updated on January 14, 2024. Global growth is expected to slow further this year, reflecting the lagged and ongoing effects of tight monetary policy to rein in inflation, restrictive credit conditions, and anemic global trade and investment. Downside risks include an escalation of the recent conflict in the Middle East, financial stress, persistent inflation, weaker-than-expected activity in China, trade fragmentation, and climate-related disasters. Against this backdrop, policy makers face enormous challenges. In emerging market and developing economies (EMDEs), commodity exporters face the enduring challenges posed by fiscal policy procyclicality and volatility, which highlight the need for robust fiscal frameworks. Across EMDEs, previous episodes of investment growth acceleration underscore the critical importance of macroeconomic and structural policies and an enabling institutional environment in bolstering investment and long-term growth. At the global level, cooperation needs to be strengthened to provide debt relief, facilitate trade integration, tackle climate change, and alleviate food insecurity.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.