Publication: Scaling Education Innovations in Complex Emergencies: A Meta-Evaluation of Five Process and Three Impact Evaluations (Published online: 30 Sep 2022)
Loading...
Files
67 downloads
Date
2023-10-12
ISSN
1943-9342 (print)
1943-9407 (online)
1943-9407 (online)
Published
2023-10-12
Editor(s)
Abstract
The papers in this special issue describe evaluations of the scaling journey of five different education programmes operating in humanitarian crises. This introduction first presents the research context for these evaluations followed by a synthesis of the overarching barriers and facilitators to scaling across three domains: (1) context, (2) business model, and (3) advocacy and ownership based on a qualitative synthesis. The synthesis showed that implementers often started multiple pilot projects in different contexts rather than scaling-up in one context. We also present a summary of impacts on learning outcomes from impact evaluations of three of the five education programmes.
Link to Data Set
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Citations
- Cited 1 times in Scopus (view citations)
Collections
Related items
Showing items related by metadata.
Publication The effects of booster classes in protracted crisis settings(Taylor and Francis, 2023-10-12)Students in protracted crisis settings often face a range of challenges which combine to yield low education outcomes. This paper presents the results from a randomised controlled trial of weekend and holiday booster classes for 7th and 8th grade girls in Kakuma refugee camp in Kenya, that aimed to improve girls’ education outcomes and increase transition rates from primary to secondary school. While qualitative results suggested numerous advantages of the booster classes, including more freedom to ask questions, smaller class sizes, and kinder teachers, the program did not yield statistically significant effects on learning outcomes, school attendance or noncognitive skills. Mixed-methods research suggests that the limited impacts may stem from implementation challenges including irregular booster class attendance and a lack of appropriate teaching materials. More broadly, the results show the importance of accounting for implementation challenges in the reporting of impact evaluation results.Publication Typology of Economic Women’s Groups Programs in South Asia(World Bank, Washington, DC, 2023-04-13)Women’s groups models vary widely across contexts but context-specific documentation is limited. This wide variation coupled with inconsistent terms used to describe these groups creates challenges in using the evidence collected on group-based interventions to inform policy. The typology presented in this brief focuses on economic women’s group models implemented in South Asia. Using program documents and evidence from evaluations, it identifies implementation models, key characteristics, and the implications of investing in women’s groups to improve economic outcomes in South Asia.Publication Reproductive Health—The Missing Millennium Development Goal : Poverty, Health, and Development in a Changing World(Washington, DC: World Bank, 2006)While women in developing countries continue to die in large numbers in child birth, population and reproductive health specialists and advocates around the world are struggling to keep the policy agenda focused on the rights and needs of poor women. The 1994 Cairo Conference and Program of Action changed how we do business, and opened many doors, but the agenda is not complete and has stalled in a number of ways. At the country level, governments and donors are making difficult choices about how and where to allocate scarce human and financial resources. Funding approaches have moved away from the implementation of narrowly directed health programs to a broader approach of health system development and reform. At the same time, countries are also centering their development agenda on the broad goal of poverty reduction. This volume addresses a large knowledge and capacity gap in the Reproductive Health community and provides tools for key actors to empower faster positive change. It is a synopsis of the materials developed for World Bank's Institute's learning program on Achieving the Millennium Development Goals: Poverty Reduction, Reproductive Health and Health Sector Reform. The volume brings together knowledge about epidemiology, demography, economics, and trends in global financial assistance. The volume also introduces practical tools such as benefit incidence analysis, costing, and stakeholder analysis to strengthen the evidence base for policy and to address the political economy factors for reform.Publication Learning in the Face of Adversity(Washington, DC, 2014-10)The goal of this study is to provide a better understanding of how a school system can operate efficiently under adversity. The results of this work will be useful in identifying relevant policies in the Middle East and North Africa region. Palestine refugees are achieving higher-than-average learning outcomes in spite of the adverse circumstances they live under. Their education system the United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) operates one of the largest non-governmental school systems in the Middle East. It manages nearly 700 schools, has hired 17,000 staff, educates more than 500,000 refugee students each year, and operates in five areas, including the West Bank, Gaza, Jordan, Lebanon, and Syria. This study examines three: West Bank, Gaza, and Jordan. Contrary to what might be expected from a resource-constrained administration serving refugee students who continually face a multitude of adversities, UNRWA students outperform public schools in the three regions the West Bank, Gaza, and Jordan by a year's worth of learning. This study was undertaken to better understand the reasons for success at UNRWA schools and their positive variation from comparable public schools. Econometric techniques were used to analyze international (TIMSS and Programme for International Student Assessment, or PISA) and national learning achievement data. Pedagogical practices and classroom time-on-task were observed using structured methods (Stallings model). Systems Approach for Better Education Results (SABER) tools were used to better understand the policies and implementation strategies for school and teacher management and for monitoring and evaluation. Additionally, qualitative data were collected and analyzed in line with an education resilience conceptual framework to better uncover factors that help students develop the skills to learn despite the adversities they face.Publication Scaling Up Collaborative Social Accountability in Complex Governance Systems(Washington, DC: World Bank, 2024-02-13)When social accountability interventions scale up and their sustainability depends on the interactions of many agents and system components, related results are rarely observable at the end of an intervention. The 2019 OECD Development Assistance Committee’s (OECD DAC) revamped evaluations criteria for assessing sustainability acknowledges that such results are often emergent, and should be monitored and evaluated with this in mind. It therefore emphasizes a turn towards assessing complex processes prospectively. It also asks evaluations to consider how likely it is that these results are evident at the time they are monitored or evaluated. However, the social accountability field continues to have gaps regarding doing this effectively in practice. This paper presents and provides evidence from testing an innovative operational approach that has promising potential to support this aim - a sequential, relational rubric. This approach can support practitioners to monitor, evaluate and learn about the causal processes of scale up of social accountability interventions with an eye towards sustainability i.e., considering prospective sustainability. It is grounded in systems thinking, co-production and social learning theory, as well as links with collective governance and social contract theory for development. Evidence yielded from the authors’ testing of this approach on a sample of diverse projects from the Global Partnership for Social Accountability (GPSA) program revealed that the alleged ‘absence of evidence’ dilemma of social accountability scale up is due to ill-fitting concepts and methods for assessment. It challenges existing assumptions and findings that claim that social accountabilityprocesses do not scale and are unsustainable. The authors propose that by using fit-for-purpose concepts and methods with a focus on social learning and compromise – also called a ‘resonance pathway to scale’ which this paper discusses in detail – it is possible to observe loosely coordinated scale up processes at work in many (but not all) social accountability interventions and identify tangible evidence of prospective sustainability. An important caveat is that these processes, the outcomes they generate, and the corresponding evidence often look qualitatively different than the original intervention design and predictions for scale-up at that point in time. This is because the process of deliberation and compromise inherent to social accountability work in dynamic local systems introduces changes and new conditions for uptake by diverse actors in the public sector, civil society, and donor institutions. The paper concludes that even relatively small-scale localized projects of three to five years with budgets of less than one million USD, across different contexts and sectors can produce processes and outcomes which contribute to many forms of sustainability, including via scaleup. Furthermore, the cross-fertilization of learning and aggregation of results for scale-up across projects within and beyond the GPSA (and other programs) can help monitoring evaluation and learning (MEL) and social accountability practitioners alike to deliver on a program’s mandate. Doing so can also create new knowledge for the wider social accountability field that siloed interventions, lacking suitable concepts and methods for assessing scale-up and prospective sustainability, often fail to produce. The paper ends with recommendations for taking forward this approach and the associated benefits, implications and required investments
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, January 2024(Washington, DC: World Bank, 2024-01-09)Note: Chart 1.2.B has been updated on January 18, 2024. Chart 2.2.3 B has been updated on January 14, 2024. Global growth is expected to slow further this year, reflecting the lagged and ongoing effects of tight monetary policy to rein in inflation, restrictive credit conditions, and anemic global trade and investment. Downside risks include an escalation of the recent conflict in the Middle East, financial stress, persistent inflation, weaker-than-expected activity in China, trade fragmentation, and climate-related disasters. Against this backdrop, policy makers face enormous challenges. In emerging market and developing economies (EMDEs), commodity exporters face the enduring challenges posed by fiscal policy procyclicality and volatility, which highlight the need for robust fiscal frameworks. Across EMDEs, previous episodes of investment growth acceleration underscore the critical importance of macroeconomic and structural policies and an enabling institutional environment in bolstering investment and long-term growth. At the global level, cooperation needs to be strengthened to provide debt relief, facilitate trade integration, tackle climate change, and alleviate food insecurity.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.