Publication: Introducing a Performance-Based School Grant in Jakarta: What Do We Know about Its Impact after Two Years?
Loading...
Published
2017-10
ISSN
Date
2017-10-26
Author(s)
Al-Samarrai, Samer
Shrestha, Unika
Nakajima, Nozomi
Santoso, Santoso
Adi Wijoyo, Wisnu Harto
Editor(s)
Abstract
This paper evaluates the early impact of introducing a performance component into Jakarta's school grant program on learning outcomes. Using administrative data, it applies difference-in-differences and regression discontinuity approaches to identify the impact of the grant by exploiting differences in program coverage over time, as well as by comparing changes in test scores between schools that received the additional performance award with schools that did not. The paper finds that the introduction of the performance component had different impacts on government primary and junior secondary schools. The program improved learning outcomes for primary schools at the bottom of the performance distribution and narrowed performance gaps across schools. However, improvements in equity were also driven by negative impacts of the program on better performing primary schools. Overall, the program reduced primary examination scores albeit by a small amount. In contrast to the results at the primary level, the performance component improved examination scores in government junior secondary schools. However, the impact seemed to be greatest among better performing schools and has therefore widened performance gaps. The findings also suggest that program impact was largely through competition between schools to receive the performance component. There is little evidence that the additional resources schools received from the award had any additional impact. The evaluation utilized preexisting administrative data and the paper offers some suggestions on how education information systems can be strengthened to create more robust feedback loops between research and policy.
Link to Data Set
Citation
“Al-Samarrai, Samer; Shrestha, Unika; Hasan, Amer; Nakajima, Nozomi; Santoso, Santoso; Adi Wijoyo, Wisnu Harto. 2017. Introducing a Performance-Based School Grant in Jakarta: What Do We Know about Its Impact after Two Years?. Policy Research Working Paper;No. 8223. © World Bank. http://hdl.handle.net/10986/28583 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Gender Gaps in the Performance of Small Firms: Evidence from Urban Peru(Washington, DC: World Bank, 2025-09-23)This paper estimates the gender gap in the performance of firms in Peru using representative data on both formal and informal firms. On average, informal female-led firms have lower sales, labor productivity, and profits compared to their male-led counterparts, with differences more pronounced when controlling for observable determinants of firm performance. However, gender gaps are only significant at the bottom of the performance distribution of informal firms, and these gaps disappear at the top of the distribution of informal firms and for formal firms. Possible explanations for the performance gaps at the bottom of the distribution include the higher likelihood of small, female-led firms being home-based, which is linked to lower profits, and their concentration in less profitable sectors. The paper provides suggestive evidence that household responsibilities play a key role in explaining the gender gap in firm performance among informal firms. Therefore, policies that promote access to care services or foster a more equal distribution of household activities may reduce gender productivity gaps and allow for a more efficient allocation of resources.Publication The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-02-05)Research on the labor market implications of artificial intelligence has focused principally on high-income countries. This paper analyzes this issue using microdata from a large set of low- and middle-income countries, applying a measure of potential artificial intelligence occupational exposure to a harmonized set of labor force surveys for 25 countries, covering a population of 3.5 billion people. The approach advances work by using harmonized microdata at the level of individual workers, which allows for a multivariate analysis of factors associated with exposure. Additionally, unlike earlier papers, the paper uses highly detailed (4 digit) occupation codes, which provide a more reliable mapping of artificial intelligence exposure to occupation. Results within countries, show that artificial intelligence exposure is higher for women, urban workers, and those with higher education. Exposure decreases by country income level, with high exposure for just 12 percent of workers in low-income countries and 15 percent of workers in lower-middle-income countries. Furthermore, lack of access to electricity limits effective exposure in low-income countries. These results suggest that for developing countries, and in particular low-income countries, the labor market impacts of artificial intelligence will be more limited than in high-income countries. While greater exposure to artificial intelligence indicates larger potential for future changes in certain occupations, it does not equate to job loss, as it could result in augmentation of worker productivity, automation of some tasks, or both.Publication Geopolitical Risks and Trade(Washington, DC: World Bank, 2025-09-23)This paper studies the impact of geopolitical risks on international trade, using the Geopolitical Risk (GPR) index of Caldara and Iacoviello (2022) and an empirical gravity model. The impact of spikes in geopolitical risk on trade is negative, strong, and heterogeneous across sectors. The findings show that increases in geopolitical risk reduce trade by about 30 to 40 percent. These effects are equivalent to an increase of global tariffs of up to 14 percent. Services trade is most vulnerable to geopolitical risks, followed by agriculture, and the impact on manufacturing trade is moderate. These negative effects are partially mitigated by cultural and geographic proximity, as well as by the presence of trade agreements.
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Local Governance and Education Performance : A Survey of the Quality of Local Education governance in 50 Indonesian Districts(World Bank, Jakarta, 2013-10)In the last 15 years, Indonesia has introduced a comprehensive package of education reforms designed to expand access and improve quality. A key component of the reform process has been the devolution of responsibility for basic education services to local governments and schools. The ability of local governments to deliver good quality basic education services varies considerably across Indonesia. Identifying the key dimensions of governance that underpin effective education service delivery can provide a starting point for addressing existing weaknesses and raising education performance. The main purpose of this report is to assess the state of local education governance in a sample of Indonesian districts and how it affects education performance. The study uses a unique survey of 50 local governments conducted in 2009 and 2012, coupled with district level information from household surveys, to identify patterns and explore trends in the relationship between governance and education outcomes. The report also explores the effects of a large donor supported program that aimed to strengthen the capacity of local governments. The findings of the Indonesian Local Education Governance (ILEG) survey demonstrate the importance of the quality of local governance in improving district education performance. Recent governments have demonstrated a commitment to education that has been backed up by substantial increases in public investment. The challenge for the education sector is to translate this commitment and increased investment into better education outcomes. The report has shown that strengthening the capacity of local governments to deliver good quality basic education services needs to be at the heart of efforts to address this challenge.Publication Investing in School Readiness(World Bank, Washington, DC, 2016-09)This paper presents evidence on the cost-effectiveness of early childhood education pathways in rural Indonesia. It documents the existence of substantial differences in school readiness between 6 to 9 year old children. Using detailed enrollment histories, it unpacks whether and how early education experiences explain these gaps. The analysis considers not only the sequence of services children enroll in, but also the age at which they enroll and the duration for which they enroll. The differences in primary school test scores between a child who has no early education exposure and a child who completes a full sequence at the developmentally appropriate age are 0.42 standard deviations in language and 0.43 standard deviations in mathematics, roughly equivalent to an additional 0.9 to 1.2 years of primary schooling. The paper analyzes the cost-effectiveness of various early education pathways in Indonesia to show that providing access to both playgroups and kindergartens to young children at developmentally appropriate ages can optimize public investments in early childhood education. The paper subjects the analysis to a variety of robustness checks, and concludes that children enrolled in play-based early education programs (playgroups) at age 3 or 4, followed by the country's more academically structured programs (kindergartens) at age 5 or 6, are more likely to be ready for primary school than children who do not follow this sequence. Compulsory pre-primary education policy should consider incorporating both playgroups and kindergartens.Publication Performance-Based Financing Toolkit(Washington, DC: World Bank, 2014-02-26)Performance-based financing (PBF) approaches have expanded rapidly in lower-and middle income countries, and especially in Africa. The number of countries has grown from three in 2006 to 32 in 2013. PBF schemes are flourishing and cause considerable demand for technical assistance in executing these health reforms in a rational and accountable manner. Currently there is a lack of knowledge among many health reformers of how to implement performance-based financing pilot projects, and scale them up intelligently. In a context of tremendous demand for solid design and implementation experience and given the rapid expansion of results-based financing (RBF) programs, there is an urgent need to build capacity in designing and implementing PBF programs. As yet there has been little attempt to gather the learning from these experiences together in one volume and, moreover, in a form that serves as a guide to implementers. This toolkit answers the most pressing issues related to the supply-side RBF programs of which PBF forms part.Publication Transferring the Purchasing Role from International to National Organizations During the Scale-Up Phase of Performance-Based Financing in Cameroon(Taylor and Francis, 2017-04-13)The World Bank and the government of Cameroon launched a performance-based financing (PBF) program in Cameroon in 2011. To ensure its rapid implementation, the performance purchasing role was sub-contracted to a consultancy firm and a nongovernmental organization, both international. However, since the early stage, it was agreed upon that this role would later be transferred to a national entity. This explanatory case study aims at analyzing the process of this transfer using Dolowitz and Marsh's framework. We performed a document review and interviews with various stakeholders (n = 33) and then conducted thematic analysis of interview recordings. Sustainability, ownership, and integration of the PBF intervention into the health system emerged as the main reasons for the transfer. The different aspects of transfer from international entities to a national body consisted of (1) the decision-making power, (2) the “soft” elements (e.g., ideas, expertise), and (3) the “hard” elements (e.g., computers, vehicles). Factors facilitating the transfer included the fact that it was planned from the start and the modification of the legal status of the national organization that became responsible for strategic purchasing. Other factors hindered the transfer, such as the lack of a legal act clarifying the conditions of the transfer and the lack of post-transition support agreements. The Cameroonian experience suggests that key components of a successful transfer of PBF functions from international to national organizations may include clear guidelines, co-ownership and planning of the transition by all parties, and post-transition support to new actors.Publication The Role of Preschool Quality in Promoting Child Development(World Bank, Washington, DC, 2016-01)This paper reports on the quality of early childhood education in rural Indonesia. On average, the paper finds that centers created under the Indonesia Early Childhood Education and Development Project provide higher quality services than other types of preschools, as measured by a comprehensive instrument of preschool quality based on direct observation of classrooms in session (the Early Childhood Environment Rating Scale-Revised). The paper also examines the relationship between preschool quality and childrens early development using three commonly applied measures of quality: (i) the Early Childhood Environment Rating Scale-Revised; (ii) teacher characteristics; and (iii) structural characteristics of preschool services, such as their size and amount of class time. First, correcting for measurement error using an instrumental variables approach, the findings suggest that preschool quality is a significant and meaningful positive predictor of childrens developmental outcomes. Second, the findings for teacher characteristics are mixed, suggesting that policies focused solely on hiring teachers based on experience and training will be insufficient to improve childrens learning. Instead, policies must address the quality of professional development activities for teachers. Third, the amount of class time spent in early childhood programs is a significant positive predictor of children’s developmental outcomes. This suggests that in rural Indonesia—where early childhood programs are relatively low dose—children are likely to benefit from attending longer hours of preschool, either playgroups or kindergartens. Lastly, the paper compares items in the Early Childhood Environment Rating Scale-Revised with Indonesias national minimum service standards for early childhood education and development, and finds that the relationship between this alternative, context-appropriate measure of preschool quality and children’s development outcomes strongly corroborates the earlier conclusions.
Users also downloaded
Showing related downloaded files
Publication Europe and Central Asia Economic Update, Fall 2024: Better Education for Stronger Growth(Washington, DC: World Bank, 2024-10-17)Economic growth in Europe and Central Asia (ECA) is likely to moderate from 3.5 percent in 2023 to 3.3 percent this year. This is significantly weaker than the 4.1 percent average growth in 2000-19. Growth this year is driven by expansionary fiscal policies and strong private consumption. External demand is less favorable because of weak economic expansion in major trading partners, like the European Union. Growth is likely to slow further in 2025, mostly because of the easing of expansion in the Russian Federation and Turkiye. This Europe and Central Asia Economic Update calls for a major overhaul of education systems across the region, particularly higher education, to unleash the talent needed to reinvigorate growth and boost convergence with high-income countries. Universities in the region suffer from poor management, outdated curricula, and inadequate funding and infrastructure. A mismatch between graduates' skills and the skills employers are seeking leads to wasted potential and contributes to the region's brain drain. Reversing the decline in the quality of education will require prioritizing improvements in teacher training, updated curricula, and investment in educational infrastructure. In higher education, reforms are needed to consolidate university systems, integrate them with research centers, and provide reskilling opportunities for adult workers.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication IFC Annual Report 2012 : Innovation, Influence, Demonstration, Volume 2. Results(Washington, DC: World Bank, 2012)This annual report of the International Finance Corporation (IFC) summarizes the innovation and leadership roles in the private sector during fiscal year 2012. The IFC invested a record $20.4 billion in 103 developing countries, reflecting a doubling of annual commitments over the last five years. Those investments included nearly $5 billion mobilized from other investors, and an investment for Sub-Saharan Africa totaling $2.7 billion, nearly twice as much as five years ago. The advisory services program expenditures grew to $197 million, up more than 50 percent over the last five years. Advisory services also helped 33 client governments introduce 56 investment-climate reforms that will improve access to basic services for more than 16 million people. IFC investment clients helped support 2.5 million jobs in 2011 and made 23 million loans totaling more than $200 billion to micro, small, and medium enterprises. Net income before grants to the International Development Association (IDA) totaled $1.66 billion. The IFC has invested more than $23 billion in IDA countries, nearly $6 billion of it in fiscal year 2012 alone.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.