Publication: Using the Oaxaca-Blinder Decomposition Technique to Analyze Learning Outcomes Changes over Time : An Application to Indonesia’s Results in PISA Mathematics
Loading...
Published
2011-03-01
ISSN
Date
2012-03-19
Author(s)
Editor(s)
Abstract
The Oaxaca-Blinder technique was originally used in labor economics to decompose earnings gaps and to estimate the level of discrimination. It has been applied since in other social issues, including education, where it can be used to assess how much of a gap is due to differences in characteristics (explained variation) and how much is due to policy or system changes (unexplained variation). The authors apply the decomposition technique in an effort to analyze the increase in Indonesia's score in PISA mathematics. Between 2003 and 2006, Indonesia's score increased by 30 points, or 0.3 of a standard deviation. The test score increase is assessed in relation to family, student, school and institutional characteristics. The gap over time is decomposed into its constituent components based on the estimation of cognitive achievement production functions. The decomposition results suggest that almost the entire test score increase is explained by the returns to characteristics, mostly related to student age. However, the authors find that the adequate supply of teachers also plays a role in test score changes.
Link to Data Set
Citation
“Barrera-Osorio, Felipe; Garcia-Moreno, Vicente; Patrinos, Harry Anthony; Porta, Emilio. 2011. Using the Oaxaca-Blinder Decomposition Technique to Analyze Learning Outcomes Changes over Time : An Application to Indonesia’s Results in PISA Mathematics. Policy Research working paper ; no. WPS 5584. © World Bank. http://hdl.handle.net/10986/3350 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Quality of education in Colombia - Achievements and challenges ahead : analysis of the results of TIMSS 1995-2007(World Bank, 2010-08-06)The main objective of this report is to analyze the effect of time changes and factors associated with student achievement in Colombia in order to foster policies to improve education quality that are grounded in research and the Colombian context. In 2007, Colombia participated for the second time in the Trends in International Mathematics and Science Study (TIMSS), providing a first-time opportunity to analyze the effects of time changes on student achievement over a period (1995-2007) during which a number of education reforms were made. Using the TIMSS 2007 results offers a chance to deepen the study on the factors associated with learning in Colombia and to benchmark Colombia's education system against that of other countries. This effort began during the first phase of the Colombia Programmatic Quality and Relevance of Education Analytic and Advisory Activities (AAA), in which an analysis of Colombia's debut in the 2006 Program for International Student Assessment (PISA), resulted in publication of, 'the quality of education in Colombia: an analysis and options for a policy agenda' report (hereafter, 'PISA report'). The present report builds on this work through an analysis of Colombia's participation in TIMSS 2007 in relation to its performance on TIMSS 1995, and reaffirms the urgent need for improved student learning outcomes in Colombia, further confirming a number of the policy options put forward in the PISA report to inform a future agenda for system design and reform.Publication How Can Bulgaria Improve Its Education System? An Analysis of PISA 2012 and Past Results(Washington, DC, 2012-09-26)Bulgaria's performance on all three disciplines of the program for international student assessment (PISA) 2012 was slightly better than its PISA 2000 performance, after having dropped between 2000 and 2006. The improvements in performance between 2006 and 2012 promoted shared prosperity, but equality of opportunities is still a major challenge. In fact, disaggregating students' PISA scores across a number of variables for example, location and ethnicity - shows that large inequalities exist in Bulgaria's education system. Peer characteristics and school segregation are the key drivers of the Bulgarian education system's performance. An in-depth analysis into math and reading skills shows imbalances in performance in Bulgaria. The main areas in which Bulgaria can further improve its educational system involve: delaying the tracking of students to reduce segregation in schools; continue improving the quality of educational resources to ensure that all students learn in an environment with books, lab equipment, and technological hardware and software; encouraging longer pre-primary education for all children; learning from successful schools to improve accountability mechanisms for schools countrywide, particularly in rural areas; reevaluating the curriculum and assessment framework to better align student learning to the envisaged country goals; and promoting effective classroom management and strengthening teaching practices.Publication The Impact of the 1999 Education Reform in Poland(2010-04-01)Increasing the share of vocational secondary schooling has been a mainstay of development policy for decades, perhaps nowhere more so than in formerly socialist countries. The transition, however, led to significant restructuring of school systems, including a declining share of vocational students. Exposing more students to a general curriculum could improve academic abilities. This paper analyzes Poland s significant improvement in international achievement tests and the restructuring of the education system that expanded general schooling to test the hypothesis that delayed vocational streaming improves outcomes. Using propensity score matching and differences-in-differences estimates, the authors show that delayed vocationalization had a positive and significant impact on student performance on the order of one standard deviation.Publication Education Quality and Opportunities for Skills Development in Albania : An Analysis of PISA 2000-2012 Results(Washington, DC, 2012)Albanian students improved their performance on PIS A1 reading, math, and science assessments between 2000 and 2012, a period over which access to upper secondary education expanded dramatically. The improvements are equivalent to a quarter to half a year of schooling in math and science and more than one year of schooling in reading. The improvements were realized despite substantial increases in enrollment and the attendant changes in the PISA sample composition. The gross enrollment rate in upper secondary education was only about 40 percent in 2000, but increased markedly to 72 percent in 2009 and 83 percent in 2012. A spike in enrollment usually results in lower average student performance due to the inclusion of poorer and traditionally excluded students. In the context of a rapidly expanding education system, it is remarkable that Albania managed to improve its average PISA scores. It is even more notable that the improvement came from significant advancements made by low-achieving students. Albania s improved PIS A scores coincide with the launch of intensive reform efforts in its education sector. The Government of Albania initiated the education sector strategy formulation process in 2002, which resulted in the 2004 passage of the National Education Strategy (NES) and the first attempt to develop a long-term roadmap for the sector. The NES served as the catalyst for a range of reforms, including: improved teacher recruitment, compensation, and management; a revised curriculum for basic and general upper secondary education; enhanced transparency and accountability through reform of the Matura, the national student assessment; reduced price and improved textbook quality through a reformed procurement process; and provision of textbook subsidies to the poorest households. While it is beyond the scope of this report to determine a causal relationship between the range of policy reforms and improved PISA scores, this report shows that socioeconomic variables played an important role. Explanatory analyses show that the effect of education variables cannot be disentangled from the effect of socioeconomic variables. Furthermore, with economic growth averaging 4.9 percent per year from 2000-2012, a viable explanation is that the general improvement in economic conditions helped to raise the tide on all social indicators, including PISA performance.Publication Inside Indonesia's Mathematics Classrooms : A TIMSS Video Study of Teaching Practices and Student Achievement(World Bank, 2010-10-01)The following report is the first of a two-stage video study to examine teaching practices and activities in Indonesian classrooms. The first stage is linked to results of the 2007 Trends in International Mathematics and Science Study (TIMSS) where 100 of the 150 classes that participated in the TIMSS examination also participated in this additional video study component. The second stage will also involve 100 classes that will participate in the 2011 exam. The second phase will follow the same methodology, allowing for comparison across years, but will also involve more in-depth analysis of the links between teaching practices and student outcomes and how teaching practices are influenced by teachers' belief systems and subject content knowledge. Indonesia has been a committed participant in the TIMSS, Program for International Student Assessment (PISA) and the Progress in International Reading Literacy Study (PIRLS) international standardized student examinations for many years and is one of the few non-OECD (Organization for Economic Cooperation and Development) countries to participate so fully. Indonesian student performance in these examinations has been relatively low, even when taking socio-economic levels into account. For example, for mathematics Indonesia ranked 36th out of 48 participating countries in TIMSS 2007, and its score of 397 was more than one standard deviation below the international average (Mullis et al, 2008). The results have been useful in providing an indication of Indonesia's relative standing in student achievement and its progress over time, but the real challenge is to take the next step and translate the results into an understanding of the factors leading to the test scores and what might be done to enhance student achievement in Indonesia.
Users also downloaded
Showing related downloaded files
Publication Ghana Access to Finance(World Bank, Washington, DC, 2016-10)Ghana has low levels of financial inclusion of individuals and access to finance for firms remains a major challenge; some of the key issues include low ownership and usage of accounts, dominance of cash, limited access points, limited electronic and mobile transactions, and high collateral, overall limiting outreach. Financial inclusion figures fare well compared to the Sub- Saharan Africa region, but in absolute terms only 40.5 percent of adults have an account at formal financial institution. Ownership and usage of electronic payment instruments is very low and the majority of transactions are conducted in cash. Mobile banking in Ghana is at a nascent stage with only 13 percent of adults having a mobile account and the number of mobile phone-based financial transactions is incipient. While majority of small and medium firms have access to formal accounts, large majority of them relies on internal finance for investments, with only around 23 percent having a bank loan or line of credit. Private sector credit to GDP is low at about 19 percent in 2014. Ghana’s limited infrastructure restricts access to both formal and unregulated financial institution, particularly in rural areas, with limited number of branches and ATM networks. Finally, high collateral requirements of over 200 percent of the loan amount for all-sized firms and over 250 percent for small firms, with real property as the most frequent type of collateral required, makes access to formal finance virtually prohibitive for many firms. The Access to Finance Note for Ghana identifies key issues and recommendations to enhance access to formal financial services for firms and to promote financial inclusion of individuals. The note provides a status of financial inclusion and access to finance in Ghana, along with a review of banking and microfinance sectors, including decomposition of interest rate spreads based on available data, leasing sector, as well as key financial infrastructure issues related to credit reporting, secured transactions, and payment system. Further, this note complements a collection of analytical work related to access to finance agenda, including notes on the microfinance sector, private equity and venture capital, diagnostic review of financial consumer protection, and a study on development finance, all providing more details on these topics.Publication Europe and Central Asia Economic Update, Fall 2024: Better Education for Stronger Growth(Washington, DC: World Bank, 2024-10-17)Economic growth in Europe and Central Asia (ECA) is likely to moderate from 3.5 percent in 2023 to 3.3 percent this year. This is significantly weaker than the 4.1 percent average growth in 2000-19. Growth this year is driven by expansionary fiscal policies and strong private consumption. External demand is less favorable because of weak economic expansion in major trading partners, like the European Union. Growth is likely to slow further in 2025, mostly because of the easing of expansion in the Russian Federation and Turkiye. This Europe and Central Asia Economic Update calls for a major overhaul of education systems across the region, particularly higher education, to unleash the talent needed to reinvigorate growth and boost convergence with high-income countries. Universities in the region suffer from poor management, outdated curricula, and inadequate funding and infrastructure. A mismatch between graduates' skills and the skills employers are seeking leads to wasted potential and contributes to the region's brain drain. Reversing the decline in the quality of education will require prioritizing improvements in teacher training, updated curricula, and investment in educational infrastructure. In higher education, reforms are needed to consolidate university systems, integrate them with research centers, and provide reskilling opportunities for adult workers.Publication Child Marriage and Faith Affiliation in Sub-Saharan Africa(Taylor and Francis, 2015-10-23)This article has two main objectives. First, it provides an account of trends in child marriage in Africa and a brief analysis of the statistical association between child marriage and faith affiliation. Second, it cautions against broad generalizations about child marriage and faith affiliation, in order to show that beyond stylized facts derived from household survey data, there is also substantial heterogeneity within the adherents of any particular faith as to how the practice of child marriage is considered. The analysis focuses on Islamic communities.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication GovTech Maturity Index, 2022 Update(Washington, DC, 2022-12)The 2021 GovTech Maturity Index (GTMI) report and underlying dataset provide opportunities to replicate the study, identify gaps in digital transformation by comparing the differences among economies and groups of economies, and track changes over time in a transparent way. The dataset will be updated every two years to reflect developments in the GovTech domain. This 2022 GTMI update report and the accompanying dataset and new data dashboard present the progress within the last two years, highlight some of the good practices, and identify existing gaps for possible improvements in countries at the technology frontier. As with the 2020 edition, economies are grouped, not ranked, to illustrate the state of GovTech focus areas globally. This overview report presents a summary of the approach, how the 2022 GTMI dataset update is different, improvements in the GTMI dataset contents and visualization tools and GTMI group calculations, and initial findings and key messages.