Publication: Benchmarking Public Policy : Methodological Insights from Measurement of School Based Management
Loading...
Date
2014-06
ISSN
Published
2014-06
Author(s)
Editor(s)
Abstract
This working paper presents a benchmarking analysis of School Based Management (SBM) using empirical data from the Philippines. School based management is widely used as a policy tool in many countries that seek to improve the quality of service delivery through decentralization. School based management typically takes many years to have an impact on educational outcomes, but policy makers need to know sooner how well the policy is being implemented. The paper extends the well-known Rasch methodology from the literature on student achievement, including the Programme for International Student Assessment, to the measurement of the implementation of school based management by computing a Rasch measure of the implementation of school based management. To test whether the resulting benchmarked measure is plausible and has practical policy value, the measure is tested for correlations with standardized measures of personality and political skills of school principals, developed in the psychology and political science literatures. The paper will be useful for readers interested in studying school based management as well as those interested more generally in the methodology of benchmarking implementation of public policy where the ultimate results are subject to long implementation periods. The methodology presented in this paper can be applied to enhance the rigor of the ongoing Systems Approach for Better Education Results (SABER) exercise to benchmark educational policies in various domains. That exercise is set to become one of the flagship policy analytical tools being developed by the World Bank and partner agencies.
Link to Data Set
Citation
“Parandekar, Suhas D.. 2014. Benchmarking Public Policy : Methodological Insights from Measurement of School Based Management. Policy Research Working Paper;No. 6938. © http://hdl.handle.net/10986/18823 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Teaching Mathematics Effectively to Primary Students in Developing Countries(World Bank, Washington, DC, 2008-12-30)This paper uses research from neuroscience and the psychology of mathematics to arrive at useful recommendations for teaching mathematics at primary level to poor students in developing countries. The enrollment rates of the poorer students have improved tremendously in the last decade. And the global Net Enrollment Ratio (NER) has improved since 2001 from 83.2 percent to 90-95 percent except in Sub-Saharan Africa and South Asia. Making teaching of math and other subjects efficient for the poor in developing countries is a great challenge, particularly in south Asia and Sub-Saharan Africa. Many developing countries have explored new means of teaching math and other subjects. Mongolia changed its mathematics education, aiming to build a new set of priorities and practices, given the abandonment of earlier traditions. Similar to international trends of the time, South Africa in the 1990s extensively applied the constructivist learning philosophy which relied on exploration and discovery, with little emphasis on memorization, drill, In conformity with a belief that teachers could develop their own learning programs, there was virtual absence of a national or provincial syllabus or textbooks. Students were expected to develop their own methods for arithmetic operations, but most found it impossible to progress on their own from counting to actual calculating. This study integrates pertinent research from neuroscience and the psychology of mathematics to arrive at recommendations for curricular and efficient means of mathematics instruction particularly for developing countries and poor students at primary level. Specifically, the latest research in neuroscience, cognitive science, and discussions of national benchmarks for primary school mathematics learning, form the basis of our recommendations. These recommendations have a reasonable chance of working in the situational contexts of developing countries, with their traditions and resources.Publication Unraveling a Secret(World Bank, Washington, DC, 2016-04)This paper seeks to find an empirical explanation of Vietnam's outstanding performance on the Programme for International Student Assessment (PISA) in 2012. Only a few developing countries participate in the assessment. Those who do, with the unique exception of Vietnam, are typically clustered at the lower end of the range of the Programme for International student Assessment scores. The paper compares Vietnam's performance with that of a set of seven developing countries from the 2012 assessment's data set, using a cut-off per capita GDP (in 2010 purchasing power parity dollars) of $10,000. The seven developing countries' average performance lags Vietnam's by more than 100 points. The "Vietnam effect" is difficult to unscramble, but the paper is able to explain about half of the gap between Vietnam and the seven countries. The analysis reveals that Vietnamese students may be approaching their studies with higher diligence and discipline, their parents may have higher expectations, and the parents may be following up with teachers regarding those expectations. The teachers themselves may be working in a more disciplined environment, with tabs being kept on their own performance as teachers. Vietnam may also be benefiting from investments in pre-school education and in school infrastructure that are disproportionately higher when compared with Vietnam's per capita income level.Publication Intelligence, Personality, and Creativity : Unleashing the Power of Intelligence and Personality Traits to Build a Creative and Innovative Economy(World Bank, Washington, DC, 2014-11-04)Cognitive ability, as measured by IQ and background factors such as socioeconomic status and demographics have historically been seen as the principal determinants of a student s academic success. However, a growing body of research from psychology, education, behavioral economics and neuroscience is showing that personality traits also predict academic and work performance. This change in paradigm suggests that education systems face a more complex challenge than traditionally recognized: to work not only with the different types of intelligence possessed by students but also with their different personality traits in order to produce academic success measured by cognitive and non-cognitive skills. This paper reviews the research findings from the different literatures (psychology, education, behavioral economics, and neuroscience) that relate to these questions. Several good reviews summarize the findings on aspects of these questions, but rarely address all of the questions above. In particular, those reviews do not shed light on how education can improve both cognitive and non-cognitive skills and how such skills promote creativity and labor market outcomes. The scientific literatures on human intelligence and personality are large, but our focus is on the subset of research findings that relate intelligence and personality to academic performance. Likewise, the literature on creativity, innovation, and productivity is extensive, but our focus will be on the research findings that relate academic performance to creativity and, ultimately, to productivity in the workplace.Publication Serbia : Student Assessment(Washington, DC, 2012-01)Serbia has focused on increasing student learning outcomes by improving the quality of education in the country. An effective student assessment system is an important component to improving education quality and learning outcomes as it provides the necessary information to meet stakeholders' decision-making needs. In order to gain a better understanding of the strengths and weaknesses of its existing assessment system, Serbia decided to benchmark this system using standardized tools developed under The World Bank's Systems Approach for Better Education Results (SABER) program. SABER is an evidence-based program to help countries systematically examine and strengthen the performance of different aspects of their education systems. SABER-student assessment is a component of the SABER program that focuses specifically on benchmarking student assessment policies and systems. The goal of SABER-student assessment is to promote stronger assessment systems that contribute to improved education quality and learning for all. The importance of assessment is linked to its role in: providing information on levels of student learning and achievement in the system; monitoring trends in education quality over time; supporting educators and students with real-time information to improve teaching and learning; and holding stakeholders accountable for results. The SABER-student assessment framework is built on the available evidence base for what an effective assessment system looks like. The framework provides guidance on how countries can build more effective student assessment systems. The framework is structured around two main dimensions of assessment systems: the types/purposes of assessment activities and the quality of those activities. Assessment systems tend to be comprised of three main types of assessment activities, each of which serves a different purpose and addresses different information needs. These three main types are: classroom assessment, examinations, and large scale, system level assessments. This report focuses specifically on policies in the area of student assessment.Publication Serbia : Student Assessment(Washington, DC, 2012-01)Serbia has focused on increasing student learning outcomes by improving the quality of education in the country. An effective student assessment system is an important component to improving education quality and learning outcomes as it provides the necessary information to meet stakeholders decision-making needs. In order to gain a better understanding of the strengths and weaknesses of its existing assessment system, Serbia decided to benchmark this system using standardized tools developed under The World Bank s Systems Approach for Better Education Results (SABER) program. SABER is an evidence-based program to help countries systematically examine and strengthen the performance of different aspects of their education systems.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Poverty and Shared Prosperity 2022(Washington, DC : World Bank, 2022)Poverty and Shared Prosperity 2022: Correcting Course provides the first comprehensive analysis of the pandemic’s toll on poverty in developing countries. It identifies how governments can optimize fiscal policy to help correct course. Fiscal policies offset the impact of COVID-19 on poverty in many high-income countries, but those policies offset barely one quarter of the pandemic’s impact in low-income countries and lower-middle-income countries. Improving support to households as crises continue will require reorienting protective spending away from generally regressive and inefficient subsidies and toward a direct transfer support system—a first key priority. Reorienting fiscal spending toward supporting growth is a second key priority identified by the report. Some of the highest-value public spending often pays out decades later. Amid crises, it is difficult to protect such investments, but it is essential to do so. Finally, it is not enough just to spend wisely - when additional revenue does need to be mobilized, it must be done in a way that minimizes reductions in poor people’s incomes. The report highlights how exploring underused forms of progressive taxation and increasing the efficiency of tax collection can help in this regard. Poverty and Shared Prosperity is a biennial series that reports on global trends in poverty and shared prosperity. Each report also explores a central challenge to poverty reduction and boosting shared prosperity, assessing what works well and what does not in different settings. By bringing together the latest evidence, this corporate flagship report provides a foundation for informed advocacy around ending extreme poverty and improving the lives of the poorest in every country in the world. For more information, please visit worldbank.org/poverty-and-shared-prosperity.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.