Publication: Bulgaria: Piloting Statistical Models for Estimation of Schools’ Value-Added Using the Results from the National Assessments
Loading...
Files in English
219 downloads
23 downloads
167 downloads
Date
2015-03
ISSN
Published
2015-03
Editor(s)
Abstract
The objective of this report is to document the process and summarize the results from the second phase of the pilot implementation of statistical models for measuring the value-added of Bulgarian schools through analysis of the national student’ assessments results. This report presents the technical aspects of the pilot and the key outcomes in terms of value-added measure for each of the schools included in the analysis. It is intended to ensure the institutional memory for the pilots and to stimulate the discussions at technical level among experts and decision makers at the Ministry of Education and Science (MES), focusing on the relevance and applicability of the piloted statistical models, in the context of Bulgaria student assessment framework, and given the available data. The report documents all the data processing, adjustments, and procedures run as part of the school value added modeling.
Link to Data Set
Citation
“Danchev, Plamen; Bankov, Kiril; Stoimenova, Vessela; Atanasov, Dimitar. 2015. Bulgaria: Piloting Statistical Models for Estimation of Schools’ Value-Added Using the Results from the National Assessments. © World Bank. http://hdl.handle.net/10986/24456 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Pilot Implementation of Statistical Models for Estimation of the Value-Added of Bulgarian Schools Using National Student Assessment Data(World Bank, Washington, DC, 2013-06)The objective of this report is to describe the process and summarize the results from the pilot implementation of statistical models for measuring the value-added of Bulgarian schools through analysis of the national student’ assessments results. This report presents the technical aspects of the pilot and the key outcomes in terms of value-added measure for each of the schools included in the analysis. The report documents all data processing, adjustments, and procedures run as part of the school value added modeling and in this respect, it is also intended expert statisticians and researchers. The national student assessment results in Bulgaria are reported on a non-transformed raw point scale accompanied by a table that allows a transformation of the raw points to the six-grade rating scale, adopted for measuring students’ performance. Based on this, each school receives an average score and some means of comparison with other schools in the country. Analyzing the test results through value-added analysis is a new approach for the country and the findings from this pilot are intended to inform policy makers in Bulgaria about the advantages and limitations of value-added measures (VAMs) in the context of the Bulgarian education system, its student assessment framework, and the data collected and used by the education management information system.Publication The Impact of the 1999 Education Reform in Poland(2010-04-01)Increasing the share of vocational secondary schooling has been a mainstay of development policy for decades, perhaps nowhere more so than in formerly socialist countries. The transition, however, led to significant restructuring of school systems, including a declining share of vocational students. Exposing more students to a general curriculum could improve academic abilities. This paper analyzes Poland s significant improvement in international achievement tests and the restructuring of the education system that expanded general schooling to test the hypothesis that delayed vocational streaming improves outcomes. Using propensity score matching and differences-in-differences estimates, the authors show that delayed vocationalization had a positive and significant impact on student performance on the order of one standard deviation.Publication Decentralized Service Delivery for the Poor : Volume 2, Background Papers(Washington, DC, 2006-08)This report on the decentralized service delivery for the poor is structured in two volumes. Volume one is a cross-sectoral report, the core report. The first part includes the program and performance overview which describes the programs (including their poverty goals) and their process of decentralization, the overview of expenditures, the access of the poor to these services, and the evidence on the quality of services. The second part of the core report is on the institutional dimensions of decentralized service delivery which includes the World Development Report (WDR) 2004-type framework of accountability, adapted to the situation in Mexico. Volume two contains the sectoral pieces. For this report-the third phase of a programmatic series of studies on poverty in Mexico-Mexico's social cabinet requested that the Bank analyze service delivery of a specific list of programs that are essential to the government's development strategy in the context of decentralization. The elements of the government's strategy considered here-basic education, health care for the population without social security coverage, local social infrastructure, and local rural development-all aim directly or indirectly to reduce poverty. Both social and economic services shape the opportunities of poor people. Social services contribute to human capital formation and risk management, while economic services shape access to markets. The analysis presented in this report does not pretend to be exhaustive of decentralized service delivery for the poor. Important areas for future research include the following: (i) analysis of the compliance of the law or of the detail regulations in programs; (ii) systematic comparisons of state interventions in the sectors analyzed in this report; (iii) analysis of the implications and requirements to implement per capita funding in health and education, and freedom to choose providers; and (iv) systematic compilation of information at the state and municipal level on the performance of the programs.Publication Education Quality and Opportunities for Skills Development in Albania : An Analysis of PISA 2000-2012 Results(Washington, DC, 2012)Albanian students improved their performance on PIS A1 reading, math, and science assessments between 2000 and 2012, a period over which access to upper secondary education expanded dramatically. The improvements are equivalent to a quarter to half a year of schooling in math and science and more than one year of schooling in reading. The improvements were realized despite substantial increases in enrollment and the attendant changes in the PISA sample composition. The gross enrollment rate in upper secondary education was only about 40 percent in 2000, but increased markedly to 72 percent in 2009 and 83 percent in 2012. A spike in enrollment usually results in lower average student performance due to the inclusion of poorer and traditionally excluded students. In the context of a rapidly expanding education system, it is remarkable that Albania managed to improve its average PISA scores. It is even more notable that the improvement came from significant advancements made by low-achieving students. Albania s improved PIS A scores coincide with the launch of intensive reform efforts in its education sector. The Government of Albania initiated the education sector strategy formulation process in 2002, which resulted in the 2004 passage of the National Education Strategy (NES) and the first attempt to develop a long-term roadmap for the sector. The NES served as the catalyst for a range of reforms, including: improved teacher recruitment, compensation, and management; a revised curriculum for basic and general upper secondary education; enhanced transparency and accountability through reform of the Matura, the national student assessment; reduced price and improved textbook quality through a reformed procurement process; and provision of textbook subsidies to the poorest households. While it is beyond the scope of this report to determine a causal relationship between the range of policy reforms and improved PISA scores, this report shows that socioeconomic variables played an important role. Explanatory analyses show that the effect of education variables cannot be disentangled from the effect of socioeconomic variables. Furthermore, with economic growth averaging 4.9 percent per year from 2000-2012, a viable explanation is that the general improvement in economic conditions helped to raise the tide on all social indicators, including PISA performance.Publication A Review of the Bulgaria School Autonomy Reforms(Washington, DC, 2010-06-25)The sweeping decentralization reform of the education system introduced by the Government in 2007 to promote greater school autonomy and more efficient spending produced impressive efficiency gains and set the foundation for better adjustment to local needs. Despite initial successes, lingering concerns remain about the accountability of schools to the local community. Thus, as a part of a continued engagement with the Government of Bulgaria, this study records the achievements of the reforms and highlights outstanding challenges. Its aim is to assess progress in the functioning of the model of delegated financing and governance in the education sector. The study aims to identify where the model could be strengthened to further improve the achievement of the objectives of the reform. The study focuses on four questions: (1) To what extent are the reforms leading to a more efficient system? (2) Is there any evidence that the quality of education had been impacted by these reforms? (3) What is the equity impact of the school closures? (4) How are accountability mechanisms affecting the role of the major stakeholders?
Users also downloaded
Showing related downloaded files
Publication Remarks to the Annual Meetings 2020 Development Committee(World Bank, Washington, DC, 2020-10-16)David Malpass, President of the World Bank Group, announced that the Board approved a fast track approach to emergency health support programs that now covers 111 countries. Most projects are well advanced, with average disbursement upward of 40 percent. The goal is to take broad, fast action early. The operational framework presented back in June has positioned the Bank to help countries address immediate health threats and social and economic impacts and maintain our focus on long-term development. The Bank is making good progress toward the 15-month target of 160 billion dollars in surge financing. Much of it is for the poorest countries and will take the form of grants or low-rate, long-maturity loans. IFC, through the Global Health Platform, will be providing financing to vaccine manufacturers to foster expanded production of COVID-19 vaccines in both part 1 and 2 countries, providing production is reserved for emerging markets. The Development Committee holds a unique place in the international architecture. It is the only global forum in which the Governments of developed countries and the Governments of developing countries, creditor countries and borrower countries, come together to discuss development and the ‘net transfer of resources to developing countries.’ The current International Financial Architecture system is skewed in favor of the rich and creditor countries. It is important that all voices are heard, so Malpass urged the Ministers of developing countries to use their voice and speak their minds today. Malpass urged consideration of how we can build a new approach to debt restructuring that allows for a fair relationship and balance between creditors and debtors. This will be critical in restoring growth in developing countries; and helping reverse the inequality.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication World Development Report 2011(World Bank, 2011)The 2011 World development report looks across disciplines and experiences drawn from around the world to offer some ideas and practical recommendations on how to move beyond conflict and fragility and secure development. The key messages are important for all countries-low, middle, and high income-as well as for regional and global institutions: first, institutional legitimacy is the key to stability. When state institutions do not adequately protect citizens, guard against corruption, or provide access to justice; when markets do not provide job opportunities; or when communities have lost social cohesion-the likelihood of violent conflict increases. Second, investing in citizen security, justice, and jobs is essential to reducing violence. But there are major structural gaps in our collective capabilities to support these areas. Third, confronting this challenge effectively means that institutions need to change. International agencies and partners from other countries must adapt procedures so they can respond with agility and speed, a longer-term perspective, and greater staying power. Fourth, need to adopt a layered approach. Some problems can be addressed at the country level, but others need to be addressed at a regional level, such as developing markets that integrate insecure areas and pooling resources for building capacity Fifth, in adopting these approaches, need to be aware that the global landscape is changing. Regional institutions and middle income countries are playing a larger role. This means should pay more attention to south-south and south-north exchanges, and to the recent transition experiences of middle income countries.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.