Publication: Pilot Implementation of Statistical Models for Estimation of the Value-Added of Bulgarian Schools Using National Student Assessment Data
Loading...
Published
2013-06
ISSN
Date
2016-06-09
Editor(s)
Abstract
The objective of this report is to describe the process and summarize the results from the pilot implementation of statistical models for measuring the value-added of Bulgarian schools through analysis of the national student’ assessments results. This report presents the technical aspects of the pilot and the key outcomes in terms of value-added measure for each of the schools included in the analysis. The report documents all data processing, adjustments, and procedures run as part of the school value added modeling and in this respect, it is also intended expert statisticians and researchers. The national student assessment results in Bulgaria are reported on a non-transformed raw point scale accompanied by a table that allows a transformation of the raw points to the six-grade rating scale, adopted for measuring students’ performance. Based on this, each school receives an average score and some means of comparison with other schools in the country. Analyzing the test results through value-added analysis is a new approach for the country and the findings from this pilot are intended to inform policy makers in Bulgaria about the advantages and limitations of value-added measures (VAMs) in the context of the Bulgarian education system, its student assessment framework, and the data collected and used by the education management information system.
Link to Data Set
Citation
“Danchev, Plamen; Bankov, Kiril; Stoimenova, Vessela; Atanassov, Dimitar. 2013. Pilot Implementation of Statistical Models for Estimation of the Value-Added of Bulgarian Schools Using National Student Assessment Data. © World Bank. http://hdl.handle.net/10986/24491 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Bulgaria(World Bank, Washington, DC, 2015-03)The objective of this report is to document the process and summarize the results from the second phase of the pilot implementation of statistical models for measuring the value-added of Bulgarian schools through analysis of the national student’ assessments results. This report presents the technical aspects of the pilot and the key outcomes in terms of value-added measure for each of the schools included in the analysis. It is intended to ensure the institutional memory for the pilots and to stimulate the discussions at technical level among experts and decision makers at the Ministry of Education and Science (MES), focusing on the relevance and applicability of the piloted statistical models, in the context of Bulgaria student assessment framework, and given the available data. The report documents all the data processing, adjustments, and procedures run as part of the school value added modeling.Publication Absenteeism and Beyond : Instructional Time Loss and Consequences(World Bank, Washington, DC, 2007-10)Studies have shown that learning outcomes are related to the amount of time students engage in learning tasks. However, visits to schools have revealed that students are often taught for only a fraction of the intended time, particularly in lower-income countries. Losses are due to informal school closures, teacher absenteeism, delays, early departures, and sub-optimal use of time in the classroom. A study was undertaken to develop an efficient methodology for measuring instructional time loss. Thus, instructional time use was measured in sampled schools in Tunisia, Morocco, Ghana, and the Brazilian state of Pernambuco. The percentage of time that students were engaged in learning vis-à-vis government expectations was approximately 39 percent in Ghana, 63 percent in Pernambuco, 71 percent in Morocco, and 78 percent in Tunisia. Instructional time use is a mediator variable that is challenging to measure, so it often escapes scrutiny. Research suggests that merely financing the ingredients of instruction is not enough to produce learning outcomes; students must also get sufficient time to process the information. The quantity-quality tradeoff that often accompanies large-scale enrollments may be partly due to instructional time restrictions. Time wastage also distorts budgetary outlays and teacher salary rates. To achieve the Millennium Development Goals students must get more of the time that governments, donors, and parents pay for.Publication Colombia - The Quality of Education in Colombia : An Analysis and Options for a Policy Agenda(Washington, DC, 2008-11-04)The main objective of this report is to analyze student learning in Colombia in order to foster policies to improve education quality that are grounded in research and the Colombian context. In 2006, Colombia participated for the first time in the Programme for International Student Assessment (PISA) of the Organization for Economic Cooperation and Development (OECD), which provides an important opportunity to benchmark the quality and equity of its education system globally and to inform its education policy. Using the PISA results, this report calls attention to the need for improved student learning in Colombia and provides new analytical work on the factors associated with learning in Colombia and other participant countries. Based on an assessment of the current state of the Colombian education system (chapter first), a review of the relevant literature (chapter second), an analysis of PISA (chapter third), and the report concludes with a set of policy options that may inform a future agenda for system design and reform (chapter fourth).Publication Mexico : Determinants of Learning Policy Note(Washington, DC, 2005-07)This report aims to identify the determinants of learning in Mexico, focusing on equity, cross-country comparisons and national studies. The present report provides new analytical work on the determinants of learning using international and national assessments, as well as new work on the returns to quality of education and an assessment of media coverage of international assessments. The report is organized as follows: Chapter 1 reviews the existing international and Mexican literature on education quality and the determinants of learning. Chapter 2 presents an overview of the state of education in Mexico. Chapter 3 discusses the analysis of the National Assessments (Estandures Nacionales) from 1998 to 2000 and the results of the analysis of PISA 2000 and PISA 2003 data. Finally, Chapter 4 concludes the main report with an agenda for action, which responds to the education situation in Mexico. The report's main message is that Mexico needs to increase secondary school enrollment rates. The country continues to do well at maintaining equity in terms of the impact of family background on scores and the very low dispersion between top and bottom achievers, which is unusual for a Latin American country participating in international achievement tests. To improve quality, Mexican schools need to improve the school climate and continue efforts to move decision-making from the state level education secretariats to the school level, thus increasing school autonomy. Also, accountability needs to be further strengthened by involving parents and the community more and setting clear goals and clear vision for the school system. Finally, Mexico's remarkable efforts to improve assessment of the system should continue, with continued participation in international achievement tests, as well as improvements of the national assessment system.Publication Private Education Provision and Public Finance : The Netherlands(World Bank, Washington, DC, 2010-01)One of the key features of the Dutch education system is freedom of education -- freedom to establish schools and organize teaching. Almost 70 percent of schools in the Netherlands are administered by private school boards, and all schools are government funded equally. This allows school choice. Using an instrument to identify school choice, it is shown that the Dutch system promotes academic performance. The instrumental variables results show that private school attendance is associated with higher test scores. Private school size effects in math, reading, and science achievement are 0.17, 0.28, and 0.18.
Users also downloaded
Showing related downloaded files
Publication World Development Indicators 2006(2006)The developing world has made remarkable progress. The number of people living in extreme poverty on less than $1 a day has fallen by about 400 million in the last 25 years. Many more children, particularly girls, are completing primary school. Illiteracy rates have fallen by half in 30 years. And life expectancy is nearly 15 years longer, on average, than it was 40 years ago. The demand for statistics to measure progress and demonstrate the effectiveness of development programs has stimulated growing interest in the production and dissemination of statistics. And not just in the traditional domains of debt, demographics, and national accounts, but in new areas such as biodiversity, information, communications, technology, and measures of government and business performance. In response World Development Indicators (WDI) has continued to grow and change. In 1999 members of the statistical community, recognizing that the production of sound statistics for measuring progress is a global responsibility, established the Partnership in Statistics for Development in the twenty-first century (PARIS21) to strengthen statistical capacity at all levels. In 2000 the United Nations millennium summit called on all countries to work toward a quantified, time-bound set of development targets, which became the millennium development goals (MDG). In the five years since the millennium summit, the idea of working toward specific goals has evolved into a general strategy of managing for development results. Countries are reporting on progress toward the MDG and monitoring their own results using a variety of economic and social indicators. Bilateral and multilateral development agencies are incorporating results into their own management planning and evaluation systems and using new indicators to set targets for harmonizing their joint work programs. All of these efforts depend on statistics.Publication A Review of Selected Hydrology Topics to Support Bank Operations(Washington, DC, 2010-06)The World Bank's 2004 Water Resources Sector Strategy focused on the need for both water resources management and development in dealing with growth and poverty alleviation. Planning and design of new hydraulic infrastructure for water supply and sanitation, food production, hydropower generation, flood protection, ecosystem restoration or other such purposes require dealing with all elements in the interaction among land, water, vegetation, human intervention and climate variability and change, with an emphasis on the end-user. They also require the simultaneous consideration of technical, economic, institutional (governance), political, financial, environmental and social factors, as called for in the Bank s 1993 Water Resources Management Policy. To provide high-level insight on the key hydrology issues involved, a group of world class experts gathered at a workshop held at World Bank Headquarters in November 2008. The workshop was organized by the Hydrology Expert Facility (HEF) of the Water Anchor. The presenters discussed advancements in key hydrologic topics that were selected for their relevance to Bank operations. The focus was on potential implications for the Bank s development assistance on water projects, programs and policies.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication World Development Indicators 2011(World Bank, 2011)World development indicators 2011, the 15th edition in its current format, aims to provide relevant, high-quality, internationally comparable statistics about development and the quality of people's lives around the globe. Fifteen years ago, World development indicators was overhauled and redesigned, organizing the data to present an integrated view of development, with the goal of putting these data in the hands of policymakers, development specialists, students, and the public in a way that makes the data easy to use. Although there have been small changes, the format has stood the test of time, and this edition employs the same sections as the first one: world view, people, environment, economy, states and markets, and global links. This edition focuses on the impact of the decision to make data freely available under an open license and with better online tools. To help those who wish to use and reuse the data in these new ways, the section introductions discuss key issues in measuring the economic and social phenomena described in the tables and charts and introduce new sources of data. The choice of indicators and text content was shaped through close consultation with and substantial contributions from staff in the World Bank's four thematic networks sustainable development, human development, poverty reduction and economic management, and financial and private sector development and staff of the International Finance Corporation and the Multilateral Investment Guarantee Agency.Publication World Development Report 2012(World Bank, 2012)The main message of this year's World development report: gender equality and development is that these patterns of progress and persistence in gender equality matter, both for development outcomes and policy making. They matter because gender equality is a core development objective in its own right. But greater gender equality is also smart economics, enhancing productivity and improving other development outcomes, including prospects for the next generation and for the quality of societal policies and institutions. Economic development is not enough to shrink all gender disparities-corrective policies that focus on persisting gender gaps are essential. This report points to four priority areas for policy going forward. First, reducing gender gaps in human capital-specifically those that address female mortality and education. Second, closing gender gaps in access to economic opportunities, earnings, and productivity. Third, shrinking gender differences in voice and agency within society. Fourth, limiting the reproduction of gender inequality across generations. These are all areas where higher incomes by themselves do little to reduce gender gaps, but focused policies can have a real impact. Gender equality is at the heart of development. It's the right development objective, and it's smart economic policy. The World development report 2012 can help both countries and international partners think through and integrate a focus on gender equality into development policy making and programming.