Publication: Does Information Improve School Accountability? Results of a Large Randomized Trial
Loading...
Date
2011-12
ISSN
Published
2011-12
Author(s)
Editor(s)
Abstract
This study evaluates a community-based randomized controlled trial (RCT) to determine the impact of an information campaign on learning and other school outcomes. The study was conducted in three Indian states, Uttar Pradesh (UP), Madhya Pradesh (MP), and Karnataka. UP and MP are two large north and central Indian states, respectively, and lag behind in economic and social outcomes, while Karnataka in southern India is economically and socially more developed. Even though all three states have devolved oversight roles to the community with respect to government schools, they differ in the extent to which such devolution has taken place. The information campaign disseminated state specific information to the community on its oversight roles in schools and education services that parents are entitled to. Information was disseminated in 11-14 public meetings in each treatment village over a period of two and a half years.
Link to Data Set
Citation
“Pandey, Priyanka; Goyal, Sangeeta; Sundararaman, Venkatesh. 2011. Does Information Improve School Accountability? Results of a Large Randomized Trial. South Asia human development sector;discussion paper series no. 49. © http://hdl.handle.net/10986/18012 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Community Participation in Public Schools : The Impact of Information Campaigns in Three Indian States(World Bank, Washington, DC, 2008-11)This study evaluates the impact of a community-based information campaign on school performance from a cluster randomized control trial. The campaign consisted of eight to nine public meetings in each of 340 treatment villages across three Indian states to disseminate information to the community about its state mandated roles and responsibilities in school management. The findings from the first follow-up 2-4 months after the campaign show that providing information through a structured campaign to communities had a positive impact in all three states. In two states there was a significant and positive impact on reading (14-27 percent) in one of the three grades tested; in the third state there was a significant impact on writing in one grade (15 percent) and on mathematics in the other grade tested (27 percent). The intervention is associated with improvement in teacher effort in two states. Some improvements occurred in the delivery of certain benefits entitled to students (stipend, uniform, and mid day meal) and in process variables such as community participation in each of the three states. Follow-up research needs to examine whether there is a systematic increase in learning when the impact is measured over a longer time period and whether a campaign sustained over a longer time is able to generate greater impact on school outcomes.Publication Public Participation, Teacher Accountability, and School Outcomes : Findings from Baseline Surveys in Three Indian States(World Bank, Washington, DC, 2008-11)This paper presents findings from baseline surveys on student learning achievement, teacher effort and community participation in three Indian states, Karnataka, Madhya Pradesh and Uttar Pradesh. Results indicate low teacher attendance and poor student learning. Parents and school committees are neither aware of their oversight roles nor participating in school management. However, there is substantial heterogeneity in outcomes across states. Karnataka has better student and teacher outcomes as well as higher levels of community awareness and participation than the other two states. The authors find substantial variation in teacher effort within schools, but most observable teacher characteristics are not associated with teacher effort. One reason for low teacher effort may be lack of accountability. Regression analysis suggests low rates of teacher attendance are only part of the problem of low student achievement. The gains in test scores associated with higher rates of attendance and engagement in teaching are small in the states of Madhya Pradesh and Uttar Pradesh, suggesting teachers themselves may not be effective. Ineffective teaching may result from lack of accountability as well as poor professional development of teachers. Further research is needed to examine not only issues of accountability but also professional development of teachers.Publication Contract Teachers(World Bank, Washington, DC, 2009-11)In this paper authors use non-experimental data from government schools in Uttar Pradesh and Madhya Pradesh, two of the largest Indian states, to present average school outcomes by contract status of teachers. The authors find that after controlling for teacher characteristics and school fixed effects, contract teachers are associated with higher effort than civil service teachers with permanent tenures. Higher teacher effort is associated with better student performance after controlling for other school inputs and student characteristics. Given that salaries earned by contract teachers are one fourth or less of civil service teachers, contract teachers may be a more cost-effective resource. However, contracts 'as they are' appear weak. Not only do contract teachers have fairly low average effort in absolute terms, but those who have been on the job for at least one full tenure have lower effort than others who are in the first contract period.Publication How Much and What Kind of Teaching Is There in Elementary Education in India? Evidence from Three States(World Bank, Washington, DC, 2014-02)This study focuses on the link between teachers' 'time-on-task' (TOT) and the nature of tasks in classrooms. This study, carried out with concurrence from Ministry of Human Resource Development (MHRD), is built upon the independent study commissioned by MHRD to explore teacher attendance rates in schools. This study ventures beyond the quantitative dimensions of teacher attendance (physical presence) to look at the 'time-on-task' (TOT) and nature of tasks, that is, the quantity and quality of teacher presence and interaction. Most specifically, it will provide insight into the work environment of teachers who are the key to service delivery and suggest implications for both policy and program interventions to empower teachers and introduce more accountability into the system. The McKinsey and Company study (Barber & Mourshed, 2007) identified three things that matter most: (1) getting the right people to become teachers; (2) developing them into effective instructors; and (3) ensuring that the system is able to deliver the best possible instruction for every child. In the present study, the attempt is to see whether the teachers are 'effective instructors' and the system is delivering the best to its children. The study aims to find out the factors that facilitate improved quality of instructional time on the one hand, and what it means to the whole process of improving learning levels on the other. In addition, there is an effort to understand the characteristics of various enabling inputsPublication Learning Levels and Gaps in Pakistan(World Bank, Washington, DC, 2006-11)The authors report on a survey of primary public and private schools in rural Pakistan with a focus on student achievement as measured through test scores. Absolute learning is low compared with curricular standards and international norms. Tested at the end of the third grade, a bare majority had mastered the K-I mathematics curriculum and 31 percent could correctly form a sentence with the word "school" in the vernacular (Urdu). As in high-income countries, bivariate comparisons show that higher learning is associated with household wealth and parental literacy. In sharp contrast to high-income countries, these gaps decrease dramatically in a multivariate regression once differences between children in the same school are looked at. Consequently, the largest gaps are between schools. The gap in English test scores between government and private schools, for instance, is 12 times the gap between children from rich and poor families. To contextualize these results within a broader South Asian context, the authors use data from public schools in the state of Uttar Pradesh in India. Levels of learning and the structure of the educational gaps are similar in the two samples. As in Pakistan, absolute learning is low and the largest gaps are between schools: the gap between good and bad government schools, for instance, is 5 times the gap between children with literate and illiterate mothers.
Users also downloaded
Showing related downloaded files
Publication Guide to the Debt Management Performance Assessment Tool(Washington, DC, 2008-02-05)The purpose of this document is to provide guidance and supplemental information to assist with country assessments of debt management performance, using the Debt Management Performance Assessment (DeMPA) tool. The DeMPA is a methodology used for assessing public debt management performance through a comprehensive set of 15 performance indicators spanning the full range of government Debt Management (DeM) functions. It is based on the principles set out in the International Monetary Fund (IMF) and World Bank guidelines for public debt management, initially published in 2001 and updated in 2003. It is modeled after the Public Expenditure and Financial Accountability (PEFA) framework for performance measurement of public financial management. The DeMPA has been designed to be a user-friendly tool to undertake an assessment of the strengths and weaknesses in government DeM practices. This guide provides additional background and supporting information so that a no specialist in the area of debt management may undertake a country assessment effectively. The guide can be used by assessors in preparing for and undertaking an assessment. It is particularly useful for understanding the rationale for the inclusion of the indicators, the scoring methodology, and the list of supporting documents or evidence required, and the questions that could be asked for the assessment.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Crime and Violence in Central America : A Development Challenge - Main Report(World Bank, 2011-01-01)Crime and violence are now a key development issue for Central American countries. In three nations El Salvador, Guatemala, and Honduras crime rates are among the top five in Latin America. This report argues that successful strategies require actions along multiple fronts, combining prevention and criminal justice reform, together with regional approaches in the areas of drug trafficking and firearms. It also argues that interventions should be evidence based, starting with a clear understanding of the risk factors involved and ending with a careful evaluation of how any planned action might affect future options. In addition, the design of national crime reduction plans and the establishment of national cross-sectoral crime commissions are important steps to coordinate the actions of different government branches, ease cross-sectoral collaboration and prioritize resource allocation. Of equal importance is the fact that national plans offer a vehicle for the involvement of civil society organizations, in which much of the expertise in violence prevention and rehabilitation resides. Prevention efforts need to be complemented by effective law enforcement. The required reforms are no longer primarily legislative in nature because all six countries have advanced toward more transparent adversarial criminal procedures. The second-generation reforms should instead help deliver on the promises of previous reforms by: (i) strengthening key institutions and improving the quality and timeliness of the services they provide to citizens; (ii) improving efficiency and effectiveness while respecting due process and human rights; (iii) ensuring accountability and addressing corruption; (iv) increasing inter-agency collaboration; and (v) improving access to justice, especially for poor and disenfranchised groups. Specific interventions reviewed in the report include: information systems and performance indicators as a prerequisite to improve inter-institutional coordination and information sharing mechanisms; an internal overhaul of court administration and case management to create rapid reaction, one-stop shops; the strengthening of entities that provide legal counseling to the poor and to women; and the promotion of alternative dispute-resolution mechanisms and the implementation of community policing programs.Publication The Mexican Social Protection System in Health(World Bank, Washington DC, 2013-01)With a population of 113 million and a per-capita Gross Domestic Product, or GDP of US$10,064 (current U.S. dollars), Mexico is one of the largest and highest-income countries in Latin America and the Caribbean (LAC). The country has benefited from sustained economic growth during the last decade, which was temporarily interrupted by the financial and economic crisis. Real GDP is projected to grow 3.8 percent and 3.6 percent in 2012 and 2013, respectively (International Monetary Fund, or IMF 2012). Despite this growth, poverty in the country remains high; with half of the population living below the national poverty line. The country is also highly heterogeneous, with large socioeconomic differences across states and across urban and rural areas. In 2010, while the extreme poverty ratio in the Federal District and the states of Colima and Nuevo Leon was below 3 percent, in Chiapas, Guerrero, and Oaxaca it was 25 percent or higher. These large regional differences are also found in other indicators of well-being, such as years of schooling, housing conditions, and access to social services. This case study assesses key features and achievements of the Social Protection System in Health (Sistema de Proteccion Social en Salud) in Mexico, and particularly of its main pillar, Popular Health Insurance (Seguro Popular, PHI). It analyzes the contribution of this policy to the establishment and implementation of universal health coverage in Mexico. In 2003, with the reform of the General Health Law, the PHI was institutionalized as a subsidized health insurance scheme open to the population not covered by the social security schemes. Today, the PHI covers all of its intended affiliates, about 52 million peoplePublication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.