Publication: Measuring Beginner Reading Skills : An Empirical Evaluation of Alternative Instruments and their Potential Use for Policymaking and Accountability in Peru
Loading...
Date
2009-01-01
ISSN
Published
2009-01-01
Author(s)
Editor(s)
Abstract
Based on analysis of reading performance data from 475 third-graders in Peru, this study makes recommendations on improving reading tests, choice of reading standards, and how to present the results at the school and individual levels. The paper reviews the literature on using reading skills measurement in the early grades to guide policymaking, strengthen accountability, and improve education quality. It uses data generated from the same students using two common approaches to measuring reading skills: an individually-administered oral fluency test, and a group-administered written comprehension test designed by the Ministry of Education for the 2006 universal standard test of second grade reading comprehension. These two approaches have sometimes been presented as competing alternatives, but the paper shows that it is better if they are used together, as complements. Based on psychometric analysis, the paper shows that both the oral and written tests adequately measured students' reading abilities. The results show that reading fluency and comprehension are correlated: fluent readers are more likely to understand what they read than non-fluent readers. The strength of the fluency-comprehension relationship depends on the level of fluency, the difficulty of the questions, and social characteristics of the school. The paper recommends using improved versions of both tests to evaluate early grade reading skills, as a central element of a system of accountability for results. It proposes a model for reporting test results desgned to highlight the importance of reading standards, mobilize the education community to reach them, track progress, and identify students in need of extra support.
Link to Data Set
Citation
“Kudo, Ines; Bazan, Jorge. 2009. Measuring Beginner Reading Skills : An Empirical Evaluation of Alternative Instruments and their Potential Use for Policymaking and Accountability in Peru. Policy Research working paper ; no. WPS 4812. © World Bank. http://hdl.handle.net/10986/4010 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication From Tailwinds to Headwinds(Washington, DC: World Bank, 2025-07-10)The first quarter of the twenty-first century has been transformative for emerging market and developing economies (EMDEs). These economies now account for about 45 percent of global GDP, up from about 25 percent in 2000, a trend driven by robust collective growth in the three largest EMDEs—China, India, and Brazil (the EM3). Collectively, EMDEs have contributed about 60 percent of annual global growth since 2000, on average, double the share during the 1990s. Their ascendance was powered by swift global trade and financial integration, especially during the first decade of the century. Interdependence among these economies has also increased markedly. Today, nearly half of goods exports from EMDEs go to other EMDEs, compared to one-quarter in 2000. As cross-border linkages have strengthened, business cycles among EMDEs and between EMDEs and advanced economies have become more synchronized, and a distinct EMDE business cycle has emerged. Cross-border business cycle spillovers from the EM3 to other EMDEs are sizable, at about half of the magnitude of spillovers from the largest advanced economies (the United States, the euro area, and Japan). Yet EMDEs confront a host of headwinds at the turn of the second quarter of the century. Progress implementing structural reforms in many of these economies has stalled. Globally, protectionist measures and geopolitical fragmentation have risen sharply. High debt burdens, demographic shifts, and the rising costs of climate change weigh on economic prospects. A successful policy approach to accelerate growth and development should focus on boosting investment and productivity, navigating a difficult external environment, and enhancing macroeconomic stability.Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Building Evidence, Shaping Policy(World Bank, Dili, 2013-08)Reliable evidence is needed to design policies that will allow overcoming Timor-Leste's remaining challenges in provision of quality education. In recent post-conflict years, aided by availability of oil revenues, Timor-Leste has been able to considerably improve availability of schools and access to education. This report presents findings of the 2012 Education Survey, collaboration between the Ministry of Education, the National Directorate of Statistics, AusAID and the World Bank. The survey collected detailed information at all primary, pre-secondary and secondary schools in the country. Its objectives were to support the improvement of Timor-Leste's education quality and service delivery through building a solid information source and analytical foundation which will allow for sound, evidence-based policy making. The survey results indicate that student absenteeism should be a major cause for concern. More than one third of grade one students were absent from school on the day of the survey, in some districts it was half or even more. Education levels of primary school teachers are low, with the majority only having secondary education. For 71 percent of primary school teachers the highest level of education is secondary school, for 6 percent it is even lower. Both demand and supply side interventions are needed to tackle the challenges faced. Some key policy areas should be: 1) improving school attendance through creating appropriate demand-side incentives; 2) enhancing teacher quality; 3) strengthening instruction language policy; 4) improving education system management; 5) improving school infrastructure and learning environment; and 6) ensuring adequate supply of textbooks.Publication Timor-Leste(Washington, DC, 2010)This report examines the status of reading acquisition in Timor-Leste's primary schools. It is written for education stakeholders and policy makers in Timor-Leste, including government officials, politicians, educators, parents, Timor-Leste's donor partners and Non Governmental Organizations (NGOs) active in the country. Because the report is aimed at those who are already familiar with the education system in Timor-Leste, it will not attempt to describe the education system, its history, or the issues, with one important exception, that policy makers and stakeholders are currently confronting. One issue in Timor-Leste, however, merits special mention in the context of this analysis. Approximately 30 percent of primary school age children in Timor-Leste are not enrolled in primary school because they never started school or have dropped out. This study assesses the reading ability only of those children who are in school. The findings show significant problems with reading acquisition for children in school. If those children who are not in school had been included in the sample, the results will be lower than those currently presented. In Timor-Leste, improving reading acquisition in the early grades is expected to lead to better learning outcomes, as well as to better access, reduced repetition and fewer drop outs.Publication Teaching Mathematics Effectively to Primary Students in Developing Countries(World Bank, Washington, DC, 2008-12-30)This paper uses research from neuroscience and the psychology of mathematics to arrive at useful recommendations for teaching mathematics at primary level to poor students in developing countries. The enrollment rates of the poorer students have improved tremendously in the last decade. And the global Net Enrollment Ratio (NER) has improved since 2001 from 83.2 percent to 90-95 percent except in Sub-Saharan Africa and South Asia. Making teaching of math and other subjects efficient for the poor in developing countries is a great challenge, particularly in south Asia and Sub-Saharan Africa. Many developing countries have explored new means of teaching math and other subjects. Mongolia changed its mathematics education, aiming to build a new set of priorities and practices, given the abandonment of earlier traditions. Similar to international trends of the time, South Africa in the 1990s extensively applied the constructivist learning philosophy which relied on exploration and discovery, with little emphasis on memorization, drill, In conformity with a belief that teachers could develop their own learning programs, there was virtual absence of a national or provincial syllabus or textbooks. Students were expected to develop their own methods for arithmetic operations, but most found it impossible to progress on their own from counting to actual calculating. This study integrates pertinent research from neuroscience and the psychology of mathematics to arrive at recommendations for curricular and efficient means of mathematics instruction particularly for developing countries and poor students at primary level. Specifically, the latest research in neuroscience, cognitive science, and discussions of national benchmarks for primary school mathematics learning, form the basis of our recommendations. These recommendations have a reasonable chance of working in the situational contexts of developing countries, with their traditions and resources.Publication Strengthening Kazakhstan's Education Systems : An Analysis of PISA 2009 and 2012(Washington, DC, 2014-12-03)Kazakhstan's Program for International Student Assessment (PISA) 2012 performance improved markedly compared to 2009, and indicated a narrowing achievement gap among students. Math and science performance improvements equivalent to more than half a year of schooling were achieved. According to the OECD, 40 points in PISA is equivalent to what students learn in one year of schooling. The improvements reduced the gap with other countries in Europe and Central Asia (ECA) by almost half. Moreover, the performance improvements of the lowest achievers in 2009 and 2012 outpaced those of their higher achieving peers at a rate that compares favorably against OECD countries. However, performance on reading improved only marginally and overall reading achievement remained low, with some groups of students actually performing worse in 2012. Kazakhstan's PISA performance places it significantly behind other countries, especially in reading. Countries with income per capita levels similar to Kazakhstan's (namely Turkey and Russia) performed significantly better in math, science, and reading. Most importantly, Kazakh reading scores still lag about one year of schooling behind the ECA average and almost two years of schooling behind OECD. Public expenditures on education are lowest in Kazakhstan compared with other PISA 2012 participating countries, which likely hampers the country's ability to ensure effective learning for all. Any increase in public spending on education will have to be aligned with careful policy reform decision making, since resources alone do not guarantee attainment of desired education outcomes.Publication Expanding Access to Early Childhood Development : Using Interactive Audio Instruction(World Bank Group, Washington, DC, 2015-02)The returns to investments in early childhood development (ECD) are manifold and can include improved school readiness, reduced drop-out rates, higher labor force productivity and greater social cohesion. Despite these high returns, enrollment in early childhood education is just 18 percent across Africa, with disproportionately high enrollment from children in urban areas and from wealthier families. Interactive Audio Instruction (IAI) is a distance learning technology that can deliver low-cost, culturally appropriate education via radio or mobile audio technology. It is a highly effective tool to reach children who can be hard to reach through conventional programs, including the rural poor and children with disabilities. IAI can also be an effective form of service delivery in unstable and conflict-affected regions.
Users also downloaded
Showing related downloaded files
Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Poverty and Shared Prosperity 2022(Washington, DC : World Bank, 2022)Poverty and Shared Prosperity 2022: Correcting Course provides the first comprehensive analysis of the pandemic’s toll on poverty in developing countries. It identifies how governments can optimize fiscal policy to help correct course. Fiscal policies offset the impact of COVID-19 on poverty in many high-income countries, but those policies offset barely one quarter of the pandemic’s impact in low-income countries and lower-middle-income countries. Improving support to households as crises continue will require reorienting protective spending away from generally regressive and inefficient subsidies and toward a direct transfer support system—a first key priority. Reorienting fiscal spending toward supporting growth is a second key priority identified by the report. Some of the highest-value public spending often pays out decades later. Amid crises, it is difficult to protect such investments, but it is essential to do so. Finally, it is not enough just to spend wisely - when additional revenue does need to be mobilized, it must be done in a way that minimizes reductions in poor people’s incomes. The report highlights how exploring underused forms of progressive taxation and increasing the efficiency of tax collection can help in this regard. Poverty and Shared Prosperity is a biennial series that reports on global trends in poverty and shared prosperity. Each report also explores a central challenge to poverty reduction and boosting shared prosperity, assessing what works well and what does not in different settings. By bringing together the latest evidence, this corporate flagship report provides a foundation for informed advocacy around ending extreme poverty and improving the lives of the poorest in every country in the world. For more information, please visit worldbank.org/poverty-and-shared-prosperity.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.