Publication: Measuring Beginner Reading Skills : An Empirical Evaluation of Alternative Instruments and their Potential Use for Policymaking and Accountability in Peru
Loading...
Published
2009-01-01
ISSN
Date
2012-03-19
Author(s)
Editor(s)
Abstract
Based on analysis of reading performance data from 475 third-graders in Peru, this study makes recommendations on improving reading tests, choice of reading standards, and how to present the results at the school and individual levels. The paper reviews the literature on using reading skills measurement in the early grades to guide policymaking, strengthen accountability, and improve education quality. It uses data generated from the same students using two common approaches to measuring reading skills: an individually-administered oral fluency test, and a group-administered written comprehension test designed by the Ministry of Education for the 2006 universal standard test of second grade reading comprehension. These two approaches have sometimes been presented as competing alternatives, but the paper shows that it is better if they are used together, as complements. Based on psychometric analysis, the paper shows that both the oral and written tests adequately measured students' reading abilities. The results show that reading fluency and comprehension are correlated: fluent readers are more likely to understand what they read than non-fluent readers. The strength of the fluency-comprehension relationship depends on the level of fluency, the difficulty of the questions, and social characteristics of the school. The paper recommends using improved versions of both tests to evaluate early grade reading skills, as a central element of a system of accountability for results. It proposes a model for reporting test results desgned to highlight the importance of reading standards, mobilize the education community to reach them, track progress, and identify students in need of extra support.
Link to Data Set
Citation
“Kudo, Ines; Bazan, Jorge. 2009. Measuring Beginner Reading Skills : An Empirical Evaluation of Alternative Instruments and their Potential Use for Policymaking and Accountability in Peru. Policy Research working paper ; no. WPS 4812. © World Bank. http://hdl.handle.net/10986/4010 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.Publication Monitoring Global Aid Flows: A Novel Approach Using Large Language Models(Washington, DC: World Bank, 2025-11-04)Effective monitoring of development aid is the foundation for assessing the alignment of flows with their intended development objectives. Existing reporting systems, such as the Organisation for Economic Co-operation and Development’s Creditor Reporting System, provide standardized classification of aid activities but have limitations when it comes to capturing new areas like climate change, digitalization, and other cross-cutting themes. This paper proposes a bottom-up, unsupervised machine learning framework that leverages textual descriptions of aid projects to generate highly granular activity clusters. Using the 2021 Creditor Reporting System data set of nearly 400,000 records, the model produces 841 clusters, which are then grouped into 80 subsectors. These clusters reveal 36 emerging aid areas not tracked in the current Creditor Reporting System taxonomy, allow unpacking of “multi-sectoral” and “sector not specified” classifications, and enable estimation of flows to new themes, including World Bank Global Challenge Programs, International Development Association–20 Special Themes, and Cross-Cutting Issues. Validation against both Creditor Reporting System benchmarks and International Development Association commitment data demonstrates robustness. This approach illustrates how machine learning and the new advances in large language models can enhance the monitoring of global aid flows and inform future improvements in aid classification and reporting. It offers a useful tool that can support more responsive and evidence-based decision-making, helping to better align resources with evolving development priorities.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The State of Global Services Trade Policies: Evidence from Recent Data(Washington, DC: World Bank, 2025-10-28)The economic environment for services trade has changed dramatically over the past 15 years, driven by rapid technological progress that has expanded the possibilities for exchanging services. How has trade policy responded to these changes? How do policy stances in a wide range of service sectors compare across economies? With its unprecedented global coverage, the Services Trade Policy Database and the associated Services Trade Restrictions Index, developed jointly by the World Bank and the World Trade Organization, help address these questions. This paper makes three principal contributions. First, it offers an in-depth discussion of the current state of services trade policies and their differences across 134 economies and 34 services subsectors. Second, the paper reveals how recent (2016–22) changes in policy stances have seen progressive liberalization by lower-income economies but stabilization or even slight policy reversals in high-income economies. This dynamic differs fundamentally from the trend that unfolded after the Great Recession over 2008–16. Third, the paper shows the implications of policy changes over the past six years on services trade costs, and it showcases how the Services Trade Policy Database’s regulatory information can inform trade negotiations, regulatory analysis, and policy making. Alongside these contributions, the paper documents updates to the Services Trade Policy Database’s economy and sector coverage and explains the latest methodological improvements made to the World Bank–World Trade Organization Services Trade Restrictions Index.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Building Evidence, Shaping Policy(World Bank, Dili, 2013-08)Reliable evidence is needed to design policies that will allow overcoming Timor-Leste's remaining challenges in provision of quality education. In recent post-conflict years, aided by availability of oil revenues, Timor-Leste has been able to considerably improve availability of schools and access to education. This report presents findings of the 2012 Education Survey, collaboration between the Ministry of Education, the National Directorate of Statistics, AusAID and the World Bank. The survey collected detailed information at all primary, pre-secondary and secondary schools in the country. Its objectives were to support the improvement of Timor-Leste's education quality and service delivery through building a solid information source and analytical foundation which will allow for sound, evidence-based policy making. The survey results indicate that student absenteeism should be a major cause for concern. More than one third of grade one students were absent from school on the day of the survey, in some districts it was half or even more. Education levels of primary school teachers are low, with the majority only having secondary education. For 71 percent of primary school teachers the highest level of education is secondary school, for 6 percent it is even lower. Both demand and supply side interventions are needed to tackle the challenges faced. Some key policy areas should be: 1) improving school attendance through creating appropriate demand-side incentives; 2) enhancing teacher quality; 3) strengthening instruction language policy; 4) improving education system management; 5) improving school infrastructure and learning environment; and 6) ensuring adequate supply of textbooks.Publication Timor-Leste(Washington, DC, 2010)This report examines the status of reading acquisition in Timor-Leste's primary schools. It is written for education stakeholders and policy makers in Timor-Leste, including government officials, politicians, educators, parents, Timor-Leste's donor partners and Non Governmental Organizations (NGOs) active in the country. Because the report is aimed at those who are already familiar with the education system in Timor-Leste, it will not attempt to describe the education system, its history, or the issues, with one important exception, that policy makers and stakeholders are currently confronting. One issue in Timor-Leste, however, merits special mention in the context of this analysis. Approximately 30 percent of primary school age children in Timor-Leste are not enrolled in primary school because they never started school or have dropped out. This study assesses the reading ability only of those children who are in school. The findings show significant problems with reading acquisition for children in school. If those children who are not in school had been included in the sample, the results will be lower than those currently presented. In Timor-Leste, improving reading acquisition in the early grades is expected to lead to better learning outcomes, as well as to better access, reduced repetition and fewer drop outs.Publication Teaching Mathematics Effectively to Primary Students in Developing Countries(World Bank, Washington, DC, 2008-12-30)This paper uses research from neuroscience and the psychology of mathematics to arrive at useful recommendations for teaching mathematics at primary level to poor students in developing countries. The enrollment rates of the poorer students have improved tremendously in the last decade. And the global Net Enrollment Ratio (NER) has improved since 2001 from 83.2 percent to 90-95 percent except in Sub-Saharan Africa and South Asia. Making teaching of math and other subjects efficient for the poor in developing countries is a great challenge, particularly in south Asia and Sub-Saharan Africa. Many developing countries have explored new means of teaching math and other subjects. Mongolia changed its mathematics education, aiming to build a new set of priorities and practices, given the abandonment of earlier traditions. Similar to international trends of the time, South Africa in the 1990s extensively applied the constructivist learning philosophy which relied on exploration and discovery, with little emphasis on memorization, drill, In conformity with a belief that teachers could develop their own learning programs, there was virtual absence of a national or provincial syllabus or textbooks. Students were expected to develop their own methods for arithmetic operations, but most found it impossible to progress on their own from counting to actual calculating. This study integrates pertinent research from neuroscience and the psychology of mathematics to arrive at recommendations for curricular and efficient means of mathematics instruction particularly for developing countries and poor students at primary level. Specifically, the latest research in neuroscience, cognitive science, and discussions of national benchmarks for primary school mathematics learning, form the basis of our recommendations. These recommendations have a reasonable chance of working in the situational contexts of developing countries, with their traditions and resources.Publication Strengthening Kazakhstan's Education Systems : An Analysis of PISA 2009 and 2012(Washington, DC, 2014-12-03)Kazakhstan's Program for International Student Assessment (PISA) 2012 performance improved markedly compared to 2009, and indicated a narrowing achievement gap among students. Math and science performance improvements equivalent to more than half a year of schooling were achieved. According to the OECD, 40 points in PISA is equivalent to what students learn in one year of schooling. The improvements reduced the gap with other countries in Europe and Central Asia (ECA) by almost half. Moreover, the performance improvements of the lowest achievers in 2009 and 2012 outpaced those of their higher achieving peers at a rate that compares favorably against OECD countries. However, performance on reading improved only marginally and overall reading achievement remained low, with some groups of students actually performing worse in 2012. Kazakhstan's PISA performance places it significantly behind other countries, especially in reading. Countries with income per capita levels similar to Kazakhstan's (namely Turkey and Russia) performed significantly better in math, science, and reading. Most importantly, Kazakh reading scores still lag about one year of schooling behind the ECA average and almost two years of schooling behind OECD. Public expenditures on education are lowest in Kazakhstan compared with other PISA 2012 participating countries, which likely hampers the country's ability to ensure effective learning for all. Any increase in public spending on education will have to be aligned with careful policy reform decision making, since resources alone do not guarantee attainment of desired education outcomes.Publication Expanding Access to Early Childhood Development : Using Interactive Audio Instruction(World Bank Group, Washington, DC, 2015-02)The returns to investments in early childhood development (ECD) are manifold and can include improved school readiness, reduced drop-out rates, higher labor force productivity and greater social cohesion. Despite these high returns, enrollment in early childhood education is just 18 percent across Africa, with disproportionately high enrollment from children in urban areas and from wealthier families. Interactive Audio Instruction (IAI) is a distance learning technology that can deliver low-cost, culturally appropriate education via radio or mobile audio technology. It is a highly effective tool to reach children who can be hard to reach through conventional programs, including the rural poor and children with disabilities. IAI can also be an effective form of service delivery in unstable and conflict-affected regions.
Users also downloaded
Showing related downloaded files
Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.