Publication: A Randomized Evaluation of a Low-Cost and Highly Scripted Teaching Method to Improve Basic Early Grade Reading Skills in Papua New Guinea
Loading...
Published
2018-05
ISSN
Date
2018-05-15
Author(s)
Editor(s)
Abstract
Early grade literacy skills are crucial for children's future education and ultimately their contribution to human capital formation and economic development. A significant challenge in development is identifying low-cost interventions to improve early literacy skills in contexts characterized by varying teacher ability and severe budget constraints. This paper evaluates the impact of Papua New Guinea's randomized Reading Booster Programme, which was conducted in Madang and Western Highlands Province in 2013 and 2014, respectively. The program provided teachers with training on a highly structured teaching method that they could apply one hour per day within the teaching time allocated to reading. Using the randomized assignment of schools into the program, the paper shows that it had a substantial impact on the reading skills targeted by the program for third grade students, ranging from 0.6 to 0.7 standard deviation. Large effects on other reading skills were found for girls but not boys. The program's cost per student was approximately US$60.
Link to Data Set
Citation
“Macdonald, Kevin; Vu, Binh Thanh. 2018. A Randomized Evaluation of a Low-Cost and Highly Scripted Teaching Method to Improve Basic Early Grade Reading Skills in Papua New Guinea. Policy Research Working Paper;No. 8427. © World Bank. http://hdl.handle.net/10986/29833 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Rigging the Scores: Corruption through Scoring Rule Manipulation in Public Procurement Auctions(Washington, DC: World Bank, 2025-12-02)Public procurement is highly susceptible to corruption, especially in developing countries. Although open auctions are widely adopted to curb it, this paper finds that corruption remains prevalent even within this procurement format. Procurement officers can collaborate with firms to manipulate scoring rules, ensuring predetermined winners, while corrupt firms submit noncompetitive bids to meet minimum bidder requirements. Using extensive data from Chinese public procurement auctions, the paper introduces model-driven statistical tools to detect such corruption, identifying a corruption rate of 65 percent. A procurement expert audit survey confirms the tools’ reliability, with a 91 percent probability that experts recognize suspicious scoring rules when flagged. Firm-level analysis reveals that local, state-owned, and less productive firms are favored in corrupt auctions. Lastly, the paper explores policy implications. Analysis of the national anti-corruption campaign since 2012 suggests that general investigations may be insufficient to address deeply ingrained corrupt practices. Using counterfactuals based on an estimated structural model, the paper shows that implementing anonymous call-for-tender evaluations could improve social welfare by 10 percent by eliminating suspicious rules and encouraging broader participation.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication Investment Policy Reforms and Foreign Direct Investment Inflows(Washington, DC: World Bank, 2025-12-01)Foreign direct investment has the potential to introduce much-needed capital and expertise in emerging and developing economies. To attract foreign direct investment, many countries have eased restrictions on foreign ownership in various sectors, reformed their institutions, and set up investment promotion agencies. Until the mid-2010s, Ethiopia remained one of the few countries that resisted this trend, with several stringent restrictions in place on foreign direct investment entry and operations in the country. This study employs a synthetic control method to examine patterns in foreign capital inflows following a series of investment policy reforms that were substantively introduced in the mid-2010s (circa 2015). The study offers evidence that investment policy reforms contributed to a significant foreign direct investment inflow in Ethiopia, compared to what would have occurred in the absence of these policies. An alternative strategy that conservatively specifies the donor country pool using an AI-assisted deep search technique changes the donor pool weighting matrix of the synthetic control method, but the estimated policy effects largely remain robust to this specification. The findings highlight the importance of targeted reforms in promoting foreign direct investment inflow in developing countries.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Intervening at Home and Then at School(World Bank, Washington, DC, 2018-12)This paper evaluates and compares two randomized interventions in Tonga, one targeting the home environment of children up to age 5 and one targeting the school environment for first and second grade students. The first intervention supports communities to set up and run playgroups that aim to improve caregiver-child interaction at home and ultimately improve children's readiness for school. Among children of mothers without high school education, being in a treatment community positively affects the school readiness literacy domains and overall score by 0.19 and 0.2 standard deviation, respectively, for girls and the literacy domains for boys by 0.17 standard deviation. The second intervention provides teachers with training, materials, and coaching to improve reading instruction practices and students’ reading ability. It increased average early grade reading scores by approximately 0.18 standard deviation per year of exposure. Two cohorts of children were potentially exposed to both interventions, providing an opportunity to compare, for the same population of children, the effects of an early childhood intervention with a school-based intervention using a common measure of learning achievement. The school readiness intervention is found to have positive effects on early grade reading scores only among children in the reading intervention’s control group; effect sizes of approximately 0.29 standard deviation were found at the end of second grade for children exposed to one year of the school readiness intervention and at the end of first grade for girls exposed to two years of the intervention.Publication Pedagogy versus School Readiness(World Bank, Washington, DC, 2017-01)Identifying cost-effective interventions to improve early literacy is vital to developing countries, given the importance of early literacy for an individual's future education outcomes and subsequent human capital formation. This paper presents the impact on early grade reading outcomes of two low-cost randomized interventions in Tonga: a reading instruction intervention and a community play-based activity intervention. The first intervention aims to improve early grade reading outcomes specifically; estimated impacts are approximately 0.3 standard deviation, although in some reading domains impacts are substantial, ranging from 0.6 to 0.7 standard deviation. The second intervention aims to improve school readiness and subsequently early grade reading outcomes, by providing communities with support to establish a community play-based activity. Using an instrumental variables approach, the play-based activity demonstrates positive impacts of around 0.2 standard deviation in many but not all reading domains. For the domains where a statistically significant impact is measured, the community play-based activity intervention is as at least as cost effective as the reading instruction intervention. The play-based activity intervention is shown to improve test scores by 0.21 to 0.47 standard deviation per US$100, depending on the reading test domain. The reading instruction intervention improves test scores by 0.08 to 0.34 standard deviation per US$100. These findings contribute further evidence on the effectiveness of reading instruction interventions, and possibly the first estimates of the impact of play group–type interventions on primary school reading outcomes.Publication Vanuatu Early Grade Reading Assessment Baseline Survey(Washington, DC, 2012)In August 2010, the Government of Vanuatu carried out early grade reading baseline assessments in English and Francophone schools with financial support from local education partners and technical assistance from the World Bank. The results of the Vanuatu Early Grade Reading Assessment (VANEGRA) are cause for concern. French language findings show that while most students develop some fundamental skills in grade levels 1, 2 and 3, by the end of grade 3, less than 1 in 4 students are able to develop fluency in reading to understand most of the text they read. The VANEGRA survey also collected data on the attributes of students, teachers and schools. Factors that were shown to be predictors of better reading performance in the early grades include: speaking French at home, owning the school textbook, having literate parents, having books at home, reading at school and at home, attending kindergarten, doing homework, and receiving help from a family member to do homework. Neither teacher experience nor in-service training showed statistical effects on student reading outcomes and two types of certification showed negative and statistically significant effects on student outcomes both in reading fluency and comprehension. VANEGRA also asked about use of seven reading instructional activities. Students who were never asked to learn the meaning of new words or practice grapheme sound correspondences showed negative and statistically significant effects. Conversely, students who were assigned reading daily in their own school time showed positive and statistically significant results. Lastly, VANEGRA asked about teacher expectations for students' reading performance. Interestingly, the fact that some teachers allowed students to consolidate some reading skills later than the median expectation was associated with better and statistically significant results. Based on the analysis presented, recommendations for improved reading instruction and greater parental involvement are presented at the end of the report.Publication Senegal : Early Grade Reading Assessment(World Bank, Washington, DC, 2008-02)In international assessments (Progress in International Reading Literacy Study - Organization for Economic Co-operation and Development [PISA-OECD] and Progress in International Reading Literacy Study International Evaluation of Educational Achievement [PIRLS-IEA]), children's reading skills are not assessed before the fourth grade. For students who are poor readers, it is often too late by this time to carry out efficient and effective remedial instruction. To be efficient remedial instruction should be conducted as early as possible. In addition, most major assessments are only composed of reading comprehension tasks and do not take into account the level of word reading fluency (including accuracy and speed) and listening comprehension. However, research suggests that reading comprehension is associated with capacity in these complementary tasks. The last two analyses indicated that in the two groups (Wolof and French), correlations between socioeconomic status and various tasks were not significant and that socioeconomic status does not contribute to variance in reading skills. This was also the case for phonemic analysis and the knowledge of letter names, although correlations between these tasks and the reading tasks were high. Correlations between the pseudo-word and word reading tasks were very high, and the ability to read pseudo-words was the only skill that explained variance in word reading (isolated or in context). Finally, correlations between reading and listening comprehension were very high, and listening comprehension was the only skill that consistently explained variance in reading comprehension.Publication Myanmar Early Grade Reading Assessment for the Yangon Region(World Bank, Bangkok, 2015-06-04)This report presents the work to adapt the EGRA to the Myanmar language and to administer it (and its questionnaires) in the Yangon region. The results of this exercise were analyzed to assess how valid and reliable this adapted tool is for the Myanmar language. Other aims of the analysis were to define core learning standards in early primary grades, and identify potential explanatory factors for differences in EGRA scores among schools. The specific information from EGRA can help guide the Ministry of Education in prioritizing future interventions that best help students improve their reading skills in early grades, as well as support the development of measurable, comparable benchmarks for students’ progress. The report is organized into six sections, including the introduction. Section two briefly reviews the reforms and goals of the education sector in Myanmar and the major challenges that helped define the research questions for the EGRA. Section three describes the most relevant education theories about learning to read in the early grades and the way these are reflected in the design of the EGRA. Section four outlines the design and implementation of the study and tools, and how they took into account the information needs of education stakeholders and the specificities of the language and education sector in Myanmar. Section five presents the methodology and results of the study for non-experts, with the methodology and statistical analyses detailed in annex five. Section six concludes with a summary of recommendations.
Users also downloaded
Showing related downloaded files
Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Lebanon Economic Monitor, Fall 2022(Washington, DC, 2022-11)The economy continues to contract, albeit at a somewhat slower pace. Public finances improved in 2021, but only because spending collapsed faster than revenue generation. Testament to the continued atrophy of Lebanon’s economy, the Lebanese Pound continues to depreciate sharply. The sharp deterioration in the currency continues to drive surging inflation, in triple digits since July 2020, impacting the poor and vulnerable the most. An unprecedented institutional vacuum will likely further delay any agreement on crisis resolution and much needed reforms; this includes prior actions as part of the April 2022 International Monetary Fund (IMF) staff-level agreement (SLA). Divergent views among key stakeholders on how to distribute the financial losses remains the main bottleneck for reaching an agreement on a comprehensive reform agenda. Lebanon needs to urgently adopt a domestic, equitable, and comprehensive solution that is predicated on: (i) addressing upfront the balance sheet impairments, (ii) restoring liquidity, and (iii) adhering to sound global practices of bail-in solutions based on a hierarchy of creditors (starting with banks’ shareholders) that protects small depositors.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.