Publication:
From Chalkboards to Chatbots: Evaluating the Impact of Generative AI on Learning Outcomes in Nigeria

Simple item page
dc.contributor.authorDe Simone, Martin
dc.contributor.authorTiberti, Federico
dc.contributor.authorBarron Rodriguez, Maria
dc.contributor.authorManolio, Federico
dc.contributor.authorMosuro, Wuraola
dc.contributor.authorDikoru, Eliot Jolomi
dc.date.accessioned2025-05-20T14:35:17Z
dc.date.available2025-05-20T14:35:17Z
dc.date.issued2025-05-20
dc.description.abstractThis study evaluates the impact of a program leveraging large language models for virtual tutoring in secondary education in Nigeria. Using a randomized controlled trial, the program deployed Microsoft Copilot (powered by GPT-4) to support first-year senior secondary students in English language learning over six weeks. The intervention demonstrated a significant improvement of 0.31 standard deviation on an assessment that included English topics aligned with the Nigerian curriculum, knowledge of artificial intelligence and digital skills. The effect on English, the main outcome of interest, was of 0.23 standard deviations. Cost-effectiveness analysis revealed substantial learning gains, equating to 1.5 to 2 years of ’business-as-usual’ schooling, situating the intervention among some of the most cost-effective programs to improve learning outcomes. An analysis of heterogeneous effects shows that while the program benefits students across the baseline ability distribution, the largest effects are for female students, and those with higher initial academic performance. The findings highlight that artificial intelligence-powered tutoring, when designed and used properly, can have transformative impacts in the education sector in low-resource settings.en
dc.identifierhttp://documents.worldbank.org/curated/en/099548105192529324
dc.identifier.urihttps://hdl.handle.net/10986/43212
dc.languageEnglish
dc.language.isoen_US
dc.publisherWashington, DC: World Bank
dc.relation.ispartofseriesPolicy Research Working Paper; 11125
dc.rightsCC BY 3.0 IGO
dc.rights.holderWorld Bank
dc.rights.urihttps://creativecommons.org/licenses/by/3.0/igo/
dc.subjectLARGE-LANGUAGE MODELS
dc.subjectADAPTIVE LEARNING
dc.subjectARTIFICIAL INTELLIGENCE
dc.subjectEDUCATION TECHNOLOGY
dc.subjectSECONDARY EDUCATION
dc.subjectTEACHING AT THE RIGHT LEVEL
dc.titleFrom Chalkboards to Chatbotsen
dc.title.subtitleEvaluating the Impact of Generative AI on Learning Outcomes in Nigeriaen
dc.typeWorking Paper
dspace.entity.typePublication
okr.date.disclosure2025-05-20
okr.date.lastmodified2025-05-19T17:05:16Zen
okr.doctypePolicy Research Working Paper
okr.doctypePublications & Research
okr.docurlhttp://documents.worldbank.org/curated/en/099548105192529324
okr.guid099548105192529324
okr.identifier.docmidIDU-c09f40d8-9ff8-42dc-b315-591157499be7
okr.identifier.doi10.1596/1813-9450-11125
okr.identifier.externaldocumentum40014259
okr.identifier.internaldocumentum40014259
okr.identifier.reportWPS11125
okr.import.id7399
okr.importedtrueen
okr.language.supporteden
okr.pdfurlhttps://documents.worldbank.org/curated/en/099548105192529324/pdf/IDU-c09f40d8-9ff8-42dc-b315-591157499be7.pdfen
okr.region.administrativeAfrica Western and Central (AFW)
okr.region.countryNigeria
okr.sectorFY17 - Other Education,FY17 - Tertiary Education,FY17 - Secondary Education,FY17 - Primary Education,FY17 - Public Administration - Education
okr.sectorEducation
okr.themeFY17 - Student Assessment,FY17 - Disease Control,FY17 - Pandemic Response,FY17 - Jobs,FY17 - Access to Education,FY17 - Climate change,FY17 - Standards, Curriculum and Textbooks,FY17 - Adaptation,FY17 - Education Governance, School-Based Management,FY17 - Labor Market Policy and Programs,FY17 - Mitigation,FY17 - Youth Employment,FY17 - Education,FY17 - Skills Development,FY17 - Teachers
okr.themeFY17 - Private Sector Development,FY17 - Human Development and Gender,FY17 - Environment and Natural Resource Management
okr.topicEducation::Education Indicators and Statistics
okr.topicSocial Protections and Labor::Work & Working Conditions
okr.topicSocial Protections and Labor::Skills Development and Labor Force Training
okr.topicScience and Technology Development::Technology Innovation
okr.unitHAWE3; HAEE1
relation.isSeriesOfPublication26e071dc-b0bf-409c-b982-df2970295c87
relation.isSeriesOfPublication.latestForDiscovery26e071dc-b0bf-409c-b982-df2970295c87
Files
Original bundle
Now showing 1 - 2 of 2
Thumbnail Image
Name:
IDU-c09f40d8-9ff8-42dc-b315-591157499be7.pdf
Size:
26.91 MB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
IDU-c09f40d8-9ff8-42dc-b315-591157499be7.txt
Size:
107.54 KB
Format:
Plain Text
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Plain Text
Description:
Download
Collections
Policy Research Working Papers