Publication: Analyzing Data from a National Assessment of Educational Achievement
Loading...
Files in English
6,028 downloads
1,373 downloads
1,232 downloads
Other Files
4,991 downloads
528 downloads
223 downloads
2,398 downloads
Published
2015-02
ISSN
Date
2015-02-12
Author(s)
Editor(s)
Abstract
This book is one of the five volumes in the National Assessments of Educational Achievement series, and provides step-by-step details on how to analyze data collected in a national assessment. Part I provides a general introduction to statistical analyses normally carried out in these large-scale assessments. These analyses cover measures of central tendency and dispersion, standard error, mean score comparisons, identifying low and high performers, correlation, introduction to regression, and charts and graphs. Part II includes item and test analysis using both classical test and item response theories. It covers analysis of pilot and final tests, treatment of missing data, differential item functioning, test dimensionality, linking national assessment results, rotated booklet designs, setting proficiency or performance levels, and scaling. An accompanying CD contains specially designed item and test analysis software (IATA), exercises and supporting data files for both parts of the volume. The five books in the series introduce key concepts in national assessments of student achievement levels, from policy issues to address when designing and carrying out assessments through test development, questionnaire design, sampling, organizing and carrying out data collection, data cleaning, statistical analysis, report writing, and using results to improve educational quality. This book will be of interest to assessment specialists of national, regional, and local educational institutions; researchers; and universities.
Link to Data Set
Citation
“Shiel, Gerry; Cartwright, Fernando. Greaney, Vincent; Kellaghan, Thomas, editors. 2015. Analyzing Data from a National Assessment of Educational Achievement. National Assessments of Educational Achievement;Vol. 4. © http://hdl.handle.net/10986/21433 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Implementing a National Assessment of Educational Achievement(World Bank, 2012-02-10)This third volume in the five-part National Assessments of Educational Achievement series, focuses on practical issues in the implementation of a national assessment. These include the representation of key educational stakeholders, required personnel and facilities, and the sequence of administrative activities in implementing an assessment. Particular attention is focused on sampling, such as defining the population to be assessed, elements of sampling theory, and the selection of schools and students to take part in an assessment. Readers are guided through the selection of a sample by working on a set of concrete tasks presented in the text, using data files in an accompanying CD. One section of Volume 3 is devoted to typical tasks involved in preparing, validating and managing data. Users are expected to develop competence in data preparation skills by carrying out the practical exercises in the CD. They are also shown how to complete important pre-analysis steps such as compute survey weights, calculate means and their sampling errors, and how to deal with non-responses and oversize and undersize schools. This volume is intended primarily for teams who are responsible for conducting national assessments and graduate students interested in technical aspects of large-scale surveys.Publication Using the Results of a National Assessment of Educational Achievement(World Bank, 2009)This book, the fifth and final volume of the National Assessments of Educational Achievement series, draws on the experiences of over forty countries that have implemented a national assessment. It considers the role of contextual factors which impinge on the use of assessment findings. The attachment of sanctions to performance on a national assessment and use of assessment results for accountability are discussed. Key components of a national assessment report are specified . Other instruments to communicate findings are described. Uses of national assessment findings for policy, management, teaching, and raising public awareness are described. A number of ways in which the use and value of national assessments could be optimized are proposed. This volume is intended primarily for teams who are responsible for conducting national assessments and policy makers responsible for the dissemination and use of national assessment results.Publication Rwanda - Education Country Status Report : Toward Quality Enhancement and Achievement of Universal Nine Year Basic Education - An Education System in Transition; A Nation in Transition(World Bank, 2011-01-01)The Republic of Rwanda is a relatively small country located in Central Africa with a population of approximately 10 million people, making it one of the more densely populated countries in the world. The current government is taking positive steps to helps the country emerge from its tragic past, and aims to promote reconciliation and unity among all Rwandese and forbids any political activity or discrimination based on race, ethnicity, or relation. The government's effort to deliver basic public services to its population, including education, also follow the spirit of inclusiveness and aims to diminish gender, socioeconomic and geographic disparities. Rwanda's development agenda is entering a new phase as it transitions from post-genocide recovery to producing a population that is regionally and globally competitive and economically and socially secure. The education sector plays a significant role in fulfilling the national agenda. This Country Status Report (CSR) takes stock of recent progress and identifies a new generation of challenges facing the education sector, particularly in the context of ongoing decentralization and the government's recent initiative to extend basic education to nine years of schooling.Publication Developing Tests and Questionnaires for a National Assessment of Educational Achievement(Washington, DC : World Bank, 2008)Developing tests and questionnaires for a national assessment of educational achievement addresses the design of two types of data collection instruments: student achievement tests and background questionnaires. Part one covers the development of an assessment framework and a test blueprint, item writing, pre testing, and final test layout. Part two delineates comparable stages and activities in the construction of background questionnaires, which are used to gather information from students, teachers, head teachers, or parents on variables that might help explain differences in student performance on the achievement test. Part three describes how to design a manual for test administration to help ensure that all students take the test under standardized conditions. The compact disc (CD) that accompanies this book offered examples of well-designed test items, questionnaire items, and administration manuals drawn from national and international assessments and is meant to showcase the variety of ways in which assessment teams have approached the design of these instruments.Publication An Expansion of a Global Data Set on Educational Quality : A Focus on Achievement in Developing Countries(World Bank, Washington, DC, 2013-07)This paper assembles a panel data set that measures cognitive achievement for 128 countries around the world from 1965 to 2010 in 5-year intervals. The data set is constructed from international achievement tests, such as the Programme for International Student Assessment and the Trends in International Mathematics and Science Study, which have become increasingly available since the late 1990s. These international assessments are linked to regional ones, such as the South and Eastern African Consortium for Monitoring of Educational Quality, the Programme d'Analyse des Systemes Educatifs de la Confemen, and the Laboratorio Latinoamericano de Evaluacion de la Calidad de la Educacion, in order to produce one of the first globally comparable data sets on student achievement. In particular, the data set is one of the first to include achievement in developing countries, including 29 African countries and 19 Latin American countries. The paper also provides a first attempt at using the data set to identify causal factors that boost achievement. The results show that key drivers of global achievement are civil rights and economic freedom across all countries, and democracy and economic freedom in a subset of African and Latin American countries.
Users also downloaded
Showing related downloaded files
Publication Great Teachers : How to Raise Student Learning in Latin America and the Caribbean(Washington, DC: World Bank, 2015)The seven million teachers of Latin America and the Caribbean (LAC) are the critical actors in the region's efforts to improve education quality and raise student learning levels, which lag far behind those of OECD countries and East Asian countries such as China. This book documents the high economic stakes around teacher quality, benchmarks the current performance of LAC's teachers, and delineates the key issues. These include low standards for entry into teacher training, poor quality training programs that are detached from the realities of the classroom, unattractive career incentives, and weak support for teachers once they are on the job. New research conducted for this report in close to 15,000 classrooms in seven different LAC countries - the largest cross-country study of this kind to date - provides a first-ever insight into how the region's teachers perform inside the classroom. It documents that the average teacher in LAC loses the equivalent of one day of instructional time per week because of inadequate preparation, excessive time on administration (taking attendance, passing out papers) and a surprisingly high share of time physically absent from the classrooms where they should be teaching. Teachers also make limited use of available learning materials, espcially those using information and communications technology (ICT), and are unable to keep the majority of their students engaged. The book sets out the three priority lines of reform needed to produce great teachers in LAC: policies to recruit better teachers; programs to groom teachers and improve their skills once they are in service; and stronger incentives to motivate teachers to perform their best throughout their career. In every area, the book distills the latest evidence from inside and outside the region to provide practical guidance to policymakers in the design of effective programs and sustainable reforms. A final chapter analyzes the politics of recent major teacher reforms in Chile, Peru, Ecuador and Mexico, chronicling the prominent role of teachers' unions and the political and communications strategies that have underpinned successful reforms.Publication Quality Early Learning(Washington, DC: World Bank, 2022-05-11)In this volume, leading researchers and implementation experts from an array of disciplines provide evidence-based, cost-effective, and actionable strategies for delivering quality early childhood education (ECE) at scale in low- and middle-income countries (LMICS).Over the past decade, neuroscientists, developmental and cognitive psychologists, economists, and education researchers have amassed evidence to inform ECE program design. Yet much of this evidence has not been readily accessible to policymakers and practitioners, and potential synergies from cross-disciplinary considerations have not been realized.Quality Early Learning: Nurturing Children’s Potential synthesizes the evidence across disciplines and charts a forward course for quality ECE. The volume includes Overview, From Evidence to Effective Policies: How to Invest in Early Childhood Education to Nurture Children’s Potential, by Magdalena Bendini, Amanda E. Devercelli, Elaine Ding, Melissa Kelly, and Adelle Pushparatnam Chapter 1, Learning in the Early Years, by Elizabeth Spelke and Kristin Shutts Chapter 2, Pedagogy and Curricula Content: Building Foundational Skills and Knowledge, by David Whitebread and Yasmin Sitabkhan Chapter 3, Building an Effective Early Childhood Education Workforce, by Nirmala Rao, Emma Pearson, Benjamin Piper, and Carrie Lau Chapter 4, Creating Early Childhood Education Environments That Promote Early Learning, by Cynthia Adlerstein and Alejandra Cortázar Chapter 5, The Role of Management, Leadership, and Monitoring in Producing Quality Learning Outcomes in Early Childhood Education, by Iram Siraj, Violeta Arancibia, and Juan Barón Chapter 6, Toward Quality Early Learning: Systems for Success, by Sharon Lynn Kagan and Caitlin M. Dermody In the volume, the authors provide the latest evidence on how young children learn most effectively and how ECE programs can foster children’s natural ability and motivation to learn. It offers guidance for policy makers on policy design and implementation including what elements of ECE to prioritize in resource- and capacity-constrained settings in LMICs.Publication World Development Report 2018(Washington, DC: World Bank, 2018)Every year, the World Bank's World Development Report takes on a topic of central importance to global development. The 2018 Report, Learning to Realize Education's Promise, is the first ever devoted entirely to education. Now is an excellent time for it: education has long been critical for human welfare, but is even more so in a time of rapid economic change. The Report explores four main themes. First, education's promise: Education is a powerful instrument for eradicating poverty and promoting shared prosperity, but fulfilling its potential requires better policies - both within and outside the education system. Second, the learning crisis: Despite gains in education access, recent learning assessments show that many young people around the world, especially from poor families, are leaving school unequipped with even the most foundational skills they need for life. At the same time, internationally comparable learning assessments show that skills in many middle-income countries lag far behind what those countries aspire to. Third, promising interventions to improve learning: Research from areas such as brain science, pedagogical innovations, or school management have identified interventions that promote learning by ensuring that learners are prepared, that teachers are skilled as well as motivated, and that other inputs support the teacher-learner relationship. Fourth, learning at scale: Achieving learning throughout an education system will require more than just scaling up effective interventions. Change requires overcoming technical and political barriers by deploying salient metrics for mobilizing actors and tracking progress, building coalitions for learning, and being adaptive when implementing programs.Publication Better Jobs and Brighter Futures(World Bank, Washington, DC, 2020-12)In this paper, the authors present the evidence on why childcare matters for building human capital, look at the current status of childcare provision worldwide, including an estimate of the global gaps in access, and present specific actions countries can take to expand access to quality, affordable childcare for all families that need it, especially the most vulnerable. This paper was originally drafted prior to the Coronavirus 2019 (COVID-19) pandemic and has been updated to include new content, taking into account the unique challenges that the COVID-19 pandemic poses for families, children, governments, and the childcare industry, as well as the importance of investing in childcare to drive countries’ economic recovery. In section one the authors make the case for why childcare matters for building human capital and how it relates to a web of diverse issues that include women’s employment, family welfare, child development, business productivity, and the overall economy. In section two, the authors present the scope of the challenge worldwide, with projections of the unmet need for quality childcare and, ultimately, the size of the market opportunity. In section three the authors suggest five policy goals that all governments should work toward to ensure affordable, quality childcare for those families that need it. In section four, the authors lay out an agenda to better leverage existing resources and cross-sectoral opportunities, support country-level processes, and expand the research agenda. Detailed annexes are included at the end of the paper, which include additional research, guidance for countries, and specific policy and country examples that may be helpful in policy dialogue. These annexes can be used as standalone resources to go into more depth on specific topics.Publication Primer on Large-Scale Assessments of Educational Achievement(Washington, DC: World Bank, 2021-04-26)To improve their education systems, countries around the world have increasingly initiated national largescale assessment programs or participated in international or regional large-scale assessment studies for the first time. Well-constructed large-scale assessments can provide credible information on student achievement levels, which, in turn, can promote better resource allocation to schools, stronger education service delivery, and improved learning outcomes. The World Bank developed this Primer on Large-Scale Assessments of Educational Achievement as a firststop resource for those wanting to understand how to design, administer, analyze, and use the results from these assessments of student achievement. The book addresses frequently asked questions from people working on large-scale assessment projects and those interested in making informed decisions about them. Each chapter introduces a stage in the assessment process and offers advice, guidelines, and country examples. This book also reports on emerging trends in large-scale assessment and provides updated information on regional and international large-scale assessment programs.