Publication: Analyzing Data from a National Assessment of Educational Achievement
Loading...
Files in English
5,978 downloads
1,364 downloads
Other Files
4,989 downloads
521 downloads
219 downloads
Date
2015-02
ISSN
Published
2015-02
Author(s)
Editor(s)
Abstract
This book is one of the five volumes in the National Assessments of Educational Achievement series, and provides step-by-step details on how to analyze data collected in a national assessment. Part I provides a general introduction to statistical analyses normally carried out in these large-scale assessments. These analyses cover measures of central tendency and dispersion, standard error, mean score comparisons, identifying low and high performers, correlation, introduction to regression, and charts and graphs. Part II includes item and test analysis using both classical test and item response theories. It covers analysis of pilot and final tests, treatment of missing data, differential item functioning, test dimensionality, linking national assessment results, rotated booklet designs, setting proficiency or performance levels, and scaling. An accompanying CD contains specially designed item and test analysis software (IATA), exercises and supporting data files for both parts of the volume. The five books in the series introduce key concepts in national assessments of student achievement levels, from policy issues to address when designing and carrying out assessments through test development, questionnaire design, sampling, organizing and carrying out data collection, data cleaning, statistical analysis, report writing, and using results to improve educational quality. This book will be of interest to assessment specialists of national, regional, and local educational institutions; researchers; and universities.
Link to Data Set
Citation
“Shiel, Gerry; Cartwright, Fernando. Greaney, Vincent; Kellaghan, Thomas, editors. 2015. Analyzing Data from a National Assessment of Educational Achievement. National Assessments of Educational Achievement;Vol. 4. © http://hdl.handle.net/10986/21433 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Implementing a National Assessment of Educational Achievement(World Bank, 2012-02-10)This third volume in the five-part National Assessments of Educational Achievement series, focuses on practical issues in the implementation of a national assessment. These include the representation of key educational stakeholders, required personnel and facilities, and the sequence of administrative activities in implementing an assessment. Particular attention is focused on sampling, such as defining the population to be assessed, elements of sampling theory, and the selection of schools and students to take part in an assessment. Readers are guided through the selection of a sample by working on a set of concrete tasks presented in the text, using data files in an accompanying CD. One section of Volume 3 is devoted to typical tasks involved in preparing, validating and managing data. Users are expected to develop competence in data preparation skills by carrying out the practical exercises in the CD. They are also shown how to complete important pre-analysis steps such as compute survey weights, calculate means and their sampling errors, and how to deal with non-responses and oversize and undersize schools. This volume is intended primarily for teams who are responsible for conducting national assessments and graduate students interested in technical aspects of large-scale surveys.Publication Using the Results of a National Assessment of Educational Achievement(World Bank, 2009)This book, the fifth and final volume of the National Assessments of Educational Achievement series, draws on the experiences of over forty countries that have implemented a national assessment. It considers the role of contextual factors which impinge on the use of assessment findings. The attachment of sanctions to performance on a national assessment and use of assessment results for accountability are discussed. Key components of a national assessment report are specified . Other instruments to communicate findings are described. Uses of national assessment findings for policy, management, teaching, and raising public awareness are described. A number of ways in which the use and value of national assessments could be optimized are proposed. This volume is intended primarily for teams who are responsible for conducting national assessments and policy makers responsible for the dissemination and use of national assessment results.Publication Rwanda - Education Country Status Report : Toward Quality Enhancement and Achievement of Universal Nine Year Basic Education - An Education System in Transition; A Nation in Transition(World Bank, 2011-01-01)The Republic of Rwanda is a relatively small country located in Central Africa with a population of approximately 10 million people, making it one of the more densely populated countries in the world. The current government is taking positive steps to helps the country emerge from its tragic past, and aims to promote reconciliation and unity among all Rwandese and forbids any political activity or discrimination based on race, ethnicity, or relation. The government's effort to deliver basic public services to its population, including education, also follow the spirit of inclusiveness and aims to diminish gender, socioeconomic and geographic disparities. Rwanda's development agenda is entering a new phase as it transitions from post-genocide recovery to producing a population that is regionally and globally competitive and economically and socially secure. The education sector plays a significant role in fulfilling the national agenda. This Country Status Report (CSR) takes stock of recent progress and identifies a new generation of challenges facing the education sector, particularly in the context of ongoing decentralization and the government's recent initiative to extend basic education to nine years of schooling.Publication Developing Tests and Questionnaires for a National Assessment of Educational Achievement(Washington, DC : World Bank, 2008)Developing tests and questionnaires for a national assessment of educational achievement addresses the design of two types of data collection instruments: student achievement tests and background questionnaires. Part one covers the development of an assessment framework and a test blueprint, item writing, pre testing, and final test layout. Part two delineates comparable stages and activities in the construction of background questionnaires, which are used to gather information from students, teachers, head teachers, or parents on variables that might help explain differences in student performance on the achievement test. Part three describes how to design a manual for test administration to help ensure that all students take the test under standardized conditions. The compact disc (CD) that accompanies this book offered examples of well-designed test items, questionnaire items, and administration manuals drawn from national and international assessments and is meant to showcase the variety of ways in which assessment teams have approached the design of these instruments.Publication An Expansion of a Global Data Set on Educational Quality : A Focus on Achievement in Developing Countries(World Bank, Washington, DC, 2013-07)This paper assembles a panel data set that measures cognitive achievement for 128 countries around the world from 1965 to 2010 in 5-year intervals. The data set is constructed from international achievement tests, such as the Programme for International Student Assessment and the Trends in International Mathematics and Science Study, which have become increasingly available since the late 1990s. These international assessments are linked to regional ones, such as the South and Eastern African Consortium for Monitoring of Educational Quality, the Programme d'Analyse des Systemes Educatifs de la Confemen, and the Laboratorio Latinoamericano de Evaluacion de la Calidad de la Educacion, in order to produce one of the first globally comparable data sets on student achievement. In particular, the data set is one of the first to include achievement in developing countries, including 29 African countries and 19 Latin American countries. The paper also provides a first attempt at using the data set to identify causal factors that boost achievement. The results show that key drivers of global achievement are civil rights and economic freedom across all countries, and democracy and economic freedom in a subset of African and Latin American countries.
Users also downloaded
Showing related downloaded files
Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Poverty and Shared Prosperity 2022(Washington, DC : World Bank, 2022)Poverty and Shared Prosperity 2022: Correcting Course provides the first comprehensive analysis of the pandemic’s toll on poverty in developing countries. It identifies how governments can optimize fiscal policy to help correct course. Fiscal policies offset the impact of COVID-19 on poverty in many high-income countries, but those policies offset barely one quarter of the pandemic’s impact in low-income countries and lower-middle-income countries. Improving support to households as crises continue will require reorienting protective spending away from generally regressive and inefficient subsidies and toward a direct transfer support system—a first key priority. Reorienting fiscal spending toward supporting growth is a second key priority identified by the report. Some of the highest-value public spending often pays out decades later. Amid crises, it is difficult to protect such investments, but it is essential to do so. Finally, it is not enough just to spend wisely - when additional revenue does need to be mobilized, it must be done in a way that minimizes reductions in poor people’s incomes. The report highlights how exploring underused forms of progressive taxation and increasing the efficiency of tax collection can help in this regard. Poverty and Shared Prosperity is a biennial series that reports on global trends in poverty and shared prosperity. Each report also explores a central challenge to poverty reduction and boosting shared prosperity, assessing what works well and what does not in different settings. By bringing together the latest evidence, this corporate flagship report provides a foundation for informed advocacy around ending extreme poverty and improving the lives of the poorest in every country in the world. For more information, please visit worldbank.org/poverty-and-shared-prosperity.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.