Publication: Developing Tests and Questionnaires for a National Assessment of Educational Achievement
Loading...
Files in English
2,396 downloads
201 downloads
316 downloads
Date
2008
ISSN
Published
2008
Author(s)
Editor(s)
Abstract
Developing tests and questionnaires for a national assessment of educational achievement addresses the design of two types of data collection instruments: student achievement tests and background questionnaires. Part one covers the development of an assessment framework and a test blueprint, item writing, pre testing, and final test layout. Part two delineates comparable stages and activities in the construction of background questionnaires, which are used to gather information from students, teachers, head teachers, or parents on variables that might help explain differences in student performance on the achievement test. Part three describes how to design a manual for test administration to help ensure that all students take the test under standardized conditions. The compact disc (CD) that accompanies this book offered examples of well-designed test items, questionnaire items, and administration manuals drawn from national and international assessments and is meant to showcase the variety of ways in which assessment teams have approached the design of these instruments.
Link to Data Set
Citation
“Anderson, Prue; Morgan, George. 2008. Developing Tests and Questionnaires for a National Assessment of Educational Achievement. National Assessments of Educational
Achievement; Volume 2. © World Bank. http://hdl.handle.net/10986/6524 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Private Non-State Sector Engagement in the Provision of Educational Services at the Primary and Secondary Levels in South Asia : An Analytical Review of Its Role in School Enrollment and Student Achievement(World Bank, Washington, DC, 2014-06)Private (non-state) sector engagement in the provision of educational services at the primary and secondary levels in South Asia has recently undergone remarkable growth. This type of education comes in various forms, such as schools financed and managed by the private sector, schools financed by the government and managed by the private sector, private school vouchers, and tutoring outside the classroom. According to recent household survey data, almost one-third of school-goers aged 6 to 18 years in South Asia go to private schools, with a high concentration in Bangladesh, India, Nepal, and Pakistan. Data for India, Nepal, and Pakistan show that on average, private schools perform at least as well as government schools on student test scores, after controlling for socioeconomic factors, and they do so at significantly lower costs to society. However, student achievement varies greatly across schools of each type, with many weak private schools as well as strong government schools. Substantial, albeit indirect, evidence points to teacher behavior and accountability as an important driver of the effectiveness of private schools. In the long run, however, many factors may play important roles in sustaining the private sector's advantage. Another risk is that overall poor quality in a large government sector may set a low benchmark for the private sector. The findings cast doubt on the effectiveness of government regulations for private schools, given weak institutional capacity. Public-private partnerships with effective accountability mechanisms could leverage both equity and efficiency. Finally, it appears important to understand and customize teaching to the child's individual level.Publication Sudan Student Assessment : SABER Country Report 2013(Washington, DC, 2013)In 2013, Sudan joined the Russia Education Aid for Development (READ) trust fund program, the goal of which is to help countries improve their capacity to design, carry out, analyze, and use assessments for improved student learning. As part of the READ trust fund program, and in order to gain a better understanding of the strengths and weaknesses of its existing assessment system, Tajikistan participated in a formal exercise to benchmark its student assessment system under The World Bank's Systems Approach for Better Education Results (SABER) program. SABER is an evidence-based program to help countries systematically examine and strengthen the performance of different aspects of their education systems. SABER-student assessment is a component of the SABER program that focuses specifically on benchmarking student assessment policies and systems. The goal of SABER-student assessment is to promote stronger assessment systems that contribute to improved education quality and learning for all. The importance of assessment is linked to its role in: providing information on levels of student learning and achievement in the system; monitoring trends in education quality over time; supporting educators and students with real-time information to improve teaching and learning; and holding stakeholders accountable for results. The SABER-student assessment framework is built on the available evidence base for what an effective assessment system looks like. The framework provides guidance on how countries can build more effective student assessment systems. The framework is structured around two main dimensions of assessment systems: the types/purposes of assessment activities and the quality of those activities. Assessment systems tend to be comprised of three main types of assessment activities, each of which serves a different purpose and addresses different information needs. These three main types are: classroom assessment, examinations, and large scale, system level assessments. This report focuses specifically on policies in the area of student assessment.Publication Language, Literacy, and Learning in Primary Schools : Implications for Teacher Development Programs in Nigeria(Washington, DC: World Bank, 2007)Language, Literacy, and Learning in Primary Schools is a synthesis of the findings arising from four years of policy research and development in Nigeria's primary schools that focused on the gap between what teachers should know and be able to do, and the realities of teaching and learning in classrooms. It begins by critically examining the outcomes of primary schooling as measured by learning achievement results from national assessments, and by identifying some core learning problems for Nigerian primary school children. It reviews the findings from recent research reports that studied teaching and learning processes in primary school classrooms, and it identifies the pedagogical issues in primary classrooms that contribute to poor learning achievements. This report describes a research and development program that set out to improve teaching and learning in core learning skill areas of the curriculum.Publication Developing Cross-Language Metrics for Reading Fluency Measurement(World Bank, Washington, DC, 2012-07-10)Since 2005, over 70 oral reading fluency tests have been given in many languages and scripts, either as part of the Early Grade Reading Assessment (EGRA) or as individual one-minute tests. Particularly in multilingual countries, reading speed and comprehension measures have been taken in multiple languages and also in multiple scripts. The development of language has a significant genetic component, which tends to create common grammatical structures. Then languages must conform to information processing limitations, notably to working memory capacity. On the basis of such features, it may be possible to develop common standards for performance improvement compare findings cross linguistically. Languages are most comparable when large chunks are used rather than single words. To arrive at some comparisons, several methods may be tried. These include: a) counting actual words in connected texts or in lists, using some conventions if needed; b) using computational solutions to arrive at coefficients of certain languages vis a vis others, such as 1 Swahili word being equivalent roughly to 1.3 English words; c) using in multiple languages lists of words of a defined length, e.g. 4 letters; d) measuring phonemes or syllables per minute, possibly dividing by average word length; and e) rapid serial visual presentation, potentially also measuring perception at the letter feature level. Overall, reading rate as words per minute seems to be a valid and reliable indicator of achievement, with 45-60 words being a range that is usable as a benchmark.Publication Teaching Mathematics Effectively to Primary Students in Developing Countries(World Bank, Washington, DC, 2008-12-30)This paper uses research from neuroscience and the psychology of mathematics to arrive at useful recommendations for teaching mathematics at primary level to poor students in developing countries. The enrollment rates of the poorer students have improved tremendously in the last decade. And the global Net Enrollment Ratio (NER) has improved since 2001 from 83.2 percent to 90-95 percent except in Sub-Saharan Africa and South Asia. Making teaching of math and other subjects efficient for the poor in developing countries is a great challenge, particularly in south Asia and Sub-Saharan Africa. Many developing countries have explored new means of teaching math and other subjects. Mongolia changed its mathematics education, aiming to build a new set of priorities and practices, given the abandonment of earlier traditions. Similar to international trends of the time, South Africa in the 1990s extensively applied the constructivist learning philosophy which relied on exploration and discovery, with little emphasis on memorization, drill, In conformity with a belief that teachers could develop their own learning programs, there was virtual absence of a national or provincial syllabus or textbooks. Students were expected to develop their own methods for arithmetic operations, but most found it impossible to progress on their own from counting to actual calculating. This study integrates pertinent research from neuroscience and the psychology of mathematics to arrive at recommendations for curricular and efficient means of mathematics instruction particularly for developing countries and poor students at primary level. Specifically, the latest research in neuroscience, cognitive science, and discussions of national benchmarks for primary school mathematics learning, form the basis of our recommendations. These recommendations have a reasonable chance of working in the situational contexts of developing countries, with their traditions and resources.
Users also downloaded
Showing related downloaded files
Publication Lebanon Economic Monitor, Fall 2022(Washington, DC, 2022-11)The economy continues to contract, albeit at a somewhat slower pace. Public finances improved in 2021, but only because spending collapsed faster than revenue generation. Testament to the continued atrophy of Lebanon’s economy, the Lebanese Pound continues to depreciate sharply. The sharp deterioration in the currency continues to drive surging inflation, in triple digits since July 2020, impacting the poor and vulnerable the most. An unprecedented institutional vacuum will likely further delay any agreement on crisis resolution and much needed reforms; this includes prior actions as part of the April 2022 International Monetary Fund (IMF) staff-level agreement (SLA). Divergent views among key stakeholders on how to distribute the financial losses remains the main bottleneck for reaching an agreement on a comprehensive reform agenda. Lebanon needs to urgently adopt a domestic, equitable, and comprehensive solution that is predicated on: (i) addressing upfront the balance sheet impairments, (ii) restoring liquidity, and (iii) adhering to sound global practices of bail-in solutions based on a hierarchy of creditors (starting with banks’ shareholders) that protects small depositors.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Assessing National Achievement Levels in Education(Washington, DC: World Bank, 2008)This introductory book describes the main features of national and international assessments, both of which became extremely popular tools for determining the quality of education in the 1990s and 2000s. This increase in popularity reflects two important developments. First, it reflects increasing globalization and interest in global mandates, including Education for All (UNESCO 2000). Second, it represents an overall shift in emphasis in assessing the quality of education from a concern with inputs (such as student participation rates, physical facilities, curriculum materials, and teacher training) to a concern with outcomes. This emphasis on outcomes can, in turn, be considered an expression of concern with the development of human capital in the belief (a) that knowledge is replacing raw materials and labor as resources in economic development and (b) that the availability of human knowledge and skills is critical in determining a country's rate of economic development and its competitiveness in an international market. The purposes and main features of national assessments are described in chapter 2. The reasons for carrying out a national assessment are considered in chapter 3, and the main decisions that have to be made in the design and planning of an assessment are covered in chapter 4. Issues (as well as common errors) to be borne in mind in the design, implementation, analysis, reporting, and use of a national assessment are identified in chapter 5. In chapter 6, international assessments of student achievement, which share many procedural features with national assessments (such as sampling, administration, background data collected, and methods of analysis), are described.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.