Publication: Developing Tests and Questionnaires for a National Assessment of Educational Achievement
Loading...
Files in English
2,403 downloads
201 downloads
339 downloads
Published
2008
ISSN
Date
2012-05-29
Author(s)
Editor(s)
Abstract
Developing tests and questionnaires for a national assessment of educational achievement addresses the design of two types of data collection instruments: student achievement tests and background questionnaires. Part one covers the development of an assessment framework and a test blueprint, item writing, pre testing, and final test layout. Part two delineates comparable stages and activities in the construction of background questionnaires, which are used to gather information from students, teachers, head teachers, or parents on variables that might help explain differences in student performance on the achievement test. Part three describes how to design a manual for test administration to help ensure that all students take the test under standardized conditions. The compact disc (CD) that accompanies this book offered examples of well-designed test items, questionnaire items, and administration manuals drawn from national and international assessments and is meant to showcase the variety of ways in which assessment teams have approached the design of these instruments.
Link to Data Set
Citation
“Anderson, Prue; Morgan, George. 2008. Developing Tests and Questionnaires for a National Assessment of Educational Achievement. National Assessments of Educational
Achievement; Volume 2. © World Bank. http://hdl.handle.net/10986/6524 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Private Non-State Sector Engagement in the Provision of Educational Services at the Primary and Secondary Levels in South Asia : An Analytical Review of Its Role in School Enrollment and Student Achievement(World Bank, Washington, DC, 2014-06)Private (non-state) sector engagement in the provision of educational services at the primary and secondary levels in South Asia has recently undergone remarkable growth. This type of education comes in various forms, such as schools financed and managed by the private sector, schools financed by the government and managed by the private sector, private school vouchers, and tutoring outside the classroom. According to recent household survey data, almost one-third of school-goers aged 6 to 18 years in South Asia go to private schools, with a high concentration in Bangladesh, India, Nepal, and Pakistan. Data for India, Nepal, and Pakistan show that on average, private schools perform at least as well as government schools on student test scores, after controlling for socioeconomic factors, and they do so at significantly lower costs to society. However, student achievement varies greatly across schools of each type, with many weak private schools as well as strong government schools. Substantial, albeit indirect, evidence points to teacher behavior and accountability as an important driver of the effectiveness of private schools. In the long run, however, many factors may play important roles in sustaining the private sector's advantage. Another risk is that overall poor quality in a large government sector may set a low benchmark for the private sector. The findings cast doubt on the effectiveness of government regulations for private schools, given weak institutional capacity. Public-private partnerships with effective accountability mechanisms could leverage both equity and efficiency. Finally, it appears important to understand and customize teaching to the child's individual level.Publication Sudan Student Assessment : SABER Country Report 2013(Washington, DC, 2013)In 2013, Sudan joined the Russia Education Aid for Development (READ) trust fund program, the goal of which is to help countries improve their capacity to design, carry out, analyze, and use assessments for improved student learning. As part of the READ trust fund program, and in order to gain a better understanding of the strengths and weaknesses of its existing assessment system, Tajikistan participated in a formal exercise to benchmark its student assessment system under The World Bank's Systems Approach for Better Education Results (SABER) program. SABER is an evidence-based program to help countries systematically examine and strengthen the performance of different aspects of their education systems. SABER-student assessment is a component of the SABER program that focuses specifically on benchmarking student assessment policies and systems. The goal of SABER-student assessment is to promote stronger assessment systems that contribute to improved education quality and learning for all. The importance of assessment is linked to its role in: providing information on levels of student learning and achievement in the system; monitoring trends in education quality over time; supporting educators and students with real-time information to improve teaching and learning; and holding stakeholders accountable for results. The SABER-student assessment framework is built on the available evidence base for what an effective assessment system looks like. The framework provides guidance on how countries can build more effective student assessment systems. The framework is structured around two main dimensions of assessment systems: the types/purposes of assessment activities and the quality of those activities. Assessment systems tend to be comprised of three main types of assessment activities, each of which serves a different purpose and addresses different information needs. These three main types are: classroom assessment, examinations, and large scale, system level assessments. This report focuses specifically on policies in the area of student assessment.Publication Developing Cross-Language Metrics for Reading Fluency Measurement(World Bank, Washington, DC, 2012-07-10)Since 2005, over 70 oral reading fluency tests have been given in many languages and scripts, either as part of the Early Grade Reading Assessment (EGRA) or as individual one-minute tests. Particularly in multilingual countries, reading speed and comprehension measures have been taken in multiple languages and also in multiple scripts. The development of language has a significant genetic component, which tends to create common grammatical structures. Then languages must conform to information processing limitations, notably to working memory capacity. On the basis of such features, it may be possible to develop common standards for performance improvement compare findings cross linguistically. Languages are most comparable when large chunks are used rather than single words. To arrive at some comparisons, several methods may be tried. These include: a) counting actual words in connected texts or in lists, using some conventions if needed; b) using computational solutions to arrive at coefficients of certain languages vis a vis others, such as 1 Swahili word being equivalent roughly to 1.3 English words; c) using in multiple languages lists of words of a defined length, e.g. 4 letters; d) measuring phonemes or syllables per minute, possibly dividing by average word length; and e) rapid serial visual presentation, potentially also measuring perception at the letter feature level. Overall, reading rate as words per minute seems to be a valid and reliable indicator of achievement, with 45-60 words being a range that is usable as a benchmark.Publication Language, Literacy, and Learning in Primary Schools : Implications for Teacher Development Programs in Nigeria(Washington, DC: World Bank, 2007)Language, Literacy, and Learning in Primary Schools is a synthesis of the findings arising from four years of policy research and development in Nigeria's primary schools that focused on the gap between what teachers should know and be able to do, and the realities of teaching and learning in classrooms. It begins by critically examining the outcomes of primary schooling as measured by learning achievement results from national assessments, and by identifying some core learning problems for Nigerian primary school children. It reviews the findings from recent research reports that studied teaching and learning processes in primary school classrooms, and it identifies the pedagogical issues in primary classrooms that contribute to poor learning achievements. This report describes a research and development program that set out to improve teaching and learning in core learning skill areas of the curriculum.Publication Teaching Mathematics Effectively to Primary Students in Developing Countries(World Bank, Washington, DC, 2008-12-30)This paper uses research from neuroscience and the psychology of mathematics to arrive at useful recommendations for teaching mathematics at primary level to poor students in developing countries. The enrollment rates of the poorer students have improved tremendously in the last decade. And the global Net Enrollment Ratio (NER) has improved since 2001 from 83.2 percent to 90-95 percent except in Sub-Saharan Africa and South Asia. Making teaching of math and other subjects efficient for the poor in developing countries is a great challenge, particularly in south Asia and Sub-Saharan Africa. Many developing countries have explored new means of teaching math and other subjects. Mongolia changed its mathematics education, aiming to build a new set of priorities and practices, given the abandonment of earlier traditions. Similar to international trends of the time, South Africa in the 1990s extensively applied the constructivist learning philosophy which relied on exploration and discovery, with little emphasis on memorization, drill, In conformity with a belief that teachers could develop their own learning programs, there was virtual absence of a national or provincial syllabus or textbooks. Students were expected to develop their own methods for arithmetic operations, but most found it impossible to progress on their own from counting to actual calculating. This study integrates pertinent research from neuroscience and the psychology of mathematics to arrive at recommendations for curricular and efficient means of mathematics instruction particularly for developing countries and poor students at primary level. Specifically, the latest research in neuroscience, cognitive science, and discussions of national benchmarks for primary school mathematics learning, form the basis of our recommendations. These recommendations have a reasonable chance of working in the situational contexts of developing countries, with their traditions and resources.
Users also downloaded
Showing related downloaded files
Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Europe and Central Asia Economic Update, Spring 2025: Accelerating Growth through Entrepreneurship, Technology Adoption, and Innovation(Washington, DC: World Bank, 2025-04-23)Business dynamism and economic growth in Europe and Central Asia have weakened since the late 2000s, with productivity growth driven largely by resource reallocation between firms and sectors rather than innovation. To move up the value chain, countries need to facilitate technology adoption, stronger domestic competition, and firm-level innovation to build a more dynamic private sector. Governments should move beyond broad support for small- and medium-sized enterprises and focus on enabling the most productive firms to expand and compete globally. Strengthening competition policies, reducing the presence of state-owned enterprises, and ensuring fair market access are crucial. Limited availability of long-term financing and risk capital hinders firm growth and innovation. Economic disruptions are a shock in the short term, but they provide an opportunity for implementing enterprise and structural reforms, all of which are essential for creating better-paying jobs and helping countries in the region to achieve high-income status.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.