Publication: From Compliance to Learning: A System for Harnessing the Power of Data in the State of Maryland
Loading...
Files in English
11,842 downloads
Published
2017-04-10
ISSN
Date
2017-04-10
Author(s)
Editor(s)
Abstract
From Compliance to Learning: A System for Harnessing the Power of Data in the State of Maryland builds on a 2015 World Bank report that assessed Education Management Information Systems (EMISs) in the state of Maryland. That report uncovered a successful system, and this one expands on lessons learned and ways to apply them in practice. The goal of this study is to distill Maryland’s good practices in education data systems and share them in a way that is useful to education stakeholders interested in harnessing the power of data to strengthen learning outcomes. This study also examines the history of education data collection and use in the United States with a focus on Maryland, including a review of federal and state legislation that has helped to shape Maryland’s education data policies and systems. In the digital age, information is power. When information is effectively harnessed and aligned with student learning, it carries the potential to radically transform the delivery of education, as well as the sector as a whole. Increasingly, education systems are moving away from using education data narrowly for compliance purposes; instead, they are embracing data as a tool to drive systemwide innovation, professionalization, and, most importantly, learning. Whether to prioritize and optimize data and information systems around student learning is no longer an option; it is imperative for education systems that aim to excel and achieve strong learning outcomes. Over the past several decades, fundamental shifts have occurred in the way that education data are collected, managed, and used. Today real-time learning data inform classroom instruction; predictive analytics identify at-risk youth before they drop out of school; and data from preschool to workforce are linked to help guide education reforms. These represent just a few of the innovative ways that schools and other stakeholders across the United States are harnessing data to improve education. The state’s success in establishing an enabling environment for education data systems and data utilization has built a strong foundation. Maryland effectively aligned a complex, statewide data system to deliver value. Prioritization of integration and alignment was key. The state then launched a longitudinal data system center that would drive an adaptive education system with insights that track students from pre-kindergarten to entry in the workforce. Data across the state are high quality and follow strict rules to preserve privacy and enhance security. Maryland’s utilization of data also offers valuable lessons. The statewide data system supports policy makers and decision makers in planning and management, as well as teachers, students, and families in instruction and learning. Consistent across Maryland’s structuring and use of data systems were a strong vision and a road map to execute that vision. Maryland’s journey offers many lessons, not only for countries with advanced data systems but also for those in less developed stages. While the technology and information exist to achieve data for learning, harnessing data within the right information system and ensuring utilization are challenging endeavors. An array of factors must align—leadership, policies, processes, and resources, to name a few—to effectively harness data to support and drive strong learning outcomes.
Link to Data Set
Citation
“Mintz, Sarah; Abdul-Hamid, Husein; Saraogi, Namrata. 2017. From Compliance to Learning: A System for Harnessing the Power of Data in the State of Maryland. World Bank Studies;. © World Bank. http://hdl.handle.net/10986/26331 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Lessons Learned from World Bank Education Management Information System Operations(Washington, DC: World Bank, 2017-04-10)Lessons Learned from World Bank Education Management Information System Operations provides an overview of the World Bank’s portfolio in the area of Education Management Information Systems (EMISs) over the course of 17 years, from 1998 to 2014. It seeks to identify overall trends and characteristics of World Bank support in this area, with the intent of informing future project preparation and analytical work. The portfolio review revealed that although several good practices were evident, operational performance of EMIS activities fell short of expectations, with widespread deficiencies that ranged from unclear definitions and understanding of the EMIS to ineffective implementation and utilization. Examples of successful activities include the development of an EMIS to manage teachers and provide access to education (for example, Afghanistan); utilization of an EMIS as a management tool (for example, Bosnia and Herzegovina); creation of an online EMIS to improve access to education data (for example, Honduras); use of an EMIS to strengthen teaching and learning (for example, Guatemala and Lithuania); and use of an EMIS as a management tool for schools (for example, Malaysia). These success stories highlight how a well-implemented EMIS can improve the performance of an education system. The challenges that have been identified as contributing to the shortcomings are related to the following: • Misalignment of activities and unrealistic EMIS goals • Institutionalization of the EMIS • Sustainability challenges resulting from inconsistent leadership • Missed integration opportunities • Private players in education • EMIS at the local level Future projects could benefit from the SABER (Systems Approach for Better Education Results)-EMIS Assessment Framework. The SABER-EMIS Framework focuses on the need for a strong enabling environment, system soundness, quality data, and effective utilization as the key factors essential for the successful implementation of an EMIS. Initial needs assessment of a country’s EMIS can play a critical role i n benchmarking countries and provide a valuable foundation for the design of new projects.Publication What Matters Most for Education Management Information Systems : A Framework Paper(World Bank Group, Washington, DC, 2014-06)The main objective of this paper is to outline what matters most for an effective education management information system (EMIS). It presents the conceptual background and operational tools for the Systems Approach for Better Education Results (SABER)-EMIS domain. These tools are intended for use by government education policy makers to assess policy areas of relevance to a country s EMIS against international best practices. This paper begins with an introduction of the domain and the rationale for an EMIS benchmarking tool. Chapter 1 then provides an overview of current data-related demands to improve education, explains how an EMIS meets those data demands, and highlights examples of specific system s in action. Chapter 2 outlines what matters in an EMIS, starting with an explanation of what comprises the construct validity and theoretical underpinnings for benchmarking an EMIS. This chapter shows that the guiding principles behind an EMIS drive actionable policies. A detailed description of four policy areas specifically, the enabling environment, system soundness, data quality, and utilization for decision making then follows in chapter 3. The chapter describes the rubric for the SABER-EMIS Tool and gives a brief overview of an EMIS benchmarking pilot, which demonstrated the feasibility of the concept. The last chapter describes how an EMIS is benchmarked, scored, and subsequently leads to a situation analysis. This assessment sequence provides an understanding of the strength and weaknesses of an EMIS system for fuller, more comprehensive depiction of its status. Overall, this paper evaluates whether a management information system is set up to use the information it generates for improving operational efficiency and educational quality.Publication Learning from Local Practices : Improving Student Performance in West Bank and Gaza(World Bank, Washington, DC, 2014-06-12)The motivation for this study is to contribute to the preparation of the new Palestinian Education Strategy by shedding light on the school and classroom level factors that influence student learning, and to identify good practices that can be generalized from high-performing classrooms to those that need improvement. While most Palestinian children are in school, performance on assessments indicates that many of them are not learning as much as they could. This represents not only inefficiency in the use of public resources, but also a lost opportunity for individual students and the society as a whole. The current study was carried out by the Assessment and Evaluation Department (AED) of the Palestinian Ministry of Education and Higher Education (MoEHE) with technical and financial support from the World Bank. The analysis presented in this paper was prepared by the World Bank team as a complement to a previous paper prepared by a team of experts from AED. For the purposes of this study, schools were classified by student performance in TIMSS 2011 and the 2012 Palestinian national exams. Classroom and school-based tools were then used to gather information from both high and low-performing schools. A total of 122 public, private and United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) schools were surveyed using four different instruments: (i) stalling's classroom observations; (ii) school leadership survey; (iii) teacher survey; and, (iv) school facilities survey, which are all provided in annex one.Publication Republic of Haiti Education Management Information Systems(World Bank, Washington, DC, 2017-06)The main objective of this paper is to outline what matters most for an effective education management information system (EMIS). It presents the conceptual background and operational tools for the Systems Approach for Better Education Results (SABER)‐EMIS domain. These tools are intended for use by government education policy makers to assess policy areas of relevance to a country’s EMIS against international best practices. This paper begins with an introduction of the domain and the rationale for an EMIS benchmarking tool. Chapter one then provides an overview of current data‐related demands to improve education, explains how an EMIS meets those data demands, and highlights examples of specific systems in action. Chapter two outlines what matters in an EMIS, starting with an explanation of what comprises the construct validity and theoretical underpinnings for benchmarking an EMIS. This chapter shows that the guiding principles behind an EMIS drive actionable policies. A detailed description of four policy areas, specifically, the enabling environment, system soundness, data quality, and utilization for decision making, then follows in chapter three. That chapter describes the rubric for the SABER‐EMIS Tool and gives a brief overview of an EMIS benchmarking pilot, which demonstrated the feasibility of the concept. The last chapter describes how an EMIS is benchmarked, scored, and subsequently leads to a situation analysis. This assessment sequence provides an understanding of the strengths and weaknesses of an EMIS system for a fuller, more comprehensive depiction of its status. Overall, this paper evaluates whether a management information system is set up to use the information it generates for improving operational efficiency and educational quality.Publication Fiji Education Management Information Systems(World Bank, Washington, DC, 2017-06)In 2011, the World Bank Group commenced a multiyear program designed to support countries in systematically examining and strengthening the performance of their education systems. this evidence-based initiative, called systems approach for better education results (SABER), uses diagnostic tools for examining education systems and their component policy domains against global standards and best practices and in comparison, with the policies and practices of countries around the world. By leveraging this global knowledge, the SABER tools fill a gap in the availability of data and evidence on what matters most to improve the quality of education and achievement of better results. This report discusses the results of applying the SABER - education management information systems (EMIS) tool in Fiji. The objectives of this report are to examine the system according to key policy areas, identify successes, and challenges in the system, and provide recommendations to support the continued advancement of EMIS in Fiji.
Users also downloaded
Showing related downloaded files
Publication A Guide to Assessing Needs : Essential Tools for Collecting Information, Making Decisions, and Achieving Development Results(World Bank, 2012-01-06)This book will benefit people and teams involved in planning and decision making. On the basis of their pragmatic value in guiding decisions, needs assessments are used in various professions and settings from emergency rooms to corporate boardrooms to guide decision making. Nonetheless, although needs assessments have many different applications, in this book on needs assessments as they are applied in organizations to accomplish results, as opposed to their use in personal decisions or medical triage. This book, in turn, is guide to assessing needs and then making essential decisions about what to do next. This book filled with practical strategies, tools, and guides covers both large-scale, formal needs assessments and less-formal assessments that guide daily decisions. Included in the book is a blend of rigorous methods and realistic tools that can help make informed and reasoned decisions. Together, these methods and tools offer a comprehensive, yet realistic, approach to identifying needs and selecting among alternative ways as go forward. Sections one and two offer quick, yet full, answers to many frequently asked questions regarding how to make justifiable decisions. Next, section three examines a variety of tools and techniques that can be used for both collecting information and making decisions. Appendix A then offers a number of checklists and guides for managing the systematic assessment processes that lead to quality decisions. Finally, the reference list at the end of the book is a valuable resource to research, tools, and discussions of needs assessment.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Moving Out of Poverty : Volume 1. Cross-Disciplinary Perspectives on Mobility(Washington, DC: World Bank and Palgrave Macmillan, 2007)This volume brings together multidisciplinary perspectives on poor people's mobility, a dynamic approach that hopefully will add to the reader's understanding of how and why people move into and out of poverty. The chapters draw on the latest longitudinal micro data to present a moving picture of poverty that is rather different from what one can see in single snapshots, the staple of traditional poverty analysis. The book is also important because the contributors' distinct disciplinary perspectives demonstrate clearly why it is critical to draw on diverse information to improve the reader's understanding about how to reduce poverty. The economic findings reinforce what has been known for some time: fast economic growth underpins poverty reduction, but the speed of declines in poverty is greatly affected by social and political factors. The economic panels also show that the people mired in chronic poverty around the world are actually fewer in number than the people moving in and out of poverty. Static studies do not capture this dynamic quality of poverty and vulnerability. Of particular interest are the chapters clarifying interactions between the local social, political, and economic factors that underlie persistent poverty, vulnerability, and inequality. They point to the need to draw from different disciplines as we turn to the task of reaching the bottom poor trapped in poverty and those churning in and out of poverty.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.