Publication: Defining and Using Performance Indicators and Targets in Government M and E Systems
Loading...
Published
2011-07
ISSN
Date
2012-08-13
Author(s)
Editor(s)
Abstract
Developing effective national monitoring and evaluation (M&E) systems and/or performance budgeting initiatives requires well-defined formulation and implementation strategies for setting up performance indicators. These strategies vary depending on a country's priority for measuring results and on the scope and pace of its performance management reform objectives. Some countries have followed an incremental method for developing indicators, that is, progressively, at strategically selected programs/sectors (for example, Canada, the United Kingdom, and Colombia), while others have taken a comprehensive, 'big bang' approach by defining indicators for all existing programs and sectors at once (for example, Mexico and the Republic of Korea). In both cases, countries need to continuously work on their indicators to improve their quality and thus ensure that indicators can meaningfully inform government processes.
Link to Data Set
Citation
“Castro, Manuel Fernando. 2011. Defining and Using Performance Indicators and Targets in Government M and E Systems. PREM Notes and Special series on the Nuts and Bolts of Government M&E Systems; No. 12. © World Bank. http://hdl.handle.net/10986/11061 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Monitoring and Evaluation System : The Case of Chile 1990-2014(Washington, DC: World Bank Group, 2014-07)From its creation in the 1990s, the Chilean monitoring and evaluation (M and E) system has represented a substantial part of the effort to improve the use of Chile's public resources within a broader context of multiple initiatives designed to modernize and improve public management in many areas. This close relationship with the budget has determined the primary characteristics of the M and E system, in both its design and operations. The M and E system's institutional coverage includes all the organizations in the executive branch of the central government and those included in the budget law for the public sector. The objective of this document is to give a broad view of the M and E systems in Chile, distinguishing the three stages and providing lessons for other countries that are developing their own systems. The first section focuses on the first period and its two stages: 1990-2000 and 2000-2010. These stages concentrate mainly on the role played by the budget office. The second period covers 2010-13, in which light is shed on both the new system's actors and the emphasis adopted by the authorities in charge, but at the same time the authorities largely continue and strengthen the existing tools from the M and E system of the previous period. The third section of the paper summarizes success factors and obstacles to success in the two periods. Section four states general conclusions regarding the main system's challenges and section five includes lessons for other countries.Publication Insider Insights(World Bank, Washington, DC, 2008-11)During the past two decades Colombia has been developing and improving its National Results-Based Management and Evaluation System (SINERGIA). The development of this system has been a focal point in Colombia's state reform towards performance-based management, particularly at the central administration. After 15 years of progress, overcoming the effects of institutional, political, and fiscal obstacles, SINERGIA has achieved one of the highest levels of development and customization, and it is held up as an example of best practices by multilateral organizations, donor agencies, and other governments. The monitoring and evaluation (M&E) system that Colombia adopted sought to promote a results focus on both planning and budgeting processes, simultaneously. However, during implementation the results-based planning model superseded the budgeting model, owing principally to the architecture of Colombia's central administration and to the institutional placement of SINERGIA within the Department of National Planning. Compared with similar experiences in other countries, the process by which SINERGIA advanced institutionalization is notable for the way it combined high-ranking, wide ranging, and formal mechanisms with the development of informal practices in key areas of the public sector. Many lessons for other countries are identified in this paper. Some of the key factors in Colombia's success are as follows: 1) the importance of having a central governmental department act as a champion supporter, and using an opportunistic approach to include the M&E system as a key pillar on public sector reform agendas; 2) the kind of regulatory and incentives framework on which the M&E system is based, and the sustained effort in promoting 'cultural' change and developing evaluation capacities; 3) the political role of the President in the system's institutionalization process; 4) the powerful part that technically defined methodologies and dissemination mechanisms have played in the system's institutionalization strategy; 5) the collaborative approach used to strengthen evaluation practices and to enhance the community of evaluators; and 6) the demand-driven approach for introducing M&E at the regional level.Publication Insider Insights(World Bank, Washington, DC, 2008)Colombia's National Results-Based Management and Evaluation System (SINERGIA) is one of Latin America's outstanding results-based monitoring and evaluation initiatives. With 15 years of progressive development, SINERGIA has endured the countries' institutional, political, and fiscal problems and has attained one of the highest levels of development and customization in Latin America. Based on its accomplishments it has been held up as an example by multilateral organizations, donor agencies, and other governments. This paper examines the experience of institutionalizing Colombia's monitoring and evaluation (M&E) system, from the perspective of a former SINERGIA manager: Manuel Fernando Castro, Director of Public Policy Evaluation, and Department of National Planning. This study is meant to complement previous studies by other authors with an insider's account, description, and analysis of the obstacles encountered and the results obtained. Likewise, it presents recommendations on how to ensure further institutionalization and identifies several lessons that might be of interest to professionals who are developing evaluation systems in other countries.Publication Results Readiness in Social Protection and Labor Operations(World Bank, Washington, DC, 2011-02)The main focus of the social protection and labor portfolio is on strengthening client's institutional capacity in the design and implementation of programs, but projects are not well equipped to track progress in this area. Correspondingly, there is a need to strengthen approaches to measuring and monitoring a 'missing middle' of service delivery, precisely those areas for which counterpart institutions are responsible during the course of a project. In particular, better measures of the primary functions of social protection and labor agencies are needed, such as identifying and enrolling beneficiaries, targeting, payment systems, fraud and error control, performance monitoring of service delivery providers, responsiveness to citizens, transparency, efficiency, management information systems and monitoring and evaluation systems. New World Bank initiatives particularly standard core indicators by sector and the introduction of results based investment lending call for substantial improvements in the use of monitoring and evaluation (M&E). Impact evaluations are included in about half of projects and should continue to be used selectively and strategically, particularly when the program is innovative, replicable and/ or scalable to reach a broader set of beneficiaries, addresses a knowledge gap and is likely to have a substantial policy impact. Structuring evaluations around core themes with common outcome measures is fundamental to building a global knowledge base on development effectiveness.Publication Tracking Results in Agriculture and Rural Development in Less-Than-Ideal Conditions : A Sourcebook of Indicators for Monitoring and Evaluation(World Bank, Washington, DC, 2009-03)The demand for verifiable evidence of results and impacts of development agricultural programs and projects is growing. However, most of the indicators that development practitioners have traditionally used in tracking progress toward achieving projects' objectives focus on the workings of the development operation itself. These performance indicators relate mainly to lower-level inputs and outputs and are used to populate management information systems. Higher-level indicators are used to measure progress in achieving the ultimate objectives of projects, and in bringing about larger outcomes and impacts. The ability to measure and demonstrate outcomes and impacts relies on the use of indicators that are based on reliable data and on the capacity to systematically collect and analyze that information. The conditions in which monitoring and evaluation (M&E) are carried out vary widely, depending on the demand for information, the extent to which it is used to inform decision-making, and the reliability of the systems that are in place to capture and convey that information. Throughout much of the developing world these conditions are "less-than-ideal," and information is irregular and often lacking altogether. In these conditions there is a lack of effective demand for information on the part of policy makers. The conditions are often especially pronounced for data related to rural areas, where the costs of data collection are high and the quality of existing data is particularly low. Building data systems and developing and supporting capacity for M&E in these conditions is, therefore, a pressing imperative for interventions in the agriculture and rural development sector. Strengthening capacity for M&E begins at the national and sub-national levels, where addressing the weaknesses of national statistical systems is a common priority. The data collected and reported within countries must not only be of sufficient quality to inform planning and policy formulation but must also be consistent between countries.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Beyond Unicorns(Washington, DC: World Bank, 2021-07-28)Similar to many other countries around the world, the COVID-19 (coronavirus) pandemic has hit Indonesia hard. Latest estimates suggest that about 5.1 million people—equivalent to 2.4 percent of the working-age population—have lost their jobs, while an additional 24 million have had to work reduced hours due to the pandemic. As many as 50 percent of workers have experienced a reduction in earnings. The impact on living standards has been devastating, with more than 2.2 million Indonesians estimated to have been pushed into COVID-19-induced poverty in 2020. One unexpected silver lining from the crisis, however, has been the turbo-charged adoption of digital technologies. Businesses, both large and small, have flocked to digital technologies to try to ensure the continuity of their operations. School closures have forced students and teachers to adapt and explore digitally enabled remote learning options, including the adoption of a variety of EdTech solutions. HealthTech apps enabling remote consultations and the delivery of medicine have seen unprecedented growth in adoption rates. Confined at home due to mobility restrictions, Indonesians have switched to the internet for their entertainment and social needs, driving sharp growth in the usage of digital media (music and video streaming) and communications applications. With this pandemic-induced flight to digital expected to be permanent to a large extent, there is excitement about an even greater acceleration in what was already the fastest growing digital economy in Southeast Asia. But at the same time questions have also emerged about the possibility of the differential access to and adoption of digital technologies compounding existing inequalities. For a country that considers achieving balanced development one of its key priorities, this is an important new challenge.Publication Exploiting Synergies between Rooftop Solar PV and Energy Efficiency Investments in the Built Environment(World Bank, Washington, DC, 2017-12)The synergies between rooftop solar PV (RPV) and energy efficiency (EE) investments in the built environment include lower specific transaction costs, optimized RPV systems, shorter project payback periods (compared to RPV-only projects), and, for EE, enhanced project visibility. These synergies improve the likelihood of project implementation, which in turn helps to reduce peak demand, increase environmental benefits, improve energy security, and lower energy bills. Because the methods of financing and implementing RPV and EE in the built environment are often similar, it is wise to consider including an EE component when investing in an RPV project, and vice versa.Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.Publication Vietnam(World Bank, Hanoi, 2020-05-01)Following from Vietnam’s ratification of the Comprehensive and Progressive Agreement for Trans-Pacific Partnership (CPTPP) in late 2018 and its effectiveness from January 2019, and the European Parliament’s recent approval of the European Union-Vietnam Free Trade Agreement (EVFTA) and its subsequent planned ratification by the National Assembly in May 2020, Vietnam has further demonstrated its determination to be a modern, competitive, open economy. As the COVID-19 (Coronavirus) crisis has clearly shown, diversified markets and supply chains will be key in the future global context to managing the risk of disruptions in trade and in supply chains due to changing trade relationships, climate change, natural disasters, and disease outbreaks. In those regards, Vietnam is in a stronger position than most countries in the region. The benefits of globalization are increasingly being debated and questioned. However, in the case of Vietnam, the benefits have been clear in terms of high and consistent economic growth and a large reduction in poverty levels. As Vietnam moves to ratify and implement a new generation of free trade agreements (FTAs), such as the CPTPP and EVFTA, it is important to clearly demonstrate, in a transparent manner, the economic gains and distributional impacts (such as sectoral and poverty) from joining these FTAs. In the meantime, it is crucial to highlight the legal gaps that must be addressed to ensure that national laws and regulations are in compliance with Vietnam’s obligations under these FTAs. Readiness to implement this new generation of FTAs at both the national and subnational level is important to ensure that the country maximizes the full economic benefits in terms of trade and investment. This report explores the issues of globalization and the integration of Vietnam into the global economy, particularly through implementation of the EVFTA.