Publication: Building Monitoring and Evaluation Capacity in Young Systems : The Experiences of Rwanda, Vietnam, and Yemen
Loading...
Published
2014-06
ISSN
Date
2014-09-09
Author(s)
Editor(s)
Abstract
This study is funded by the Governance Partnership Facility to better understand country experiences with building monitoring and evaluation (M&E) capacity to identify paths to success and obstacles to reform. For every country, whether recently emerging from conflict, low-income, or Organization for Economic Cooperation and Development (OECD), M&E is critical to evidence-based policymaking, budget decisions, management, and accountability, all elements of good governance. Building M&E capacity in fragile and conflict-affected states is not a well-documented topic, although analysts generally agree that even in these challenging contexts, countries can set up monitoring capabilities, albeit with heavy donor support. This study aims to strengthen the knowledge base by synthesizing and comparing the experiences of Rwanda, Vietnam, and Yemen in building capacity for their recently established M&E systems. The study also draws comparisons with Mexico's more well-developed M&E system. This paper is directed to policymakers, development workers, donors, and other supporters of M&E research, operations, and activities. The author envision that providing country case studies on implementing M&E programs in difficult circumstances will contribute to a South-South knowledge exchange for key stakeholders who are working to advance newly established M&E systems in their own countries.
Link to Data Set
Citation
“Hwang, Helena. 2014. Building Monitoring and Evaluation Capacity in Young Systems : The Experiences of Rwanda, Vietnam, and Yemen. © http://hdl.handle.net/10986/20023 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication PRSPs and Budgets(A Synthesis of Five Case Studies, 2005-01-18)This paper synthesizes the findings from a series of case studies on the interaction between the PRSP process and the budget. The five studies, Bolivia, Burkina Faso, Cambodia, Tanzania and Vietnam aim to assess the extent to which public finance management and budget allocations reflect the principles and content of the Poverty Reduction Strategy Paper PRSP, hence providing insights into progress in PRS implementation. The cases also shed light on whether the PRSP process itself has fostered more accountable, efficient and pro-poor budget processes and allocations as of 2003.The PRSP process, with its focus on data and information for evidence-based policy-making, open and participatory policy-making processes, poverty results and country-led donor coordination, alignment and harmonization has the potential to significantly improve the pro-poor focus and general accountability of budgeting processes.The cases confront a number of methodological challenges. First, in some countries and sectors, lack of appropriate data constrained the extent to which the research questions could be fully answered. Second, the PRSP remains a relatively recent innovation in all the countries studied and we recognize that many of our findings are preliminary, and require additional confirmation over time. Third, any assessment of the value added of the PRSP approach needs to be cognizant of the initial conditions in country, both to avoid ascribing successes to the PRSP which pre-date its existence, and to temper expectations about what the approach can deliver in a relatively short space of time given the starting point of each country. To address this last challenge, the case studies explicitly acknowledge the pre-existing situation in-country and try to assess the value added of the PRSP process.The four countries studied have a number of common features.Finally, and perhaps most importantly, all five countries share a high-level political commitment to addressing poverty, although the extent to which this commitment permeates throughout government agencies varies from country to country.The five countries, however, also display many distinctive features. Bolivia and Cambodia, for example, both suffer from high degrees of political fragmentation, which in Bolivia has manifested itself as civil unrest on a number of occasions in the last two years. Burkina Faso, Tanzania, and Vietnam, on the other hand, benefit from more stable political systems and an inherited commitment to pro-poor policies from socialist governments.Publication Georgia Public Expenditure Review : Diagnostics of Public Investment Management System(Washington, DC, 2014-06-11)Generating growth and creating jobs within a sustainable fiscal framework is Georgia s biggest macroeconomic challenge. Although Georgia registered rapid growth of 5.7 percent a year during 2010-13, unemployment remains high at 15 percent. New growth companies, especially in tourism and other service sectors, did not generate enough formal or even informal employment. Fiscal policy played a crucial role in Georgia s recent growth performance with a fiscal stimulus driven post-crisis recovery which increased deficit and debt levels followed by fiscal consolidation during 2010-12 when recovery took hold. The weak execution of the budget in 2013 and policy uncertainty were largely responsible for the growth slowdown during the year. Tackling the growth and jobs agenda in Georgia will require significant investment in human and physical capital and the government has a large role to play here. Additional spending, where it is needed, should be undertaken within the fiscal consolidation agenda of the government, designed to help restore the macroeconomic buffers needed to secure stability and sustain confidence in the future. The change in government in 2012 marked a shift in fiscal policy with prioritization of recurrent social expenditures over capital spending, thereby, increasing budget rigidity. During 2012-13, the government raised the benefit levels under the targeted social assistance (TSA) and pensions and introduced universal health care (UHC). As a result, the fiscal deficit is likely to increase from 2.6 percent of gross domestic product (GDP) in 2013 to 3.7 percent in 2014. Over the medium term, an aging population and the need to improve health outcomes and coverage of the poor in social assistance programs will keep social expenditures high at more than 9 percent of GDP. The share of capital expenditures will level off, meanwhile. Such an outcome will reduce the government s flexibility in trimming current expenditures in the future.Publication Rwanda : Technical Assessment on a Proposed Credit(Washington, DC, 2014-09-14)The Public Financial Management (PFM) Sector Strategic Plan (SSP) identifies key challenges and proposes solutions in each program that are translated into a foundation for defining sector priorities and outcomes through FY2017-18. Improving coherence between national strategies, the Medium Term Expenditure Framework (MTEF), and the annual budget process has been identified as an area for improvement under the first program, on economic planning and budgeting. In the second program, on resource mobilization, key challenges are inadequate resource mobilization, resulting in aid dependency at the national level and lack of discretionary revenues at the subnational level. Across the PFM sector, particularly under program 7, on PFM sector and coordination, capacity and skill shortages are identified as key bottlenecks. Capacity and skill shortages are more pronounced at the subnational level, especially on core PFM areas such as accounting, auditing, budgeting, and reporting. NISR made significant progress in the quality, timeliness, and dissemination of data, mainly in the social and demographic domain, under the first National Strategy for Development of Statistics, or NSDS (2009-14). The overarching objectives of NSDS 2 are to produce relevant, reliable, and timely statistics to monitor the progress of EDPRS 2 and to strengthen the NSS.Publication Rwanda : Fiduciary Assessment on a Proposed Credit(Washington, DC, 2014-09-14)A fiduciary assessment for the Rwanda Public Sector Governance PforR was carried out, taking into account recent PFM diagnostic reports and meetings and discussions with key officials in the proposed implementing agencies and other stakeholders. The assessment followed the Draft Guidance Notes on PforR Operations and requirements of OP/BP 9.00, Program for Results. The assessment used the four pillars approach of the Organisation for Economic Co-operation and Development Development Assistance Committee (OECD-DAC) to define the inherent risks in the procurement environment. In line with the Sector Board s practices manual, the potential FM risks for the various PFM elements are rated as low (L), modest (M), substantial (S), or high (H). The assessment is also mindful of the gaps that may exist between form (policies, laws, structures, instructions/manuals) and actual functionality or practices of the PFM system. Mitigation measures are proposed to reinforce the government s PFM reform efforts. Critical measures are included in the PAP.Publication Improving the Quality of Public Expenditure in the Dominican Republic(Washington, DC, 2012)This book addresses the achievements, challenges, and opportunities to improve the quality of public spending. Steps to make such changes have come through monitoring and evaluation approaches that can be replicated or expanded; sectoral efforts to improve the performance of priority programs; Congress's use of information on the results of public spending; the implementation of performance budgeting at subnational levels; and the harmonization of accounting between the three levels of the federal government. All these aspects are key elements of comprehensive reform. Currently, as the book states, accountability focuses on achieving results rather than on centering attention on mere compliance with rules and procedures. In this context, based on a new legal framework, the government of Mexico has decisively promoted results-based management and budgeting. The Performance Evaluation System (SED) was finally established in 2008 with the institution of the principles, concepts, methodologies, guidelines, procedures, and systems that support its operation. Its adoption as a common practice in the Federal Public Administration (APF) process will require a gradual, progressive, systematic learning and continuous improvement that should allow performance evaluation to take root in the APF. This calls for consolidating the Results-Based Budgeting (RBB)-SED in all agencies, expanding its use and improving the quality of the information that feeds it. However, not just the APF benefit will from the implementation of the RBB-SED. As the publication suggests, the approach to an expenditure budget based on performance information offers Congress great opportunities to enhance its regulatory and supervisory functions. The improvement in the quality of Matrices de Indicadores para Resultados (MIRs), program evaluations, and their integration into the budgetary programming cycle also contributes to this purpose.
Users also downloaded
Showing related downloaded files
Publication Doing Business 2014 : Understanding Regulations for Small and Medium-Size Enterprises(Washington, DC: World Bank Group, 2013-10-28)Eleventh in a series of annual reports comparing business regulation in 185 economies, Doing Business 2014 measures regulations affecting 11 areas of everyday business activity: Starting a business, Dealing with construction permits, Getting electricity, Registering property, Getting credit, Protecting investors, Paying taxes, Trading across borders, Enforcing contracts, Closing a business, Employing workers. The report updates all indicators as of June 1, 2013, ranks economies on their overall “ease of doing business”, and analyzes reforms to business regulation – identifying which economies are strengthening their business environment the most. The Doing Business reports illustrate how reforms in business regulations are being used to analyze economic outcomes for domestic entrepreneurs and for the wider economy. Doing Business is a flagship product by the World Bank and IFC that garners worldwide attention on regulatory barriers to entrepreneurship. More than 60 economies use the Doing Business indicators to shape reform agendas and monitor improvements on the ground. In addition, the Doing Business data has generated over 870 articles in peer-reviewed academic journals since its inception.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2011(World Bank, 2011)The 2011 World development report looks across disciplines and experiences drawn from around the world to offer some ideas and practical recommendations on how to move beyond conflict and fragility and secure development. The key messages are important for all countries-low, middle, and high income-as well as for regional and global institutions: first, institutional legitimacy is the key to stability. When state institutions do not adequately protect citizens, guard against corruption, or provide access to justice; when markets do not provide job opportunities; or when communities have lost social cohesion-the likelihood of violent conflict increases. Second, investing in citizen security, justice, and jobs is essential to reducing violence. But there are major structural gaps in our collective capabilities to support these areas. Third, confronting this challenge effectively means that institutions need to change. International agencies and partners from other countries must adapt procedures so they can respond with agility and speed, a longer-term perspective, and greater staying power. Fourth, need to adopt a layered approach. Some problems can be addressed at the country level, but others need to be addressed at a regional level, such as developing markets that integrate insecure areas and pooling resources for building capacity Fifth, in adopting these approaches, need to be aware that the global landscape is changing. Regional institutions and middle income countries are playing a larger role. This means should pay more attention to south-south and south-north exchanges, and to the recent transition experiences of middle income countries.