Publication: Capturing Results a Better Way : Eight Lessons in Productive Data Collection
Loading...
Date
2009-04
ISSN
Published
2009-04
Editor(s)
Abstract
Although many development partners have been discussing impact and evaluation for the last 30 years of international development, there still seems to be disagreement on indicators, impact, and how to collect the data, and discussions are ongoing. Evaluations and impact assessments are crucial for International Finance Corporation (IFC) advisory services projects. They help identify issues in implementing strategies that ultimately stand in the way of realizing the project's goals and provide vital lessons for the success of future endeavors. Based on experiences at the IFC South Asia Enterprise Development Facility (SEDF), the authors want to share some lessons on how to collect monitoring and evaluation (M&E) data in the most effective way and what data to look for.
Link to Data Set
Citation
“Hossain, Mustahid; Firdouse, Monira; Adhikary, Deepak P.. 2009. Capturing Results a Better Way : Eight Lessons in Productive Data Collection. IFC Smart Lessons Brief. © World Bank. http://hdl.handle.net/10986/10562 License: CC BY-NC-ND 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Taking Advantage of a Window of Opportunity(International Finance Corporation, Washington, DC, 2017-02)Rwanda’s government and private sector took a bold step towards achieving a critical reform agenda with the design and implementationof a single window for international trade system. This implementation marked the first successful collaboration among Rwanda’s numerous agencies that over see the country’s cross-border trade. Addressing the demands of a diverse group of stakeholders was certainly daunting, but effective stakeholder engagement and change management efforts have produced results that are exerting a major impact on the efficiency of goods into and transiting Rwanda. Driving the Single Window project was an aspiration for greater collaboration at the level of government-to-government, business-to business and government-to-business. Rwanda’s membership in the East African Community, which is a Single Customs Territory was another critical factor. By addressing national needs and incorporating a regional focus and outreach in the management of cargo, the Rwanda Electronic Single Window has achieved success.Publication A Win for the Private Sector(International Finance Corporation, Washington, DC, 2017-02)Trade Mark East Africa (TMEA) launched its standards harmonization project in 2011 to help businesses cut costs associated with the different standards in force across the East African community (EAC). The first phase of the project will come to an end in June 2017. This project stemmed from the importance of standards development for regional integration and has been done through supporting the national bureaus of standards in achieving regional harmonization. Product standards have a significant impact on trade in goods within the EAC while non-harmonized standards continue to interrupt the smooth flow of goods in the region. This smart lessons describe the challenges to the harmonization process and how the project’s successful implementation is boosting trade within the region.Publication Working with Tajikistan to Develop its First National Commodity Nomenclature of Foreign Economic Activities(International Finance Corporation, Washington, DC, 2017-02)One of the most important instruments of trade facilitation is the commodity nomenclature, which provides a definition of all goods subject to foreign trade. The correct classification of goods forms the basis for determining the appropriate value of a good and for determining the customs duties imposed on a good on import or export. Customs statistics on foreign trade are derived from it, and those statistics in turn serve as a tool for the determination and implementation of customs policy. Commodity nomenclature is used not only at the national level, but also by the World Trade Organization, the World Customs Organization, the United Nations, and other international entities. Importers and exporters or investors in other countries visit customs nomenclature websites thousands of times a day to see the types and levels of customs duties and other charges and trade policy measures that particular countries apply. Trade policy regulations, rules of origin, and trade statistics in almost all of the developed and developing countries are designed and compiled on the basis of customs nomenclatures. This SmartLesson discusses how the Central Asia Trade Logistics Project worked with the Customs Administration of the Republic of Tajikistan on the development of its first national commodity nomenclature.Publication PortNet in Morocco(International Finance Corporation, Washington, DC, 2017-01)In 2008, Morocco’s National Ports Agency launched a project to create a national single-window platform for Morocco’s foreign tr ade. The process was long and difficult, and its success is owing in large part to the leadership and focus demonstrated by PORTNET S.A., the company created in 2012 to be in charge of the project. This SmartLesson describes the steps PORTNET took to forge a strategic alliance between public and private stakeholders in Morocco to achieve a common, mutually beneficial aim: streamline Morocco’s foreign trade procedures and improve its business climate.Publication Taking the First Step to Facilitate Trade in Sudan(International Finance Corporation, Washington, DC, 2017-02)The Republic of Sudan’s seaports used to be known for congestion resulting from the slow processing of imported goods. In response, the government created an ad hoc National Committee on trade facilitation to help streamline the processing of goods coming in and to facilitate trade. This smart lesson describes the steps taken in setting up the National Committee on Trade Facilitation and the challenges involved.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Developing a Trade Information Portal(Washington, DC, 2012-07)A number of countries have introduced or are considering the introduction of a trade information portal as a means of facilitating trade and increasing transparency. For World Trade Organization (WTO) members or countries in the process of acceding to the WTO, a trade information portal will assist in complying with new commitments currently being negotiated as part of the Doha Development Round. The negotiations aim to strengthen the provisions of Article X of General Agreement on Tariffs and Trade (GATT) which currently requires that all regulatory trade related information "shall be published promptly in such a manner as to enable governments and traders to become acquainted with them". In many developing nations, government agency specific websites may not exist and even when they do they are often incomplete, out of date, or the content may not cover the entire spectrum of information that a trader may wish to obtain to ensure compliance with import, export, or transit requirements. It is therefore desirable to create a single platform where all the information relating to trade from all the various agencies is aggregated under one roof and is readily available for searching and viewing. This guide discusses the issues and challenges that developing nations are likely to face when implementing a trade information portal and provides a checklist of practical guidelines for the steps that might be required in order to achieve effective implementation.Publication Doing Business, An Independent Evaluation : Taking the Measure of the World Bank-IFC Doing Business Indicators(Washington, DC : World Bank, 2008)Doing Business (DB), the annual World Bank- International Finance Corporation (IFC) benchmarking exercise launched in 2004, is one of the Bank Group's flagship knowledge products. It aims to measure the costs to firms of business regulations in 178 countries and ranks the countries along 10 dimensions. It also aims to advance the World Bank Group's private sector development agenda by motivating and informing the design of regulatory reforms, enriching international initiatives on development effectiveness, and informing theory. By ranking countries and spotlighting both leaders and laggards, DB has attracted the interest of senior policy makers and is claimed to have inspired reforms on business climate issues. DB's lively communications style has helped give the DB indicators an international profile. The report has five sections: the first chapter reviews the intellectual underpinnings of the DB indicators. The second chapter reports on how DB collects and assembles data. The chapters third and fourth discuss the relevance of the dimensions measured by the exercise and their use inside and outside the Bank. And finally, chapter fifth presents findings and recommendations.Publication A Toolkit for the Evaluation of Financial Capability Programs in Low-, and Middle-Income Countries(World Bank, Washington, DC, 2013)When resources are scarce and social safety nets are weak, households' ability to manage income and assets wisely may be an important determinant of economic security. However, many open questions remain about how households in low and middle-income countries gain and exercise financial capability, and the best ways for governments and the private and nonprofit sector to help increase this capability. With the exception of a small but important number of studies that have recently been completed or are currently under way, robust evidence regarding the efficacy of financial capability interventions is relatively sparse compared to the level of interest and programmatic activity. One reason for this is a lack of systematic evaluation. The toolkit draws from past experience and the experience of the Russia Financial Literacy and Education Trust Fund pilot projects to provide concrete and tangible examples for the reader that illustrate the specific circumstances and challenges in this field. This toolkit is designed for researchers who are interested in conducting an evaluation of a financial capability program and for policy makers and practitioners interested in commissioning an evaluation. It will also be useful to evaluation researchers who want to brush up on a research technique they are less familiar with or who are new to the area of financial capability and financial education, particularly in Low, and Middle-Income Countries (LMIC). This toolkit is intended to be a practical, hands-on guide to designing, conducting, and analyzing financial capability evaluations, with a focus on doing so in LMICs. The toolkit covers a wide range of material on how to design, conduct and analyze evaluations, material that is spread out over the 13 chapters that follow. The chapters are contained within four overarching parts: setting the stage for monitoring and evaluation (M&E): understanding the M&E process and concepts (chapters 2-3); conducting M&E for financial capability programs (chapters 4-7); collecting and analyzing M&E Data for Financial Capability Programs (chapters 8-10); and other Issues in conducting M&E for financial capability programs (chapters 11-14).Publication Practical Guidelines for Effective Bank Resolution(World Bank, Washington, DC, 2007-11)This study adopts a practical approach in developing a set of guidelines on designing a bank resolution framework and implementing efficient bank resolution methods in Latin America. It identifies six pillars that are useful for establishing a bank resolution framework. The study aims to guide policymakers choose from a set of bank resolution methods, by outlining their advantages and disadvantages and establishing efficiency requirements. The focus is on the good-bank/bad-bank approach, which is a type of purchase and assumption mechanism that has increasingly become part of the newer legal frameworks in Latin America. The good-bank/bad-bank approach is an effective bank resolution method because it can be very successful in meeting certain efficiency criteria, including the minimization of contagion costs and preservation of business.Publication Planning, Monitoring, and Evaluation : Methods and Tools for Poverty and Inequality Reduction Programs(World Bank, Washington, DC, 2013-01)As the author enter the second decade of the twenty-first century, governments, international organizations, nongovernmental organizations (NGOs), philanthropic organizations, and civil society groups worldwide are actively focusing on evidence-based policy and increased accountability to stakeholders (results agenda).The widespread implementation of the Results Agenda has generated a plethora of books, guides, academic papers, trainings, and case studies, which has enabled an ongoing maturation process in the field. Consequently, specialists are now better equipped to understand what works under which circumstances. Broadly speaking there are two interrelated questions which must be answered when assessing the sustainability of a government results agenda. First, is the institutional design and practice of government conducive to evidence-based policy making? Second, are the overarching monitoring and evaluation (M&E) methods and specific tools used appropriate for garnering the evidence demanded by government? These series of notes aim to make a small contribution to the latter question by summarizing and highlighting a selection of PM&E methods and the tools that governments and international organizations around the world have developed to put these into practice in their own contexts. The central goal of this initiative is to prompt a process of learning, reflection and action by providing practical information to those whose leadership role requires them to understand PM&E methods and their potential for enhancing evidence-based policy making.
Users also downloaded
Showing related downloaded files
Publication Crime and Violence in Central America : A Development Challenge - Main Report(World Bank, 2011-01-01)Crime and violence are now a key development issue for Central American countries. In three nations El Salvador, Guatemala, and Honduras crime rates are among the top five in Latin America. This report argues that successful strategies require actions along multiple fronts, combining prevention and criminal justice reform, together with regional approaches in the areas of drug trafficking and firearms. It also argues that interventions should be evidence based, starting with a clear understanding of the risk factors involved and ending with a careful evaluation of how any planned action might affect future options. In addition, the design of national crime reduction plans and the establishment of national cross-sectoral crime commissions are important steps to coordinate the actions of different government branches, ease cross-sectoral collaboration and prioritize resource allocation. Of equal importance is the fact that national plans offer a vehicle for the involvement of civil society organizations, in which much of the expertise in violence prevention and rehabilitation resides. Prevention efforts need to be complemented by effective law enforcement. The required reforms are no longer primarily legislative in nature because all six countries have advanced toward more transparent adversarial criminal procedures. The second-generation reforms should instead help deliver on the promises of previous reforms by: (i) strengthening key institutions and improving the quality and timeliness of the services they provide to citizens; (ii) improving efficiency and effectiveness while respecting due process and human rights; (iii) ensuring accountability and addressing corruption; (iv) increasing inter-agency collaboration; and (v) improving access to justice, especially for poor and disenfranchised groups. Specific interventions reviewed in the report include: information systems and performance indicators as a prerequisite to improve inter-institutional coordination and information sharing mechanisms; an internal overhaul of court administration and case management to create rapid reaction, one-stop shops; the strengthening of entities that provide legal counseling to the poor and to women; and the promotion of alternative dispute-resolution mechanisms and the implementation of community policing programs.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Guide to the Debt Management Performance Assessment Tool(Washington, DC, 2008-02-05)The purpose of this document is to provide guidance and supplemental information to assist with country assessments of debt management performance, using the Debt Management Performance Assessment (DeMPA) tool. The DeMPA is a methodology used for assessing public debt management performance through a comprehensive set of 15 performance indicators spanning the full range of government Debt Management (DeM) functions. It is based on the principles set out in the International Monetary Fund (IMF) and World Bank guidelines for public debt management, initially published in 2001 and updated in 2003. It is modeled after the Public Expenditure and Financial Accountability (PEFA) framework for performance measurement of public financial management. The DeMPA has been designed to be a user-friendly tool to undertake an assessment of the strengths and weaknesses in government DeM practices. This guide provides additional background and supporting information so that a no specialist in the area of debt management may undertake a country assessment effectively. The guide can be used by assessors in preparing for and undertaking an assessment. It is particularly useful for understanding the rationale for the inclusion of the indicators, the scoring methodology, and the list of supporting documents or evidence required, and the questions that could be asked for the assessment.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication The Mexican Social Protection System in Health(World Bank, Washington DC, 2013-01)With a population of 113 million and a per-capita Gross Domestic Product, or GDP of US$10,064 (current U.S. dollars), Mexico is one of the largest and highest-income countries in Latin America and the Caribbean (LAC). The country has benefited from sustained economic growth during the last decade, which was temporarily interrupted by the financial and economic crisis. Real GDP is projected to grow 3.8 percent and 3.6 percent in 2012 and 2013, respectively (International Monetary Fund, or IMF 2012). Despite this growth, poverty in the country remains high; with half of the population living below the national poverty line. The country is also highly heterogeneous, with large socioeconomic differences across states and across urban and rural areas. In 2010, while the extreme poverty ratio in the Federal District and the states of Colima and Nuevo Leon was below 3 percent, in Chiapas, Guerrero, and Oaxaca it was 25 percent or higher. These large regional differences are also found in other indicators of well-being, such as years of schooling, housing conditions, and access to social services. This case study assesses key features and achievements of the Social Protection System in Health (Sistema de Proteccion Social en Salud) in Mexico, and particularly of its main pillar, Popular Health Insurance (Seguro Popular, PHI). It analyzes the contribution of this policy to the establishment and implementation of universal health coverage in Mexico. In 2003, with the reform of the General Health Law, the PHI was institutionalized as a subsidized health insurance scheme open to the population not covered by the social security schemes. Today, the PHI covers all of its intended affiliates, about 52 million people