Publication: Monitoring and Evaluating the Poverty Impacts of Agricultural Water Investments
Loading...
Date
2006-06
ISSN
Published
2006-06
Author(s)
Editor(s)
Abstract
Monitoring and evaluating (M&E) the poverty impact of agricultural water investments may allow some conclusions about returns on different types of investments and their contributions to poverty reduction. This paper recommends the following: involve beneficiaries early in the M&E process -- broad consultations and early involvement of users in the design and implementation of the M&E system will do much to build consensus and ownership; use beneficiary self-assessments and other participatory approaches so that assessments can be made midcourse -- there may be a long time lag in realizing a reduction in poverty from agricultural water-related projects, and the poverty impact often cannot be evaluated until well after a project ends; keep the number of indicators collected within manageable proportions; and ensure that a good baseline survey is undertaken -- without a proper baseline, it is difficult to monitor progress and evaluate the impacts of investments.
Link to Data Set
Citation
“Sur, Mona. 2006. Monitoring and Evaluating the Poverty Impacts of Agricultural Water Investments. Agricultural and Rural Development Notes; No. 15. © World Bank. http://hdl.handle.net/10986/9606 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Reconstructing Baseline Data for Impact Evaluation and Results Measurement(World Bank, Washington, DC, 2010-11)Many international development agencies and some national governments base future budget planning and policy decisions on a systematic assessment of the projects and programs in which they have already invested. Results are assessed through Mid-Term Reviews (MTRs), Implementation Completion Reports (ICRs), or through more rigorous impact evaluations (IE), all of which require the collection of baseline data before the project or program begins. The baseline is compared with the MTR, ICR, or the posttest IE measurement to estimate changes in the indicators used to measure performance, outcomes, or impacts. However, it is often the case that a baseline study is not conducted, seriously limiting the possibility of producing a rigorous assessment of project outcomes and impacts. This note discusses the reasons why baseline studies are often not conducted, even when they are included in the project design and funds have been approved, and describe strategies that can be used to 'reconstruct' baseline data at a later stage in the project or program cycle.Publication Handbook on Impact Evaluation : Quantitative Methods and Practices(World Bank, 2010)This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Impact Evaluations in Agriculture(Washington, DC: World Bank, 2011)This report seizes the opportunity to learn from existing evidence by analyzing lessons derived from impact evaluations produced between 2000 and January 2009 to begin to discern what has been effective in agriculture. It is part of a broader effort being undertaken by the Independent Evaluation Group (IEG) of the World Bank to understand how impact evaluations can help improve performance and broadly disseminate those lessons. Specifically, the report has three objectives: 1) assess the current state of impact evaluations in the agriculture sector and highlight challenges that users face when trying to answer what works best in the sector; 2) derive a taxonomy of agriculture interventions evaluated using impact evaluation methodology, and identify the most common constraints for farmers and addressed by those interventions; and 3) highlight what can be said about the impact of different interventions on agricultural outcomes (focusing on productivity and farm income). Also, point to areas for future research of agricultural interventions to broaden the use of this analysis. The rest of this chapter provides some necessary definitions for the report, outlines the conceptual framework, and presents a brief background on the selection of impact evaluations (IEs) from the evaluation literature. Chapter two provides a profile of the evidence, including IE characteristics and challenges encountered in the analysis. Chapter three looks within the interventions and presents a formal taxonomy of all agricultural interventions represented in the group analyzed for the report. Chapter four delves into the evidence by presenting the primary constraints dealt with in the interventions, the results reported by the evaluations, and some lessons that may be incorporated into future project design. Chapter five concludes with some general remarks.Publication China Watershed Management Project : Development of a Monitoring and Evaluation System, Final Report(Washington, DC, 2006-06)The objective of this assignment was to develop a Monitoring and Evaluation (M&E) system for watershed management in the Loess Plateau area. The M&E system for the China Watershed Management Project (CWMP) has been developed on the base of the M&E system that has been implemented during the previous two phases of the World Bank Loess Plateau Project. The final report presents the main outcomes of this process. The major findings of the M&E systems review are summarized in the following chapter two. The steps of developing and agreeing the M&E framework are presented in chapter three. Chapter four will describe the specific features of and challenges for watershed M&E before chapter five goes into a detailed presentation of the M&E framework. The M&E framework is most significant outcome of this assignment because it brings together all the agreements and considerations around institutional and methodological issues of M&E. The key parameters for M&E are defined in the framework, but they are further specified into operational steps in the M&E guidelines which are prepared as a separate document.
Users also downloaded
Showing related downloaded files
Publication Boom, Bust and Up Again? Evolution, Drivers and Impact of Commodity Prices: Implications for Indonesia(World Bank, Jakarta, 2010-12)Indonesia is one of the largest commodity exporters in the world, and given its mineral potential and expected commodity price trends, it could and should expand its leading position. Commodities accounted for one fourth of Indonesia's Gross Domestic Product (GDP) and more than one fifth of total government revenue in 2007. The potential for further commodity growth is considerable. Indonesia is the largest producer of palm oil in the world (export earnings totaled almost US$9 billion in 2007 and employment 3.8 million full-time jobs) and the sector has good growth prospects. It is also one of the countries with the largest mining potential in view of its second-largest copper reserves and third-largest coal and nickel reserves in the world. This report consists of seven chapters. The first six chapters present an examination and an analysis of the factors driving increased commodity prices, price forecasts, economic impact of commodity price increases, effective price stabilization policies, and insights from Indonesia's past growth experience. The final chapter draws on the findings of the previous chapters and suggests a development strategy for Indonesia in the context of high commodity prices. This section summarizes the contents of the chapters and their main findings.Publication Poverty Reduction in Indonesia : Constructing a New Strategy(Washington, DC, 2001-10-29)The objective of the report is to point at the need for a new poverty strategy, and the areas of action it should cover, where each area should be specifically discussed, addressing the lives of Indonesia's poor, and the tradeoffs policymakers will need to consider, based on the belief that this poverty strategy should emerge from a broad dialogue among stakeholders. First, in broadening poverty, the report looks at the facts of the late 1990s crisis, which revealed the precariousness of Indonesia's gains in reducing expenditure-based poverty. Thus to extend those gains, the poverty strategy needs to be defined, and then redeveloped by acknowledging the multidimensional reality of poverty, and, it is this notion which will lead to making the strategic choices. Second, within the country's political transition to a democratic, decentralized mode of governance, a poverty strategy needs to be consistent with an empowered populace, and democratic policymaking mechanisms. In creating a policy environment for raising the incomes of the poor, the report identifies the resumption of rapid sustainable growth, with rising real wages, employment opportunities, and, limited inflation, including the economic empowerment of the poor, enhanced by poverty-focused public expenditures. Inevitably, the provision of core public services is an area which should address the people's will in local governance policies, focusing on education and health, while providing appropriate infrastructure, and developing safety nets.Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Impact Evaluation in Practice, Second Edition(Washington, DC: Inter-American Development Bank and World Bank, 2016-09-13)The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.Publication World Development Report 2009(World Bank, 2009)Places do well when they promote transformations along the dimensions of economic geography: higher densities as cities grow; shorter distances as workers and businesses migrate closer to density; and fewer divisions as nations lower their economic borders and enter world markets to take advantage of scale and trade in specialized products. World Development Report 2009 concludes that the transformations along these three dimensions density, distance, and division are essential for development and should be encouraged. The conclusion is controversial. Slum-dwellers now number a billion, but the rush to cities continues. A billion people live in lagging areas of developing nations, remote from globalizations many benefits. And poverty and high mortality persist among the world’s bottom billion, trapped without access to global markets, even as others grow more prosperous and live ever longer lives. Concern for these three intersecting billions often comes with the prescription that growth must be spatially balanced. This report has a different message: economic growth will be unbalanced. To try to spread it out is to discourage it to fight prosperity, not poverty. But development can still be inclusive, even for people who start their lives distant from dense economic activity. For growth to be rapid and shared, governments must promote economic integration, the pivotal concept, as this report argues, in the policy debates on urbanization, territorial development, and regional integration. Instead, all three debates overemphasize place-based interventions. Reshaping Economic Geography reframes these debates to include all the instruments of integration spatially blind institutions, spatially connective infrastructure, and spatially targeted interventions. By calibrating the blend of these instruments, today’s developers can reshape their economic geography. If they do this well, their growth will still be unbalanced, but their development will be inclusive.