63385 Can the Poor Influence Policy? Participatory Poverty Assessments in the Developing World Second Edition Includes a new chapter on how to involve the poor in poverty reduction strategies Caroline M. Robb INTERNATIONAL MONETARY FUND THE WORLD BANK Washington, D.C. Washington, D.C. © 1999, 2002 The International Bank for Reconstruction and Development / The World Bank 1818 H Street, NW Washington, DC 20433 All rights reserved Manufactured in the United States of America First published 1999. Second Edition 2002 1234040302 The findings, interpretations, and conclusions expressed here are those of the author(s) and do not necessarily reflect the views of the Board of Executive Directors of the World Bank or the governments they represent. The World Bank cannot guarantee the accuracy of the data included in this work. The boundaries, colors, denominations, and other information shown on any map in this work do not imply on the part of the World Bank any judgment of the legal status of any territory or the endorsement or acceptance of such boundaries. Rights and Permissions The material in this work is copyrighted. No part of this work may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or inclusion in any information storage and retrieval system, without the prior written permission of the World Bank. The World Bank encourages dissemination of its work and will normally grant permission promptly. For permission to photocopy or reprint, please send a request with complete informa­ tion to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA, telephone 978-750-8400, fax 978-750-4470, www.copyright.com. All other queries on rights and licenses, including subsidiary rights, should be addressed to the Office of the Publisher, World Bank, 1818 H Street NW, Washington, DC 20433, USA, fax 202-522-2422, e-mail pubrights@Worldbank.org. Cover photo credit: Curt Camemark, 1993; Senegal ISBN 0-8213-5000-5 Library of Congress Cataloging-in-Publication Data has been applied for. Contents Foreword to the Second Edition vii Foreword to the First Edition xi Preface to the Second Edition xv Acknowledgments xix Abbreviations and Acronyms xxi Summary xxv 1. A Status Report 1 Context 2 What Is a Participatory Poverty Assessment? 4 How Are PPAs Conducted? 7 What Is the Current Status of PPAs? 18 Notes 21 2. Impact of the PPA 23 Deepening the Understanding of Poverty and Combining Data Sources 26 Attitudes and Policy Change 30 Strengthening the Capacity to Deliver Policy 34 Determinants of the Level of Impact 35 Notes 43 3. Emerging Good Practice 45 At the World Bank: Initial Steps and Follow-Up 45 At the Country Level: Linking PPAs to the Process of Policymaldng 53 At the Community Level: Including the Poor 61 Analysis and Synthesis: Combining PPAs with Household Survey Data 67 Notes 85 iii iv CONTENTS 4. Linking PPAs to Poverty Reduction Strategies 87 Background to the Poverty Reduction Strategy Paper 87 How to Include the Poor in the PRSP Process: Operational Implications 90 Poverty Impact Assessments of Macroeconomic and Structural Reforms 94 Country Examples of the Links between the PPAs and PRSPs 95 Next Steps for PPAs 103 The Challenge for PPAs 104 Notes 105 Appendixes 107 Appendix A. Methodology 108 Appendix B. Impact 121 Appendix C. Poverty Assessments, Completed and Scheduled (by Country), Fiscal Year 1989-2000 135 Appendix D. Examples of PRA Exercises in Thailand (1998) and Zambia (1996) 137 Appendix E. Country Case Examples 138 Appendix F. Social Aspects of the East Asian Financial Crisis: Perceptions of Poor Communities 175 Appendix G. Methodology of This Review 188 Bibliography 189 Boxes 1. Background to the World Bank's Participatory Poverty Assessment 5 2. Participatory Poverty Monitoring in Zambia 12 3. World Bank Participatory Poverty Assessments: Status Report, March 2001 19 4. Examples of Planned PPAs 20 5. Enriching the Diagnosis of the Nature of Poverty 26 6. Examples of Explanations Provided by PPAs 29 7. Can the Poor Influence the Budget? Case Example from Uganda 36 8. Twelve Hallmarks of Good PPAs 46 9. What Is Poverty Reduction? 47 10. Factors for the World Bank to Consider to Increase the Impact ofPPAs 54 11. Handing Over the Document Does Not Equal Ownership 59 12. Participation Is More Than Holding Workshops 60 13. Factors to Consider at the National Level to Increase the Impact of PPAs 62 CONTENTS v 14. Factors to Consider at the Community Level to Increase the Impact of PPAs 68 15. Summary of Emerging Good Practice for Integrating Data Sets 84 16. Why PRSPs Are Different 88 AI. Creeping Crisis in Vietnam 176 A2. How People Are Coping in Khon Kaen 186 Figures 1. Good Practice Research Cycle 13 2. PPA Impact by Quality of Research Team 40 3. PPA Impact by Quality of PPA Manager and Level of Bank Management Support 41 4. PPA Impact by Link to Poverty Assessment 41 5. PPA Impact by World Bank and Government Ownership 42 6. PPA Impact by Level of Policymaker Involvement 43 7. Information Filters and Biases: Case Study of the PPA in Zambia 77 8. PRSP Operational Linkages 89 AI. Social Impacts of the East Asian Crisis in Thailand 177 A2. Perceptions of the Impact of the East Asian Financial Crisis: Results of a Focus Group in the Philippines 184 Tables 1. Summary of PPA Typical Characteristics 8 2. Case Examples of PPA Features at a Glance 9 3a. Methodologies Used 10 3b. Time Spent in the Field 10 3c. Number of Communities Assessed 10 3d. Agency Conducting the Fieldwork 10 3e. Cost 11 3f. Year Fieldwork Was Conducted 11 4. Comparison of Participatory Methodologies 14 5. Range of PPA Impacts 24 6. Summary of PPA Impacts 38 7. Summary of Impact Variables 39 8. Summary of Household Survey Types 70 9. Characteristics of Household Surveys and PPAs 72 10. Summary of the Ways Data Sets Can Be Combined 78 11. Impact of PPAs on Poverty Reduction Strategy Papers 98 12. How the Poor Influenced the PRSP in Uganda 102 AI. PPA Outputs and Applications 147 A2. Links between Poverty Analysis and Policy Change 163 Foreword to the Second Edition e are united today by our belief that widespread poverty in the W midst of global prosperity is both unsustainable and morally unac­ ceptable. Now, more than ever before, we need to focus on the role our organizations can best play in the fight against poverty, and we must constantly ask ourselves, How does what we are doing affect the poor? Can the poor themselves help to answer this question? If so, how can we reach the poor, and should the poor influence policy? We think they can and indeed must. The question therefore is not whether we should include the poor but how? This is the subject of Can the Poor Influence Policy? This influential book documents and analyzes the development of a comprehensive methodology that shows how to consult directly with the poor and link the results to the national policy dialogue. This methodology was developed in partnership with gov­ ernments, nongovernmental organizations (NGOs), and other civil soci­ ety groups. The importance of including the poor became even clearer during the East Asian crisis. By directly consulting poor people, policymakers found that there was not only a financial crisis but another profound crisis that affected the poor directly. When we visited the slums and villages, the issues poor people face became apparent. What we learned was that the poor have a very clear idea of what they want. They are able to analyze their poverty, suggest solutions, and prioritize policies. Poor people want a chance and they want an opportunity to transform their lives. In 1999, the World Bank, therefore, spoke of "the other crisis" in East Asia, the human crisis of those condemned to poverty as well as those who had recently found hope only to see it roughly snatched away. There is an urgent need to look beyond financial solutions, to combine social and structural needs with macroeconomic solutions. We must therefore learn to have a debate in which the need for often drastic change can be balanced with advancing the interests of the poor. Only then will we vii viii FOREWORD TO THE SECOND EDITION arrive at solutions that are sustainable. Only then will we be able to bring the international financial community and local citizens with us. Both the International Monetary Fund (IMF) and the World Bank are at the heart of an integrated international effort to ensure that global­ ization benefits everyone. We should follow a concept that recognizes that the impacts of poverty cannot be separated from the macroeco­ nomic dimension and that extreme income inequalities between nations must not be allowed to become a major source of political instability in the world. Poverty is an issue for everyone, and the poor must be full partners and participants. Operating within that concept, a refocused IMF must be aware of poverty issues outside its core areas of responsi­ bility, and it must work in a complementary fashion with the organiza­ tions primarily responsible for those issues. The Fund and the World Bank are thus redoubling their efforts to ensure a closer and stronger partnership to better serve our member countries. During our recent joint trip to Africa, we recognized in Africa an awareness that any effort to reduce poverty must start with-and build upon-peace, democracy, and good governance at home. We must give countries the scope to pursue their national interests and responsibili­ ties-while preserving their cultural identities. We recognize that our programs are most effective when there is broad understanding of and support for our work. Gaining support for country programs requires a stronger relationship with parliaments and civil society. Therefore, we must explain our advice better and expand our dialogue with the pub­ lic to reach the regional and local levels. Both the World Bank and the IMF agree that world poverty is the paramount challenge of the 21st century and that decisive progress must be made in meeting the established international development goals set for the year 2015. The fight against poverty will succeed only if it is based on a strategy designed by the country itself, rather than one imposed from outside. For that reason, in September 1999, the World Bank and the IMF launched Poverty Reduction Strategy Papers (PRSPs), which are owned by the country, developed with broad participation, and clearly linked to agreed-on international development goals. The Fund will make more explicit the links between poverty and our main lending instrument to poor countries, the Poverty Reduction and Growth Facility. This can be done by using various data sources, includ­ ing participatory poverty assessments (PPAs). The World Bank will strengthen the poverty focus of its lending through the Poverty Reduc­ tion Support Credit, which is closely linked with implementing PRSPs andPPAs. The PRSP process seeks to strengthen further the link between debt relief, development assistance, and poverty reduction. It is a way for a FOREWORD TO THE SECOND EDITION ix country to draw on the best available knowledge in the design of its poverty reduction strategy-by involving donors, the private sector, civil society, as well as the poor. This new participatory approach is changing the way we do business. In this book, Caroline Robb shows how participatory methods and approaches can enable poor people to analyze their situations and express their priorities, and how these can fundamentally differ from those assumed by policymakers. The book is essential reading for poli­ cymakers who wish to understand how to improve consultation with the poor; for governments, NGOs, and donors who wish to undertake PPAs; and for all those embarking on PRSPs. Horst Kohler, Managing Director J~ James D. Wolfensohn, President International Monetary Fund The World Bank Group Foreword to the First Edition n understanding of the nature and causes of poverty lies at the heart A of designing economic and social strategies for development. Much of the analytic work on poverty critical to such an understanding has treated the poor as an object of inquiry: Empirical investigations have been conducted to explain outcomes for the poor in terms of their charac­ teristics, the environment in which they live, and the policies of govern­ ments and other agents toward them. This tradition of work has been critical to deepening our comprehension of poverty and of the options to alleviate it. There is another tradition of inquiry, however-one that seeks to understand the experience and causes of poverty from the perspective of the poor themselves. Investigations of the poor within this broad tra­ dition include, for example, the work of anthropologists and others who have undertaken intensive studies of villages or poor urban areas span­ ning decades. In the context of development endeavors, a relatively recent component of this tradition involves the use of participatory tech­ niques. (Although these techniques have often been linked to specific projects, they increasingly have been associated with broader diagnostic investigations of the nature and causes of poverty and of the potential for policy to make a difference.) A variety of techniques have been devel­ oped to support this participatory process. All have the aim of giving the poor a voice, a voice that is not distorted by the mind-set of the investi­ gators. Typically, the techniques also have the objective of capturing the perspective of the poor in a way that can be communicated to decision­ makers in government and development agencies. Both aspects are important for the ultimate objective of empowering the poor. Poverty studies have become of critical importance to the World Bank in the past decade, since the reaffirmation of poverty reduction as its core purpose. Particularly in the wake of the World Development Report (WD R) 1990 on Poverty, the Bank has become one of the major agents and sup­ porters of the study of poverty, through both a series of country-specific xi xii FOREWORD TO THE FIRST EDITION poverty assessments and a wide range of other research. Within this experience, the Bank is probably best known for its use of traditional household surveys, especially multipurpose surveys (such as the Living Standards Measurement Studies) that use questionnaires to document a range of dimensions of household well-being. Indeed, the World Bank has sometimes been characterized as working exclusively with a con­ sumption- or income-based definition of poverty. This has never been true (for example, the WDR 1990 placed considerable emphasis on the lack of health and education as dimensions, as well as causes, of poverty). However, it is true that most poverty assessments have iden­ tified the poor in terms of a poverty line, based on a country-specific assessment of the minimum consumption required to meet basic nutri­ tional standards and to effectively participate in a society. The Bank is less well known for its increasing use of participatory techniques in both project and diagnostic work. The present study sur­ veys one part of this trend: the use of participatory techniques in poverty assessment work. As Caroline M. Robb shows, their use rose signifi­ cantly in the mid-1990s and has become common in poverty assess­ ments conducted over the past three years or so. These participatory poverty assessments have already yielded rich results, sometimes con­ firming and sometimes contradicting the conclusions of more tradi­ tional questionnaire-based national household surveys. They confirm that the poor themselves see poverty as having many dimensions­ including lack of material resources and ill health, but also including a vulnerability to adverse economic developments or, in some communi­ ties, to physical violence. The assessments provide insight into the nature of coping mechanisms, particularly the role of local networks (or social capital), and have the potential to provide telling information on the effectiveness-or ineffectiveness-of public and private institutions. This participatory work can, and should, also playa role in the design and ongoing evaluation of interventions. Participatory poverty work is expected to be of growing importance to the World Bank in diagnostic, policy, and project work. We already see this in some of the early assessments of the social aspects of the East Asian economic crisis. And while the World Development Report 1990 made limited use of the participatory tradition, one of the major studies in the lead-up to the next WDR on poverty and development (which will be released in September 2000) combines new studies and a syn­ thesis of participatory poverty analyses to present the perspective of the poor on the nature of poverty, trends in various dimensions of poverty, and the utility of formal and informal institutions that address the causes and conditions of poverty. Finally, we need to emphasize that tradi­ tional household surveys and participatory poverty work are funda­ FOREWORD TO THE FIRST EDITION xiii mentally complements, not substitutes-and certainly not rivals. They mutually inform each other, to everyone's benefit. Recent Living Stan­ dards Measurement Studies increasingly make use of subjective assess­ ments of poverty, while other new studies make use of participatory and questionnaire-based approaches in a structured, complementary way. Developing powerful and effective diagnoses of the causes of poverty, and appropriate treatments to reduce poverty, requires both well-designed quantitative investigation and giving a genuine voice to poor people. Gloria Davis Michael Walton Director, Social Development Director, Poverty Reduction and Chief Economist, Human Development Preface to the Second Edition n 1999, when the first edition of this book was published, many devel­ I opment practitioners and policymakers did not believe that including the poor in the policy dialogue was credible or even feasible. Since then, there has been a shift in development thinking: the debate has moved from explaining why the poor should be included to how they can be included. As one of the International Monetary Fund's (IMF) first two social development specialists, I have witnessed this change from inside both the World Bank and the IME This book offers some insights as to how this can be done. This shift in thinking is occurring in a worldwide context of rapid and accelerating globalization, which has caused an equally rapid change in poor people's aspirations and awareness. Within the context of aid and development, during the 1990s there was growing evidence that aid per­ forms best in countries where governments are committed to develop­ ment and reform. It is also widely accepted today that to substantially reduce poverty, it is essential to implement both economic policies that promote growth and social policies and sectoral programs that directly improve the living conditions of the poor. As a consequence, donors now support nationally owned poverty reduction strategies (PRSs). This emphasis on policies that reduce poverty was also behind the launch of the enhanced Heavily Indebted Poor Countries (HIPC) Initiative at the G7 Summit in Cologne in mid-1999, which made debt relief conditional on a country's formulation of a poverty reduction framework That approach has been welcomed by many civil society organizations. In response, aid agencies have increasingly emphasized a participa­ tory process of developing PRSs, which promotes the empowerment of the poor, builds partnerships to support the PRSs, and fosters ownership, accountability, and transparency. While this implies new, more open and collaborative power relationships, the necessary changes at the institu­ tional, procedural, and individual levels are likely to be achieved only over time (see Institute of Development Studies forthcoming). xv xvi PREFACE TO THE SECOND EDITION Within the World Bank and IMF, some procedural changes have been introduced. In response to the wider global context, and in recognition that the East Asian crisis had not just financial but also social impacts that negatively affected many of the poorest and most vulnerable in the region (Wolfensohn 1998), the World Bank introduced the comprehen­ sive development framework (COF) in 1999. The COF focuses on a more holistic approach to development by seeking a better balance in policy­ making between interdependent elements of development-social, structural, human, governance, environmental, economic, and finan­ cial. The COF also emphasizes partnerships between governments, donors, civil society, the private sector, and other development actors, and stresses the importance of the country's being in the lead, both own­ ing and directing the development agenda, with the Bank and other partners each defining their support in their respective plans. Last year, the World Bank published the World Development Report (WDR) 2000/2001: Attacking Poverty (2001). Some of the research for the WDR built on the results of participatory poverty assessments (PPAs), as discussed in the first edition of this book. The WDR reaffirms the con­ clusion of the first edition by stressing a broader definition of poverty that includes not only low incomes and low consumption but also lack of education, poor nutrition and health, powerlessness, vulnerability, lack of respect and dignity, and a lack of trust in formal institutions because of corruption and irrelevance. The WDR also stresses the fun­ damental role of institutional and social change in strengthening devel­ opment processes, and the importance of including poor people in development planning. It proposes a strategy for attacking poverty in three ways: promoting opportunity, facilitating empowerment, and enhancing security. The World Bank is now focusing on how to link this strategy to its operations. The COF and other donor frameworks have provided the basis for the introduction of the Poverty Reduction Strategy Paper (PRSP), to be developed by the countries in consultation with civil society, including the poor. Henceforth, programs supported by the Bank and IMF will be based on the government-driven poverty reduction strategies elabo­ rated in the PRSPs. The PRSs also provide the basis for debt relief under HIPC, as well as for all World Bank and IMF concessionallending. As a result, the IMF-supported programs will now be based on poverty out­ comes as well as on sound macroeconomic frameworks. This is a major step. In the short period since their introduction, the COF and the PRSs have changed the way the World Bank and the IMF conduct their oper­ ations, and PRSs have the potential to create policy space for the poor to be directly involved in the policymaking process. xvi PREFACE TO THE SECOND EDITION xvii Since the introduction of the PRSs, I am constantly being asked by economists and by government policymakers: Is it really possible to include the poor in policymaking? The answer is yes. This revised edi­ tion lays out how to include the poor using the participatory poverty assessment. This tried and tested method was developed in partnership with nongovernmental organizations (NGOs), government, and aca­ demic institutions, and has been undertaken in more than 60 countries worldwide during the past decade. A new chapter has been added to this second edition that discusses how to include the poor, through a PPA, in the development of poverty reduction strategies. In addition, this second edition draws on new PPA case examples. The first edition underscored the importance of linking the PPA process to policymaking, since past experience has shown that simply present­ ing policymakers with new information generated through a PPA does not guarantee policy change. In order to increase their impact, many of the new PPAs have been more closely linked to the political context of policy choice and change. The challenge now is to move from isolated PPA research studies to ensuring that PPA consultations become part of the broader national policy dialogue and political decisionmaking, as well as part of a system to monitor the implementation of the commitments made by govern­ ments and donors. Only then will there be more transparency, account­ ability, and longer lasting change. Caroline M. Robb December 2001 Acknowledgments ,....,ru.s book arose from discussions, meetings, and workshops with peo­ ~ pIe from a wide variety of organizations and communities, to all of whom I am very grateful. I particularly thank Robert Chambers (Institute of Development Studies [IDS}) for his unfailing inspiration, encourage­ ment, and direction. In addition, substantial contributions were made by Kimberly Chung (Brown University), John Gaventa (lDS), Jeremy Hol­ land (University of Swansea), Andrew Norton (Department for Interna­ tional Development-United Kingdom [DFID]), Ben Osuga (Swinga, Uganda), and Dan Owen (London School of Economics). Additional com­ ments were provided by Nancy Alexander (Bread for the World Institute), Bella Bird (DFID), Karen Brock (IDS), Elizabeth Gomart (Consultant), Richard Holloway (Private Agencies Collaborating Together), Ramesh Singh (Action Aid, Vietnam), and Joachim Theis (Save the Children, Viet­ nam). I also thank the local research teams in case studycountries, who under­ took the fieldwork, and the civil society institutions, government agen­ cies, and community members who gave their time so freely to help in this study: In Zambia, Clare Barkworth and Cosmas Mambo (Social Recovery Project, Zambia), Peggy Chibuye (World Bank, Resident Mis­ sion), Silverio Chamuka, Helen Muchimba, Hope Kasese, Fanwell Kon­ dolo, Mulasikwanda Liswaniso, Kwibisa Liywalii, John Milimo, Eddie Mwanza, Malako Nabanda, and Lizzie Peme (Participatory Assessment Group), and Fred Mutesa and Stephen Muyakwa (University of Zambia); in Costa Rica, Carmen Camacho (UNICEF), Betsy Murray (World Bank, Resident Mission), and Pablo Sauma (Ministry of Economic Planning); in Pakistan, the Association for Development of Human Resources, Muham­ mad Ahsan Ashraf, Asif Farooki, and Parvez Tahir; and in Mozambique, Yussuf Adam (Universidade Eduardo Mondlane). At the Bank, Michael Walton, Gloria Davis, Ishrat Hussain, and Aubrey Williams sponsored the research and publication, and guided the research for the first edition of this book. For the second edition, the World Bank xix xx ACKNOWLEDGMENTS (John Page, Poverty Reduction Group) and the IMF (G. E. Gondwe, Africa Deparbnent) jointly sponsored the research and publication. I particu­ larly thank Michael Walton (World Bank) for providing me with detailed comments on draft copies of this book and for his leadership and valuable insights, which were instrumental to the production of this book. I also thank Anupam Basu (IMF) for providing advice and detailed comments on the book's second edition. Soniya Carvalho, John Clark, Nora Dud­ wick, James Edgerton, Paul Francis, and Jenny Rietbergen-McCracken provided substantial contributions at all stages of the research. The peer reviewers were Jeanine Braithwaite, Jesko Hentschel, and Peter Lanjouw. Comments on earlier drafts of the book were provided by Mark Blackden, Lionel Demery, Paula Donnelly-Roark, Kene Ezemenari, Christopher Gibbs, Bruce Harris, Eugene Henkel, Ernesto Hernandez-Cam, Jack van Holst-Pelleken, Emmanuel Jimenez, Steen Jorgensen, Mary Judd, Valerie Kozel, Alexandar Marc, TIm Marchant, David Marsden, Caroline Moser, Deepa Narayan, Adega Ouma, Valeria Pena, Gill Perkins, Nadine Poupart, Jacomina de Regt, Claude Salem, Larry Salmen, Parmesh Shah, Veena Siddarth, Andrew Steer, Roger Sullivan, Maurizio Tovo, Tosca Van Vijfeijken, Frederick WhelTJ" and Michael Woolcock. At the Bank's Office of the Publisher, Hank Chase, Connie Eysenck, Dan Kagan, Alan Kahan, Nicki Marrian, Don Reisman, and Janet Sasser, and at the IMF's office, David Cheney and Lori-Michele Newsom contributed editorial, design, and production expertise. Abbreviations and Acronyms ADB Asian Development Bank AMREF African Medical and Research Foundation (Kenya) ASAFE Association pour la Promotion de la Femme Entrepreneur BA Beneficiary assessment CAP Community action plan CAS Country assistance strategy (World Bank) CDF Comprehensive development framework CEDEP Centre for Development of People (Ghana) CEM Country economic memorandum (World Bank) CEP-UEM Centro de Estudos da Popula~ao, Universidade Eduardo Mondlane (Mozambique) CFA Communaute Financiere Africaine crr Composite impact index COD Country Operations Department (World Bank) CSO Central Statistics Office CWIQ Core Welfare Indicators Questionnaire DANIDA Danish Agency for International Development DFID Department for International Development-United Kingdom ENVSP Environmental and Social Policy Department (World Bank) EU European Union FAO Food and Agriculture Organization FDI Foreign direct investment GDP Gross domestic product GTZ German Technical Cooperation HIES Household Income and Expenditure Survey H1PC Heavily indebted poor countries HRD Human resources development xxi xxii ABBREVIATIONS AND ACRONYMS IBRD International Bank for Reconstruction and Development lOF Institutional Development Fund (World Bank) lORC International Development Research Centre IDS Institute of Development Studies LCMS Living conditions monitoring survey LIL Learning and innovation loan LSMS Living Standards Measurement Study M&E Monitoring and evaluation MFPED Ministry of Finance, Planning, and Economic Development (Uganda) MPED Ministry of Planning and Economic Development (Uganda) MTEF Medium-Term Expenditure Framework NOS National development strategy (Swaziland) NGO Nongovernmental organization NPAP National Poverty Alleviation Program NSO National Statistical Office PA Poverty assessment PAF Poverty Action Fund PAG Participatory Assessment Group PAID Pan African Institute for Development PEAP Poverty Eradication Action Plan PER Public expenditure review PIR Poverty and inequality report PLA Participation learning and action PLSA Participatory Living Standards Assessment PMA Plan for Modernization of Agriculture PME Participatory monitoring and evaluation PPA Participatory poverty assessment PPM Participatory poverty monitoring PPR Participatory policy research PRA Participatory rural appraisal PRMPO Poverty Reduction and Economic Management, Poverty Division PROINDER Programa de Iniciativas de Desarrollo Rural PRS Poverty reduction strategy PRSP Poverty Reduction Strategy Paper PSA Programa Social Agropecuario RDP Reconstruction and Development Program (South Africa) RRA Rapid rural appraisal SARAR Self-esteem, associative strength, resourcefulness, action planning, and responsibility ABBREVIATIONS AND ACRONYMS xxiii SDS Secretarie Desarrollo Social (government poverty agency, Mexico) Sida Swedish International Development Authority SIEMPRO Sistema de Informacion, Monitoreo y Evaluacion de Programas Sodales (Technical Assistance for the Improvement of Social Information) SSI Semistructured interview TDRI Thailand Development Research Institute UNDP United Nations Development Programme UNICEF United Nations Children's Fund UPPAP Uganda Participatory Poverty Assessment Project WMS Welfare Monitoring Survey (Kenya) Summary Participatory poverty assessments are showing the World Bank and other out­ side observers of poverty that we are not the only poverty experts. Poor people have a long-overlooked capacity to contribute to the analysis of poverty-and without their insights we know only part of the reality of poverty, its causes, and the survival strategies of the poor. H ow can the poor, so removed from the powerful, influence national policy? For many years, poverty assessments have used income and consumption indicators, education levels, and health status to determine levels of poverty. Such data are derived from household surveys. Recently, policymakers have also begun using a new method called a participatory poverty assessment (PPA) to sharpen the diagnosis of poverty and better understand the needs and priorities of the poor. PPAs use participatory research methods to understand poverty from the perspective of the poor. The method elicits both quantitative and qualitative data on broader indi­ cators of poverty, such as vulnerability, physical and social isolation, pow­ erlessness, insecurity, and self-respect. As a result, a poverty assessment that uses the PPA research method gives the poor, marginalized, and excluded a voice in policymaking. PPAs can have an impact on policy by directly presenting the views of the poor to policymakers, both in country and within the World Bank, IMP, and other donor agencies. Although participatory approaches have been used by social scientists in project work for some time, their use for policy analysis is new. This new way to influence policy has been devel­ oped by the Bank in partnership with governments, nongovernmental organizations (NGOs), academic institutions, and other donors. To date, more than 60 countries have undertaken PPAs with assistance from the World Bank; an equal number of PPAs have been conducted by other agencies, including United Nations agencies, bilaterals, and NGOs. Many lessons are now emerging that broaden our understanding of the policy process and of poverty itself. xxv xxvi SUMMARY • Policy: Experience with PPAs indicates that where there is a broad policy dialogue on poverty that includes different civil society groups, the constituency for reform is widened, ownership is increased, and the resulting policy is more likely to be implemented. Simply presenting to policymakers the results of the new information generated through PPAs does not guarantee policy change. As a result, more recent PPAs have also focused on the policymaking process and the political context of policy choice and policy change. In such cases, the PPA process is not necessarily politically neutral. • Poverty: PPAs have consistently shown that poor people emphasize dimensions of poverty different from those typically used in policy analysis, including income and consumption levels, health, and edu­ cation status. The poor also emphasize such aspects as vulnerability, physical and social isolation, lack of security and self-respect, lack of access to information, a distrust of state institutions, and power­ lessness. What Is a Participatory Poverty Assessment? A PPA is a method to include poor people in the analysis of poverty with the objective of influencing policy. The findings are transmitted to poli­ cymakers, thereby enabling the poor to influence public policy choices. PPAs have three key elements: a. Field research. By directly consulting the poor at the community level, field research generates a better understanding of poverty from the perspective of the poor. The views of the poor contribute to the analysis of poverty and the formulation of public policy aimed at poverty reduction. b. Policy influence. A cross-section of civil society (for example, NGOs, policymakers, administrators, civic groups) is included in the PPA process to promote wider ownership of the PPA results, thereby increasing the chance that the PPA will influence policy. c. Country capacity. The results of PPAs are combined with other data sources, including quantitative household surveys, to better diag­ nose poverty. Using PPAs to extract information for research purposes only, with lim­ ited participation and no link to policymaking, is considered bad prac­ tice. In the past, most PPAs were focused only on the first element, field SUMMARY xxvii research. Links to policymaking were weak or unsustainable. More recently, PPAs are being designed to include both the second and third elements, resulting in greater long-term impact. To strengthen the link between the World Bank's assistance strategy and the country's own efforts to reduce poverty, the Bank is committed to completing country-specific analyses of poverty in the form of poverty assessments. In the past, the core elements of such assessments were data on the income, consumption, education levels, and health sta­ tus of the target group, usually based on the results of household sur­ veys. From 1994 to 1999,45 percent of the Bank's completed poverty assessments have also included a PPA. PPAs use participatory research methods to understand poverty from the perspective of the poor by focusing on their realities, needs, and priorities. Instead of a predetermined set of questions, as used in household surveys, PPAs use a variety of flexible methods that com­ bine both visual (mapping, matrices, diagrams) and verbal (open­ ended interviews, discussion groups) techniques, with the objective of better defining the experience of individuals, groups, households, and communities. The principle of a PPA is to ensure that the intended beneficiaries have some control over the research process. Instead of information being extracted from an interviewee, communities share their knowl­ edge and are involved in analyzing the results. The assumption is that poor people have expertise and should be part of the decisionmaking process. Experience from past PPAs has shown that the poor have the capacity to appraise, analyze, plan, and act to a far greater extent than has heretofore been acknowledged. Impact of PPAs Over the past few years, the percentage of PPAs in poverty assessments has increased. One-fifth of the Bank's poverty assessments completed in fiscal year 1994 included a PPA. By fiscal 1995, this figure had risen to one-third, and in fiscal 1996, fiscal 1997, and fiscal 1998, half the poverty assessments included a PPA. Out of the 43 PPAs completed up to fiscal 1998,28 were in Africa, 6 in Latin America, 5 in Eastern Europe, and 4 in Asia. These PPAs have entailed a wide variety of approaches and have had a variety of outcomes and impacts. This book proposes a threefold classification of PPAs based on their varying impacts-those that deepen our understanding of poverty, that influence policy, and that strengthen policy delivery. xxviii SUMMARY Deepening Our Understanding of Poverty PPAs are deepening our understanding of poverty by enabling the poor to highlight dimensions of poverty, explain the processes of impover­ ishment, and rank their priorities. The policy dialogue has been domi­ nated by income and consumption measures and health and education status derived from traditional household surveys. PPAs are adding to this analysis by providing other insights on the nature of poverty from the point of view of the poor. Vulnerability Vulnerable groups are not always identified in household surveys. Nei­ ther is the fact that their access to productive resources might be con­ strained by political, cultural, and social factors. In Armenia, single pensioners were consistently ranked by the communities as the poor­ est-not because they had the least income but because they were isolated and socially excluded. In Togo, the PPA drew attention to vul­ nerable groups such as displaced people and domestic child labor. Aspects of gender In Tanzania, men identified transportation, farming, and drunkenness as the three most important problems, whereas women identified food shortages, lack of clean water, and illness. Crime and violence Some PPAs have been able to highlight the relationship between poverty and illegal activities. In contrast, household surveys often are not able to access such information because of the respondent's reluctance to answer questions from an interviewer she or he does not trust. PPAs have been able to access data on such sensitive topics as child prostitu­ tion (Zambia), drugs (Jamaica), and domestic violence (Mexico). The PPA in Ecuador found that street crime and violence restrict women's abilities to work away from home and that women and the elderly are reluctant to use public transport, particularly at night, because of safety concerns. Seasonality Many of the PPAs, such as those in South Africa, Zambia, Ghana, and Togo, included a seasonality analysis that highlighted great differences in poverty, vulnerability, and coping strategies over the year. Powerlessness In The Gambia and Uganda, the poor expressed frustration with their lack of influence on government policies. Ugandans also expressed con­ cern about government corruption and a distrust of state institutions, SUMMARY xxix especially the police and the judiciary. In Vietnam's PPA, people said they lacked information about their entitlements and rights, and about the activities of local government. In some PPAs (for example, Brazil, Bangladesh, and Uzbekistan), police harassment, corruption, and gen­ eral unresponsiveness were reported. Both the lack of protection from violence and crime and a lack of trust of the police in general were reported in many PPAs as important factors affecting poor people's security. (See Narayan and others 2000, pp. 162-166, for more details on the role of the police.) PPAs have helped in the interpretation of results from traditional household surveys. For example, the PPA in Mexico found that some women in Mexico City are unwilling to leave their houses and go to work. Because they do not have tenancy rights, they are afraid that their houses might become occupied. In addition, the PPAs have made it clear that the poor can analyze the causes of their vulnerability and rank their priorities. As a result of the poor's involvement, the PPAs in Ghana, Mali, and Nigeria identified physical isolation and a lack of access to water as major problems. PPAs generally work with information at various levels-from indi­ viduals, households, and communities-and study issues of gender, ethnicity, age, and the relationships and differences between various community groups. Some PPAs have focused on individual case stud­ ies of people, prOviding insights into the dynamics of poverty and sur­ vival strategies. At the household level, the focus on intrahousehold dynamics can reveal both the unequal allocation of resources among household members and the impact of power relations on the poverty of women, men, and children within the household. Most PPAs also adopt a community perspective to highlight the diversity of social or cultural groups and their wide-ranging coping strategies. Influencing Policy Evaluating the extent to which PPAs have influenced policy involves consideration of two main issues: first, Has policy changed? Second, Have poIicymakers shifted their focus toward a more pro-poor approach? Although causality is usually difficult to establish, there are many examples of how PPAs have influenced policy at the country level and within the Bank, such as the following: • Zambia: The PPA identified the fact that school fees were to be paid at a time of year that caused maximum economic stress for house­ holds. The Ministry of Education decided to prepare a new regula­ tion to change the timing of school fees. xxx SUMMARY • Ghana: The PPA influenced the composition of the Bank's country program by shifting the emphasis to rural infrastructure and to the quality and accessibility of education and health care. Strengthening Policy Implementation Finally, a participatory process can help build the capacity of insti­ tutions to implement a policy more effectively by creating incentives (political or otherwise) and by generating a new institutional align­ ment to achieve effective, sustainable poverty reduction. To move toward strengthening policy implementation, the PPA needs to be designed to: • Use participatory techniques to diagnose both the policy environ­ ment and the ability and willingness of institutions to deliver the evolVing policy • Build the capacity of institutions to use participatory methods in the formulation and implementation of the policy • Initiate appropriate partnerships and linkages between and within formal and informal networks and institutions. PPAs have the potential to increase dialogue and negotiation on poverty at the policy level; increase ownership and commitment to pol­ iey delivery on the part of different civil society groups; and strengthen links between communities and policymakers. Over the longer term, this process could challenge existing power relations. Although it has not been possible to fully assess the impact of the PPAs, most appear to have achieved the objective of data collection and analysis. Some have achieved the objective of capacity building, but only a few have affected the formulation and implementation of policy, which is necessary if they are to have a wider impact. It is important, at this stage, not to overstate what PPAs have delivered or can deliver. But the approach does have the potential to affect communities by involv­ ing local people in the definition and analysis, including causes, of their own poverty; by helping people shift from passively being dependent to actively seeking ways to reduce their poverty; and by involving com­ munities in policy formulation and delivery, as opposed to their being merely acted upon. Emerging Good Practice There is no single model for this type of work The best approach is often determined by the context. However, this book suggests some mini­ SUMMARY xxxi mum standards and good practice for participatory policy research that aims to affect policy change. Emerging good practice for managing the PPAs at the World Bank includes wide ownership of the PPA across departments, as well as a team approach, the integration and balancing of various sector interests, a commitment to poverty reduction, and management support. At the country leveL the potential impact of PPAs on policy change is influ­ enced by the degree of government support for the exercise and, more generally, by the level of ownership and commitment of in-country stakeholders, which affects the credibility of the analysis. At the com­ munity level, the quality, credibility, and effectiveness of the PPA relate to when it is performed (before, during, or after the household survey), the methods used, the length of time allocated for fieldwork, the skills of the researchers, and the degree of institutional linkage established through the fieldwork process. Ethical questions are raised in this new field of influencing policy through dialogue with the poor. In the past, participatory methodolo­ gies were widely used at the project level, where there was immediate follow-up and action at the community level. Many practitioners are now questioning the process, principles, and ethics of working directly with communities for policy research where there may be no direct follow-up at the community level-the result being more data extrac­ tion than community action. All survey work, but especially PPAs, should discuss with participating groups the terms of the relationship. A basic principle is that the results of the PPAs should be shared with all the participating communities. This book focuses on the World Bank's experience with PPAs. Some practitioners have argued that a number of World Bank PPAs should not be included because they were extractive, did not influence policy, and were not participatory (Brock 2000). However, both good and bad practice PPAs are included in this analysis to facilitate learning from past experiences. Looking Ahead Combining Data Sources for Better Poverty Analysis There has been a tendency to see a dichotomy between traditional household surveys, which are quantitative and objective, and PPAs, which are qualitative and subjective. In practice, however, these divi­ sions are not as clear and are often misleading, since subjective ques­ tions are increasingly being used in traditional surveys and many PPAs contain quantified information and analysis. xxxii SUMMARY The objective of a comprehensive poverty analysis, therefore, should be to conduct participatory research and household surveys interac­ tively, so that they enhance each other. If a PPA is conducted after the household survey, the results will explain, challenge, reinforce, or shed new light on household survey data. The results of the household sur­ vey can also, of course, explain, challenge, or reinforce the PPA. If the PPA is conducted before the household survey, the PPA results could assist in generating hypotheses, shaping the design of the house­ hold survey, and developing survey questions appropriate for the respondents. Ideally, this should be an ongoing process whereby both PPAs and household surveys are conducted periodically and feed into each other. The results of past PPAs indicate that when they are used in conjunction with household surveys, the final assessment is a much fuller analysis of the varying dimensions of poverty, and the policy rec­ ommendations are more relevant and informed. Involving the Poor in Measuring Success PPAs have shown that poor people have the capacity to contribute to the debate on poverty. The question is, therefore, who should determine indicators of success? In the past, such indicators have been defined by those outside the community. Whose values and whose reality count (see Chambers 1997 and Gaventa 1998) are key issues. Emerging from these questions is the further question of who determines reality. To understand how projects and policies affect people's lives, investiga­ tions now focus on ways in which the poor can measure and assess out­ comes (using indicators and values that make sense to them) and ana­ lyze causality. These approaches are increasingly being incorporated into World Bank projects. However, nationally, and even internationally, defined targets still tend to be quantified targets determined by out­ siders.! Linking PPAs to Poverty Reduction Strategy Papers In September 1999, the World Bank and the IMF agreed to major changes in their operations to help low-income countries achieve sustainable poverty reduction. Henceforth, programs supported by the two institu­ tions will be based on government-driven poverty reduction strategies (PRSs) developed in consultation with civil society and elaborated in Poverty Reduction Strategy Papers (PRSPs). The PRSPs also provide the basis for debt relief under the Heavily Indebted Poor Countries Initia­ tive, as well as for all World Bank concessionallending. There are four key features of the PRSs for which PPAs can be usefuL SUMMARY xxxiii a. Poverty analysis. PRSs can incorporate information from the PPA on the multidimensional aspects and causes of poverty. b. Formulation and dissemination. The priorities of the poor should be reflected in the PRS goals set forth in the PRSPs. These priorities can be reflected in the sequencing of public actions, the choice of indica­ tors for monitoring implementation of poverty reduction strategies, and budget allocations. c. Monitoring. The PPA can provide policymakers with information on the effectiveness and relevance of poverty reduction strategies and the institutions that implement them, as well as on delivery of the budget and quality of services. d. Evaluating outcomes. Outcomes reported during PPAs should be integrated with other sources and used to inform decisions on whether to change policies and budget allocations. In this way, PRSs serve as a way to link PPAs to the policymaking process so they do not remain isolated exercises with limited impact. PPAs highlight the potentially powerful role the poor can play in ana­ lyzing poverty, developing interventions for its reduction, and assess­ ing the impact of projects and policies. The challenge for the Bank and the rest of the development community is to effectively integrate the perspectives and values of the poor into the process of policy and proj­ ect formulation and implementation. Note 1. For example, the international development goals include the following quantified targets: the proportion of people living in extreme poverty in developing countries reduced by at least one-half by 2015; universal primary education in all countries by 2015; progress toward gender equality and the empowerment of women, demonstrated by eliminating gender disparity in primary and secondary education by 2005; the death rates for infants and children under the age of five years reduced in each developing country by two-thirds the 1990 level by 2015; the rate of maternal mortality reduced by three­ fourths between 1990 and 2015; access available through the primary health care system to reproductive health services for all individuals of appropriate ages, no later than the year 2015. 1 A Status Report articipatory poverty assessments (PPAs) are broadening our under­ P standing of both poverty and the policy process. The limitations of quantitative measurements of well-being have long been recognized, and there is a rich tradition of anthropological and sociological work that uses a range of techniques to achieve an in-depth understanding of poverty for project work. In this tradition, PPAs use a systematic participatory research process that directly involves the poor in defining the nature of poverty, with the objective of influencing policy. This process usually addresses both traditional concerns, such as lack of income and public services, and other dimensions, such as vulnerability, isolation, lack of security and self-respect, and powerlessness. PPAs are also highlighting the fact that policy change involves more than writing statements of intent in a policy document. It requires an understanding of the unpredictable situation within which agenda set­ ting, formulation, and implementation continuously overlap and policy choices are made as outcomes of social processes. It also requires an understanding of how a broad-based dialogue with different people in society, including the poor, can help ensure that a policy will be imple­ mented and sustained. PPAs have demonstrated the value of the following: • Participatory policy research in the form of participatory problem identification, which includes the poor in the analysis of their own livelihoods using both qualitative and quantitative information • Participation in policymaking, which involves linking the informa­ tion from participatory research into a broad policy dialogue among a cross-section of stakeholders, leading to increased awareness, atti­ tude shifts, and changes in policy and the policy delivery framework. PPAs are part of a trend within and beyond the World Bank that is challenging personal, professional, and institutional norms. On a per­ sonallevel, the new approach is to learn from and listen to others; on a 2 CAN THE POOR INFLUENCE POLICY? professional level, it is to appreciate that we are not the only experts and that many others can contribute to the debate on poverty and develop­ ment; and on an institutional level, it is to change organizational culture, methods, and values from top-down practices to adaptable approaches that embrace risk-taking and error. Context In the 1980s, the Bank's poverty reduction objectives were often over­ shadowed by the focus on economic adjustment to achieve macroeco­ nomic stability and structural change as foundations for long-term growth. Toward the end of the decade, however, the Bank and other development agencies began to act to mitigate the consequences of eco­ nomic and structural adjustment for the poor. For example, the Social Dimensions of Adjustment program, funded by several multilateral and bilateral agencies, was launched in November 1987 in response to their concern about the position of the poor in the structural adjustment process in Africa. The program included a strong focus on strengthen­ ing national information systems, though with little use of participatory research. The World Development Report 1990 (World Bank 1990), which focused on the issue of poverty, proposed a strategy for achieving more effective poverty reduction. That report was followed in 1991 by a policy paper, Assistance Strategies to Reduce Poverty (World Bank 1991), which laid out how the findings of the World Development Report could be used to strengthen poverty reduction efforts. The policy paper recommended that a poverty assessment be conducted for each country, with the objec­ tive of analyzing the nature and causes of poverty and developing a strategy for poverty reduction. In the World Bank's process, the poverty assessment, which is done routinely for each country, feeds into the country assistance strategy, which lays out the Bank's program of sup­ port for a country in relation to its development objectives and struc­ tural conditions (see World Bank 1992). The World Development Report 2000/2001: Attacking Poverty (World Bank 2001) broadens the definition of poverty as presented in the World Development Report (WDR) 1990. The WDR 2000/2001 concludes that major reductions in poverty are possible but that achieving them will require a more comprehensive approach that directly addresses the needs of poor people in three important areas: opportunity, empower­ ment, and security. The WDR 2000/2001 drew on a large volume of research, including past and ongoing PPAs. (See Narayan and others [2000] for a summary of new PPAs undertaken in 23 countries for the WDR.) A STATUS REPORT 3 World Bank poverty assessments use a variety of sources to diagnose the structural causes of poverty. Typically, a national household income or expenditure survey, or a multipurpose living standards measure­ ment survey, is undertaken to provide basic information on the patterns of poverty. The early poverty assessments made little use of participa­ tory techniques, and although they did employ a multidimensional con­ cept of poverty, their principal criterion for defining who is poor was generally consumption or income. This approach, however, has changed over the past decade, with increasing attention being paid to informa­ tion from participatory research sources. Such information is generally used to complement, enhance, modify, or interpret conclusions derived from household survey analyses and other quantitative sources. Outside the Bank, there was also a growing realization of the impor­ tance of including the poor in diagnosis and policy work. A variety of sources led to this shift from projects to policy dialogue. PPAs devel­ oped in response to the broadened thinking on the multidimensional character of poverty associated with such publications as the Bulletin on Vulnerability (Institute of Development Studies 1989) and Putting the Last First (Chambers 1983). In the Bank, there was also ongoing project (as opposed to policy) work on understanding poverty and well-being through beneficiary assessments, participatory rural appraisals, devel­ opmental anthropology approaches, and similar methods. The European donors (including Denmark, Norway, Sweden, and the United Kingdom, which support the PPAs through trust funds and oper­ ational funding) began to emphasize the social dimensions of poverty and provided funding for many of the Bank's PPAs in Africa.! In the Bank, development of the PPA was initially based on a series of papers by Clark (1992), Norton and Francis (1992), Salmen (1992a, 1992b), and Clark and Salmen (1993). In addition, the Bank's Participation Learning Group (see World Bank 1994c) created a more receptive institutional environ­ ment for participatory approaches in both project and policy work. Although to date more than 60 countries have undertaken PPAs with assistance from the World Bank, an equal number of PPAs have also been conducted with assistance from other agencies, including the United Nations Development Programme (UNDP), the Asian Development Bank (ADB), bilaterals, and nongovernmental organizations (NGOs). For example, as far back as 1990, The Gambian government and the UNOP formulated the Strategy for Poverty Alleviation through a process of dia­ logue with a cross-section of groups in society, including poor communi­ ties throughout the country.2 The strategy provided an institutional framework whereby the poor could express their views on poverty.3And in Bangladesh, the UNDP undertook a national participatory poverty study (UNOP 19%).4 More recently, PPAs have been undertaken in part­ nership between and among various donors and NGOs. For example, the 4 CAN THE POOR INFLUENCE POUCY? PPA in Mongolia (carried out in 2000) was supported by a partnership between the Government of Mongolia, the Centre for Social Develop­ ment (local consulting firm), UNICEF, the World Bank, the ADB, and the Department for International Development-United Kingdom (DFID). The partnership for The Gambian PPA (1999 and 2000) was between the government, the International Development Research Centre (IDRF), Canada, and Action Aid. The World Bank has adopted participatory research techniques on a broad basis in a variety of geographical regions and with a range of partners. This experience has enabled the Bank to understand the diverse causes and conditions of poverty and the processes that affect policy change. Appendixes A and B5 analyze the methodologies and impacts of participatory assessments on a country­ specific basis. The objective is to learn from the organizations that have been our partners in this exercise and to reflect on the process. What Is a Participatory Poverty Assessment? APPAis a method to include poor people in the analysis of poverty with the objective of influencing policy. The findings are transmitted to poli­ cymakers, thereby enabling the poor to influence public policy choices. PPAs have three key elements: a. Field research. By directly consulting the poor at the community level, field research generates a better understanding of poverty from the perspective of the poor. The views of the poor contribute to the analysis of poverty and the formulation of public policy aimed at poverty reduction. b. Policy influence. Across-section of civil society (for example, NGOs, policymakers, administrators, civic groups, parliamentarians, and media) is included in the PPA process to promote wider ownership of the PPA results, thereby increasing the chance that the PPA will influence policy. c. Country capacity. The results of PPAs are combined with other data sources, including quantitative household surveys, to better diag­ nose poverty. Using PPAs to extract information just for research purposes, with limited participation and no link to policymaking, is considered bad practice. In the past, many of the World Bank's PPAs were focused on the first element, field research. Links to policymaking were weak or unsustainable. More recently, PPAs are being designed to include the second and third elements, resulting in a greater impact. A STATUS REPORT 5 A PPA is typically one of many inputs into a World Bank poverty assessment (see box 1). Unlike household surveys, which collect statis­ tical data on the extent of poverty through standardized methods and rules, PPAs focus on processes and explanations of poverty as defined by individuals and communities within an evolVing, flexible, and open framework. Box 1. Background to the World Bank's Participatory Poverty Assessment As a result of the World Development Report 1990 on poverty and the 1991 policy paper Assistance Strategies to Reduce Poverty, the Bank is committed to carrying out complete country-specific analyses of poverty in the form of poverty assessments. As of July 1998, 99 poverty assessments had been completed (see appendix C). A majority (55 percent) of these were based on statistical assessments without participatory surveys. Each poverty assessment draws a poverty line based on the level of income or con­ sumption associated with the minimum acceptable level of nutrition and other necessities of everyday life. People are considered poor if their income falls below this line (World Bank 1991). Poverty assessments gen­ erally include an analysis of the depth and severity of poverty and are increasingly using multiple poverty lines. From 1994 to 1999, 43 poverty assessments included PPAs, which pro­ vided new dimensions in the analysis of poverty. Policy-focused research using participatory methods is undertaken to understand poverty from the perspective of the poor by focusing on their realities, needs, and pri­ orities. Definitions of poverty, therefore, have moved beyond the conven­ tional consumption and income indicators to broader issues, such as vulnerability, physical and social isolation, powerlessness, and lack of security and self-respect. The PPAs form part of the poverty assessment, which combines qualitative and quantitative data to achieve a better analysis of poverty. The inclusion of other stakeholders at different levels in the country is required to link the information from the PPAs to policymaking. In many countries, this inclusion has led to the creation of partnerships between the Bank, government, and civil society with the objective of reducing poverty. The World Development Report 2000/2001: Attacking Poverty (World Bank 2001) broadens the definition of poverty as presented in the World Devel­ opment Report 1990. The WDR 2000/2001 concludes that major reductions in poverty are possible but that achieving them will require a more com­ prehensive approach that directly addresses the needs of poor people in three important areas: opportunity, empowerment, and security. The WDR also stresses the fundamental role of institutional and social change in strengthening development processes, and the importance of including poor people in development planning. The WDR drew on a large volume of research, including past and ongoing PPAs. 6 CAN THE POOR INFLUENCE POLICY? PPAs are sometimes referred to as qualitative surveys. This name can be confusing because there is a qualitative dimension to traditional sur­ vey work, and many PPAs contain quantified information and analysis. The terms "objective" for household surveys and "subjective" for PPAs may also be inaccurate. In household surveys, for example, interview­ ers and analysts will interpret informants' answers subjectively. The use of these terms can create the appearance of a dichotomy, whereas in the best poverty analysis, the two merge into one integrated analysis (for example, the World Bank's poverty assessments for Armenia and Zam­ bia, and the Ugandan government's 1999 Poverty Status Report). Tradi­ tional survey data can be used to count, compare, and predict. The strength of the PPA is not in counting but rather in understanding the hidden dimensions of poverty and analyzing the causality and processes by which people fall into and get out of poverty. Participatory research is undertaken by facilitators using a diverse set of participatory tools determined by the research agenda and local con­ text. Enabling the poor to participate leads to a reversal in the relation­ ship between the community and the outsider that is implicit in traditional surveys. Facilitators of participatory research need different skills and behavior, including listening to and respecting the expertise of participants, building trust, handing over control, and allowing the community to define the poverty issues that matter. The poor are viewed as participants or partners in the research process, data are shared with them, and the analysis of research results takes place within the com­ munity. The poor thus have more control over the research process, and their capacity to appraise, analyze, plan, and act is recognized. The extent and quality of participation have, however, varied exten­ sively. Some PPAs have been criticized for limited participation, espe­ cially when interviews were done quickly (less than two weeks of field research in some countries) and the results were not fed back to the com­ munities. In other PPAs, the quality of the participation has been ques­ tioned. Although participatory research methods may have been used, some research teams adopted a dominant role, undermining participa­ tion and resulting more in data extraction. For example, the manager of the PPA in Ecuador judged that genuine participation was limited and renamed it the Rural Qualitative Survey. Secondary stakeholders (that is, those beyond the community) have also participated in PPAs. Such stakeholders can include, for example, other donors (bilaterals, UNICEF), national and international NGOs (Save the Children, Oxfam), academic institutions, religious groups and leaders, different levels of government, and local leaders. Even some poverty assessments that did not include direct consultations with the poor were participatory in the sense that they consulted a cross-section of secondary stakeholders (for example, Malawi). A STATUS REPORT 7 Although PPAs and anthropological research have some similarities, there are three main distinctions. First, PPAs provide a perspective from a cross-section of communities in different areas of a country, whereas anthropological research usually analyzes one or two communities in depth. Second, PPAs tend to focus on messages for policy. Third, PPAs provide a rapid overview of the current situation, which is quickly pre­ sented to the policymakers. Anthropological research usually takes longer and focuses more deeply on processes within communities, often without a policy focus. In summary, PPAs have been used to provide dearer insight into the perceptions of the poor on the key issues related to poverty reduction (Norton and Stephens 1995). They are contributing to a greater under­ standing of the processes by which people fall into and get out of poverty, the complex coping and survival strategies adopted by the poor, and the major priorities and solutions identified by the poor, all within a local or regional context. By combining the PPA with the house­ hold survey information, the final poverty assessment is able to more fully analyze the various dimensions of poverty and make more informed and appropriate policy recommendations. How Are PPAs Conducted? Factors that influence the approach and consequent outcome of PPAs include political context, support, and commitment, both in country and within the Bank; relations between the Bank and the governments; and levels of expertise. Thus, there is a wide range of experiences among the PPAs undertaken to date (see appendix A for details of the timing, research teams, institutions involved, and methods used). Table 1 sum­ marizes the typical characteristic of PPAs, and table 2 provides two case examples. In general, PPAs with the wider objectives of linking to the policymaking process and increasing a country's capacity to analyze poverty tend to cost more. The design of a PPA is determined by conditions in a given country, the research agenda, the size of the sample, the experience of the researchers, links to policymaking, and the extent to which capacity building for poverty analysis is included. Tables 3a-3f summarize the experiences of some of the PPAs. The methodologies in table 3a are described in detail starting on page 13. The discussion below focuses on three main issues to be considered when conducting participatory policy research: sequencing and dura­ tion, research teams, and methodologies. 8 CAN THE POOR INFLUENCE POUCY? Table 1. Summary of PPA Typical Characteristics Feature Sample Cost $75,000-$200,000 Number of communities 40-60 communities selected for research Time spent training 2 weeks Time spent on field research 3-6 months Time spent on analyzing data 2-3 months from field research Composition of research team Nationals of country, with men and women equally represented; ability to speak locallanguagesi representatives from various ethnic and age groups Agency conducting the fieldwork Government extension workers; local and international NGOs; academic institutions; independent consultants / firms Donors that have contributed to DFID, World Bank, Action Aid, Oxfam, government-led PPAs UNDP, UNICEF, DANIDA, Asian Development Bank, Institute of Develop­ ment Studies (United ,,-,n Self-esteem, associative strength, resourcefulness, action planning, and responsibility. Table 3b. Time Spent in the Field Duration Number ofPPAs' Percent 1-2 weeks 3 8 2-4 weeks 8 20 1-2 months 3 8 2-4 months 15 37 4-8 months 11 27 • Where data are available. Table 3c. Number of Communities Assessed Number in the PPA Number Percent 1-9 6 26 10-24 6 26 25-49 7 30 50-74 2 9 75--100 2 9 • Where data are available. Table 3d. Agency Conducting the Fieldwork Agency Number of PPAs' Percent LocalNGOb 8 18 International NGO 8 18 Academic institution 18 42 Government agency 5 11 Independent consultants and firms 5 11 • The numbers add up to more than 43 because some PPAs used more than one type of agency. b Nongovernmental organization. A STATUS REPORT 11 Table 3e. Cost Cost (US$) Number ofPPAs" Percent $4,000 2 10 $5,000-$24,000 2 10 $25,000-$49,000 3 15 $50,000-$99,000 9 45 $100,000-$150,000 4 20 • Where data are available. Table 3£. Year Fieldwork Was Conducted Year Number of PPAs" Percent 1993 7 14 1994 9 18 1995 11 22 1996 5 10 1997 5 10 Ongoing and planned 13 26 a Where data are available. A balance needs to be achieved between quick fieldwork (which leads to less costly and more timely policy messages) and longer, more expen­ sive fieldwork, such as household surveys (which can cost up to $1 mil­ lion and take up to three years). PPAresearch teams have spent from one day to one week in a given community and have visited from 4 to 98 communities. Urban areas are more complex, and thus more time and flexibility are needed, since it is difficult to predict the nature of partici­ pation. Total time in the field for a PPA has ranged from one week to eight months, depending on the sample size and the number of research teams. Research Teams In Eastern Europe, most of the research was conducted by individuals from local universities. In other countries, NGOs undertook the field research (for example, Centre for Development of People [CEDEP] in Ghana, CARE in Cameroon, African Medical and Research Founda­ tion [AMREF] in Kenya, Red Cross in Lesotho, Save the Children in Mali). International agencies have also been involved in the research process (UNDP in Togo, UNICEF in Lesotho). In South Africa, a local consulting company worked alongside a cross-section of NGOs, whereas in Mozambique and Zambia, local universities were involved. In Latin America, the community-level research was conducted by a 12 CAN THE POOR INFLUENCE POUCY? Box 2. Participatory Poverty Monitoring in Zambia Background Using the same approach developed in the PPA, participatory poverty moni­ toring (PPM) has been undertaken in Zambia on a yearly basis (1995, 1996, and 1997) since the completion of the first PPA. The monitoring was con­ ducted by the Participatory Assessment Group (PAG), the NGO involved in the PPA. The objective was to monitor changes in poverty over time. Overall, it is evident that the PPA and the PPMs have made a considerable impact and contributed in a meaningful manner to the national policy agenda on poverty. The critical interest in the PPMs and their continuing contribution to policy dialogue lie in their empirical observation and elucidation of trends and changes in livelihood conditions in Zambia. Two areas of PAG's work will require continual reinforcement. Method­ ological skills need regular refreshing and upgrading through periodic train­ ing. The methodological approach requires repeated investigation of key policy areas using similar research techniques. What is required for successive PPMs to have additive value is consistent innovation in the use of research methods by the research team. The second area that needs continual attention is the dissemination of find­ ings, which involves identifying more precisely the clients for different types of PPM outputs and tailoring specific recommendations to those clients. An improved dissemination strategy is a priority. Initiatives might include local dissemination workshops, condensed reports for NGOs and other local insti­ tutions, and networking with other agencies and research institutes. Linkages and impacts The PPMs are not simply a tool for enriching the understanding of poverty in Zambia. They are also an important means of improving participatory plan­ ning in the provinces and districts by closing the information loops at those levels. PAG's efforts (in dialogue, participation, and feedback) have been increasingly concentrated at the decentralized level and are well suited to ongoing decentralization efforts. Link with the living conditions monitoring survey There is still much informal discussion about linking the monitoring systems of the PPM and the living conditions monitoring survey (LCMS). The latest proposal suggests a quarterly meeting of a technical committee (comprising PAG and LCMS), with a rotating chair informing each institution of the other's ongoing and planned work. As far as harmonizing work programs, one problem identified was the dif­ ference in project cycles of the LCMS survey (at least one-and-a-half years) and the shorter cycle of the PPM. The timing of survey cycles appears to be the only major hurdle to partnership, since PAG and the Living Conditions Monitoring Unit are housed in the same complex at the Central Statistics Office, making it feasible, at least in practical terms, to harmonize their work programs. Source: Based on a note prepared by D. Owen for field research for this study. A STATUS REPORT 13 Figure 1. Good Practice Research Cycle L first PPA conducted t PPA results create hypotheses for testing through household survey Next PPA explains results of and influence survey design. household survey, tests robustness of survey results, generates new hypotheses for testing, and influences the design of the next survey. • Household survey conducted t t Results of household survey test Next PPA conducted I robustness of PPA results and inFluence research agenda and selection of next PPA sites. cross-section of NGOs, universities, and government departments (for example, the government poverty agency in Mexico). Some PPAs have used teams experienced in participatory research, as in Zambia, where the research team was given additional training in participatory rural appraisal (PRA) methods for the PPA exercise. Other PPAs have used local teams trained to conduct the research or have tapped into the country's NGO and consulting firm networks (South Africa). In Ghana, the team was composed of a cross-section of individ­ uals from NGOs, government line ministries, and academia. Methodologies There is a widening debate about the most appropriate methods to use when conducting participatory policy research. Below is a brief descrip­ tion of the main methodologies used B (see table 4). In reality, these methodologies are complementary and can be used together. Refer­ ences are given for more in-depth information. What is a beneficiary assessment? Many of the early PPAs were undertaken using a methodology called beneficiary assessment (BA), originally developed by the Bank in the early 1980s for use in the urban slums of Latin America. It was one of the methodologies that pioneered the inclusion of the voice of the poor in ~ Table 4. Comparison of Participatory Methodologies I Rapid rural Participatory Beneficiary Participatory monitoring appraisals rural appraisals assessments and evaluation Item (RRAs) (PRAs) (BAs) (PME) ! When 1970 Late 1980s 1980 1990 1990 t j Where Universities NGOs World Bank NGOs NGOs, universities, World Bank, governments, donors Objective Data collection Community Data collection for Understanding impact Data collection to t ! for projects empowerment project managers influence policy j Focus Project Project Project Project Policy -i Main actors Outsiders Local people Outsiders Local people Local people and outsiders Key techniques Visuals Visuals Conversational Combination of methods, Combination of methods, ..... interviews e.g., RRA, PRA, BA, SARAR e.g., RRA, PRA, BA, SARAR ""­ Outcomes Plans, projects, Sustainable local Better informed Assessment of Better informed policyrnakers publications action and project managers project process institutions Main innovation Methods Behavior Listening to the Local people's contribution Linking local people to the people to determining indicators national policy dialogue of success Key resource Local people's Local people's Local people's Local people's Local people's knowledge for earlier overlooked knowledge capabilities knowledge perceptions on impact a better understanding of the problem and local people's capability to analyze policy impact Notes: NGO nongovernmental organization; SARAR = sell-esteem, associative strength, resourcefulness, action planning, and responsibility. Source: Adapted from Chambers (1997). A STATUS REPORT 15 Bank operations. BAs draw from consumer research, traditional quali­ tative social science research, anthropological participant observation (observing people and interacting with them in their environments), conversational interviews, focus group interviews, institutional assess­ ments, and investigative journalism. A BA is designed in consultation with policymakers and others who will use the information. Teams of researchers collect information in selected communities through focus groups and individual interviews. A semistructured interview guide is drafted before the research begins. Information is collected mainly through dialogue between beneficiaries and researchers. The researchers then analyze the collected informa­ tion-unlike a PRA, in which some of the analysis is done at the com­ munity level (see Salmen 1995a and 1995b for more details). What are rapid and participatory rural appraisals? Many PPAs have used the RRA methodology, which emerged in the 1970s. Its purpose was to develop an approach that would enable out­ siders to learn about rural conditions and people's realities quickly and cost-effectively. In the mid-1980s, RRAs evolved into the PRA approach, which placed greater emphasis on community participation. RRAs and PRAs use such tools as mapping; diagrams of changes, trends, and linkages; matrices; and scoring. They also use group anima­ tion and exercises to facilitate information sharing, analysis, and action among stakeholders. The information is thereby made visible, which often creates ownership. The power of the PRA is frequently in "group­ visual synergy" (Chambers 1997), with analysis being locally led. The main difference between BA and PRA is that PRA combines both verbal and visual techniques and emphasizes community-level analysis, whereas the BA emphasizes verbal techniques, and most of the analysis is done by the interviewer. The PRA is also a set of principles that includes following up actions, embracing error, showing respect, being willing to unlearn assumptions and conditioned responses (reversals in learning), using methods or processes only if they make sense in the context (optimal ignorance), compensating for biases, and triangulating data. As Chambers (1997) has noted, "PRA stresses changes in the behavior and attitudes of out­ siders, to become not teachers but facilitators, not lecturers but listeners and learners." (Also see International Institute of Environment and Development 1991-2001.) What is participation learning and action? Participation learning and action (PLA) is an umbrella term for a wide range of similar approaches and methodologies, including RRAs and PRAs. The common theme in all these approaches is the full participa­ 16 CAN THE POOR INFLUENCE POLICY? tion of people in the process of learning about their needs and oppor­ tunities and in the action required to address them (see International Institute of Environment and Development 1991- 2001). What is SARAR? The methodology using self-esteem, associative strength, resource­ fulness, action planning, and responsibility (SARAR) uses visual aids to stimulate discussions. These visuals are prepared in advance by the researchers (unlike the PRA, in which the visuals are created by the communities to express issues and concerns). The main objectives of the SARAR are to build local capacity to plan for community development or to raise awareness of health and sanitation issues. SARAR builds on local knowledge and strengthens local capacity through a variety of par­ ticipatory methods. It has also been used by development agencies to increase participation and joint decisionmaking, although it is not often used in PPAs (see Srinivasan 1990). Use of methodologies There are many different participatory traditions from around the world: some provide the philosophy for participation, others provide the tools, and some provide both. PRA is one of the few that provides a broad philosophy in addition to distinctive tools. The selection of methodologies and tools depends on the context of the PPA (for exam­ ple, capacity of in-country institutions, PPA manager's knowledge of different methods, government approval, availability of skilled trainers, time available). The tools and approaches can be very different, and all have advan­ tages and drawbacks. For example, PRA enables some of the analysis to take place at the community level, leading to greater ownership of the results. A researcher from Zambia, where a PRA was undertaken, stated that community ownership meant that "problems would be thought about long after my departure."9 To further promote this ownership in Zambia, charts and papers created by local people were left with the community. PRA places more emphasis on community-level interview­ ing, while BA concentrates on households or individuals (Norton and Stephens 1995) and involves less community ownership and control over the analysis and results. Some have argued that the visual tools of PRA might not be suitable for all cultures. Although this statement might be true to some extent, the skill and sensitivity of the facilitator and the understanding that he or she has of the community usually determine the extent to which visual tools will be appropriate. PRAs have been conducted effectively in a diverse range of cultures in more than 100 countries. \0 A STATUS REPORT 17 How these methodologies relate to policy work and methodological dilemmas These methodologies were not originally designed to influence policy­ they were developed specifically for communities and project work. BAs were traditionally used to seek the views of beneficiaries on the impact of projects and to feed this information back to project managers in an attempt to influence project design. SARARs and PRAs were used at the community level to develop community action plans with the wider objective of empowerment. In the 1990s, participatory methods were used to achieve the broader objective of influencing policy. Sector assessments used participatory research to influence policy in the following areas: health and education in Zambia (work done by the NGO, Participatory Assessment Group; Milimo 1996); urban poverty and violence in Jamaica (Moser and Hol­ land 1996); and wetlands management in India and Pakistan (Gujja, Pim­ bert, and Shah 1996). Whereas PPAs attempt to influence the broader policy framework, sector assessments attempt to influence specific policies. In this new field of influencing policy through dialogue with the poor, ethical questions are being raised about the possible exploitation involved in using the poor to gain access to information without any benefit to them. When participatory methodologies were widely used at the project level, they comprised tools for gaining information and a set of principles, such as action follow-up, empowerment, and capacity building in the community. When participatory methodologies are used for policy work, however, these principles have often not been followed. It is suggested that when undertaking participatory research for policy work, the term participatory policy research (PPR) might be more appro­ priate. The debate has evolved because many PRA practitioners have questioned the process, principles, and ethics of working directly with communities for policy research when people's expectations are raised and there is no direct follow-up at the community level-the result being more data extraction than community action. PPR uses tools from various methodologies but with a different overall objective: the cre­ ation of policy messages with communities contributing to the analysis, as opposed to direct action, community empowerment, and capacity building. But ethical questions remain about taking people's time and raising their expectations when undertaking not only PPAs but any kind of poverty research, including household surveys. PPR, therefore, is not generally a tool for empowerment (Chambers 1997), and while its research value is great, its value at the community level should not be overstated. For policy, the participatory research is meant to be imperfect, rapid, and restricted, and the principle of imme­ 18 CAN THE POOR INFLUENCE POLICY? diate action may not be feasible because the focus is on trends, not project identification. PPR is a way to inform policy rather than empower local people. In an attempt to respond to the principle of fol­ low-up action, however, many PPAs have linked the information with action-oriented institutions. For example, in Argentina and Brazil the fieldwork has been linked with the work of country NGOs and govern­ ment line ministries. As a result, the potential now exists for moving from information sharing to continuous dialogue with various stake­ holders, including those at the community level. What Is the Current Status of PPAs? As of July 1998, 43 PPAs had been undertaken at the World Bank. The fraction of poverty assessments including a PPA has risen from one-fifth in fiscal 1994 to one-third in fiscal 1995 and one-half in fiscal 1996, fiscal 1997, and fiscal 1998. 11 Of the 43 PPAs completed, 28 are in Africa, 6 in Latin America,S in Eastern Europe, and 4 in Asia. Box 3 shows the distribution of the various participatory methodolo­ gies employed, by region, as of May 2001. Box 4 details some of the PPAs planned by the Bank and other organizations. A STATUS REPORT 19 Box 3. World Bank Participatory Poverty Assessments: Status Report, March 2001 AFRICA EASTERN EUROPE and Benin RRA CENTRAL ASIA Burkina Faso PRA Albania Various Burundi PRA Armenia Various Cameroon BA Azerbaijan Various Central African RRA Bosnia and PRA/various Republic Herzegovina Chad RRA Bulgaria PRA/various Djibouti PRA Georgia Various Egypt PRA Kyrgyz Republic Various Equatorial Guinea RRA Latvia Various Eritrea RRA Macedonia Various Ethiopia PRA Moldova Various Gabon RRA Russia Various The Gambia PRA Ukraine Various Ghana PRA Uzbekistan PRA/various Guinea RRA Kenya PRA/SARAR LATIN AMERICA and the CARIBBEAN Lesotho PRA Argentina BA Madagascar BA Bolivia PRA/various Malawi PPA Brazil BA Mali RRA Costa Rica BA Mauritius RRA Ecuador PRA Mozambique PRA Guatemala BA Niger RRA Jamaica PRA Nigeria PRA Mexico BA Rwanda RRA Nicaragua Various Somaliland PRA South Africa PRA ASIA Swaziland PRA/BA Bangladesh PRA Tanzania PRA/SARAR Cambodia PRA Togo RRA India PRA Uganda PRA Indonesia PRA/BA Zambia PRA/various Mongolia PRA Pakistan PRA/various Papua New Guinea Various Sri Lanka PRA Thailand PRA Vietnam PRA Notes: RRA =rapid rural appraisal; PRA =participatory rural appraisal; BA =beneficiary assessment; SARAR =self-esteem, associative strength, resource­ fulness, action planning, and responsibility; various = a variety of qualitative research methods were used, including open-ended interviews, focus groups, and semistructured interviews. 20 CAN THE POOR INFLUENCE POLICY? Box 4. Examples of Planned PPAs Where Description When Donor support Albania PPA TBC TOC Burkina Faso National Participatory 2001 World Bank Poverty Assessment as part of the implementation of the PRSP Cambodia PPA 2001 ADB Chad Perceptions of 2000-01 TBC Poverty Study Egypt PPA Ongoing DFID The Gambia PPA-3-year project 2000-2002 Government of The Gambia, IORC Ghana PPA TOC TBC Guinea PPA TOC TBC Guinea Bissau RapidPPA Mid-2001 TBC Kenya PPA TBC TOC Lao PPA October 2000­ TOC May 2001 Malawi PPA TBC TBC Moldova PPA September 2001 TOC Mongolia Follow-up to the first PPA TBC TBC Myanmar PPA 2001 UNDP Niger Perceptions of November 2000 UNDP Poverty Study -March 2001 Pakistan PPA Ongoing World Bank Pakistan PPA-managed at 2001 Government of district level Pakistan Sierra Leone PPA 2001-2002 TBC Uganda PPA-3-year Ongoing DFIO/UNDP/ project World Bank Notes: TBC to be confirmed; ADB = Asian Development Bank; DFID Department for International Development-United Kingdom; IORC =Interna­ tional Development Research Centre; UNDP United Nations Development Pro­ gramme. A STATUS REPORT 21 Notes 1. The Department for International Development-United Kingdom seconded a Social Development Advisor (Andrew Norton) to the Bank to work on the development of participatory poverty assessments in Africa from 1992 to 1994. 2. See The Gambia (1994) for more details on this case. 3. In The Gambia, Action Aid and a nongovernmental organization (NGO) coordi­ nating body assisted in organizing the participatory research on poverty using participa­ tory rural appraisal techniques. In addition, a local team conducted research to gain an understanding of the informal networks within communities and throughout the country. Initially the policy environment was constrained, with the government unwilling to dis­ cuss poverty openly. As the dialogue gradually developed, more stakeholders were included until enough policy space was created to put poverty and related issues, such as decentralization and gender inequalities, on the political agenda. This process of consul­ tation led to increased donor coordination and created an opportunity for the government and NGOs to redefine their heretofore controversial relationship. 4. Holland and Blackburn (1998) state that in the poverty study for Bangladesh, new issues were put on the policy agenda, such as the problem that demands for increasingly high dowry payments led to daughters' being a burden to their parents and that wives were divorced or abused if the dowry was not paid. Furthermore, if daughters were edu­ cated and did not find a job, the demand for a dowry could increase. As a result, some par­ ents were not sending their daughters to school. The study found that throughout Bangladesh, a priority for the poor was the enforcement of antidowry laws. 5. Appendix A analyzes the various methodological and organizational issues asso­ ciated with each of the PPAs. Appendix B focuses on the value added of the PPAs and the impact on the Bank's and borrower's country programs and policies. 6. LSMSs use an integrated set of questionnaires and are designed to be repeated on a regular basis to track changing conditions over time. LSMSs can produce a comprehen­ sive measure of household welfare, and evaluate its distribution across the population and over time; evaluate patterns in access to social services, such as schools, clinics, or wel­ fare programs; identify the determinants of socioeconomic outcomes (for example, how women's schooling affects fertility decisions, or how health status affects workers' labor supply); and examine household responses to changes in economic conditions or govern­ ment programs (for example, how price subsidies influence consumption patterns, or how clinic user fees affect health care choices). For further details, see World Bank 19961. 7. Although there were many limitations to these early PPAs, they are significant for having been the first Bank studies to use participatory research methods in poverty analysis. 8. The information in this section comes from a variety of sources but is based mainly on Rietbergen-McCracken and Narayan (1997). 9. Malako Nabanda, Participatory Assessment Group (NGO), Zambia. 10. Including developed countries. For example, PRA is now widespread throughout the United Kingdom. See Inglis and Guy (1996). 11. See appendix C for a detailed breakdown of all poverty assessments completed by the Bank to date 2 Impact of the PPA ncluding the poor in policy dialogue has great potential for creating bet­ I ter poverty reduction policies. The original rationale of the participa­ tory poverty assessments (PPAs) was to influence the policy dialogue by collecting information on the poor's perceptions of poverty. Most PPAs have achieved this objective to some degree, but with substantial varia­ tion in the level of impact. The PPAs with the greatest impact tended to be those that implicitly or explicitly had more ambitious objectives. It is use­ ful to assess impact in relation to three objectives: a. Deepening the understanding of poverty: Through the incorporation of the results of participatory techniques into a diagnosis of the nature and causes of poverty b. Influencing attitudes and policy: Through the use of the PPA process within a broader participatory process that engages policymakers c. Strengthening the policy delivery framework: Through the creation of a new institutional alignment that increases policy impact for effec­ tive, sustainable poverty reduction. Although the principal objectives of PPAs have been to diagnose the causes and nature of poverty and to influence policy, some PPAs have been successful in fostering dialogue with and building the capacity of credible poverty reduction institutions, which then create links between traditional and formal institutions. These links have created room for a more coordinated approach to poverty reduction among various stake­ holders, including donors, with ongoing and increasing interaction between policy change and stakeholder dialogue. This process is long, slow, and continuous and requires the redefinition of stakeholder rela­ tionships, including relationships with the World Bank. Ideally, gov­ ernments should lead the process, or lead in partnership with other institutions, and development partners should offer support and advice. This policy change and institutional strengthening at all levels 23 24 CAN THE POOR INFLUENCE POLICY? are part of a wider process of establishing linkages between the poor and those in power. This section uses case examples to explore the diverse array of observed impacts of PPAs in the context of the three categories men­ tioned above: the extent to which PPAs have deepened the understand­ ing of poverty; their impact on attitudes and consequent policy change; and the extent to which frameworks for policy implementation have been strengthened. These impacts are summarized in table 5, which also links the various levels of impact to the different PPA approaches and the required shifts in the thinking of policymakers. Table 5. Range of PPA Impacts Required shift Typical approach in the thinking PPA impact and inputs Potential outcome ofpolicymakers 1. Deepening the • Rapid appraisals in • Changes in policy • Poverty viewed as a understanding of the field (e.g., 3 documents reflecting multidimensional poverty weeks). Information views of the poor. phenomenon, the extraction. Limited character of which is Participatory feedback and action • The information defined by the com­ might be accurate data at the community and interesting, but munity. incorporated in level. there is limited room • Policymakers under­ the analysis of • Policymakers not for government own­ stand the value of poverty. necessarily included ership or for chang­ participatory in the process. ing attitudes of research and of policymakers. including the percep­ • Prescriptive and tions of the poor. often top-down in • The poor are given a nature. voice, but there is • Isolated exercises limited commitment with limited impact from the top to on the wider devel­ ensure that the poor's concerns opment process. remain on the agenda. • Issues such as power, decentralization,and gender are considered but not always included in ongoing debate. • Policymakers might feel threatened. 2. Influencing • Feedback and • Attitudinal shifts of • Policymakers are policy follow-up to field key stakeholders are seen as partners who appraisals (e.g., the reflected in policy should be included Policies realigned poor validate infor­ changes. Policies are from the beginning toward poverty on mation). Ownership refocused toward of the planning a long-term basis of the information at poverty. process. IMPACT OF THE PPA 25 Required shift Typical approach in the thinking PPA impact and inputs Potential outcome of policymakers by focusing on the community level. • More politically sen­ • World Bank is seen changing Development of sitive issues, such as as one of many attitudes. action plans and power, decentraliza­ stakeholders. follow-up. Longer tion, and gender, are • Policy change is process (e.g., 1 year). put on the agenda viewed as part of a for continuous • Government involve­ wider social process. negotiation. ment from the begin­ ning. Administrators • Government and those who ownership and com­ implement policy are rnitment are high. included in the debate. • Redefinition of the relationships among stakeholders. Emphasis on build­ ing partnerships and trust. Increasing coordination and conflict resolution through consensus building. 3. Linking • A continuous process • Strengthening the • Policy agenda formulation of cross-checking policy delivery setting, decision- with policy and dialogue. framework by build­ making, and implementation ing the capacity of implementation • Identification of cred­ appropriate institu­ are interrelated ible institutions for Policy delivery tions, both formal processes. Recogni­ capacity building. framework and traditional. tion that policy Strengthening rela­ strengthened. tionships between change does not • Those who imple­ formal and informal ment policy are not automatically mean institutions. Aware­ just included in the policy implementa­ ness of traditional debate but their tion and that there is management prac­ capacity is also a difference between tices. increased. discourse and outcomes. • Organizational • Cross-stakeholder development and ownership and • Participation is seen commitment. as more than an add- institutional change. on or a component. • Ongoing participa­ • Increasing trans­ It is viewed as an tory monitoring and parencyand approach within evaluation of accountability. which an overall poverty. framework is created • Building institutions at rnicroeconornic for more effective level contributes to policy formulation decentralization. and implementation. • The process of policy • Beginning to challenge existing change is part of a power relations (con­ wider process of trol by elites, pat­ establishing linkages ronage, exclusion of between the poor the poor). and those in power. 26 CAN THE POOR INFLUENCE POLICY? Deepening the Understanding of Poverty and Combining Data Sources PPAs are deepening our understanding of poverty and contributing to a more in-depth analysis of this complex problem. PPAs are beginning to provide insights into dimensions of poverty, the causes and dynam­ ics of poverty, priorities of the poor, and different levels of analysis. Dimensions of Poverty It is well known that poverty has many dimensions beyond income and consumption. However, policy dialogue has focused primarily on income and consumption measures of poverty, while other dimensions highlighted in the PPAs have been underemphasized in the policy debate (see box 5). Box 5. Enriching the Diagnosis of the Nature of Poverty The strength of many PPAs has been to highlight the diversity of poor people's experience of poverty. Definitions of well-being and ill-being vary dramatically depending on many aspects beyond income: a lack of self-respect and dignity; poor health; lack of skills, education, or infor­ mation; lack of access to assets for a secure livelihood; lack of time; inse­ curity; lack of freedom of choice; helplessness; exclusion; loneliness; and isolation. These aspects are often interconnected and lead to the disem­ powerment of poor people. State institutions and powerlessness In many PPAs, poor people expressed a desire to have better access to information and to be able to influence decisionmakers. But many PPAs have also highlighted the fact that poor people do not trust state institu­ tions. In The Gambia and Uganda, the poor expressed frustration about their lack of influence on government policies. Ugandans also expressed concern about government corruption and a distrust of state institutions, especially the police and the judiciary. In Vietnam's PPA, people said they lacked information about their entitlements and rights, and about the activities of local government. Gender The Zambian PPA was able to distinguish different kinds of female­ headed households. "Women without support," as opposed to female­ headed households, were identified as the poorer group. In northern Mexico, the PPA found that it was easier for women than for men to obtain jobs. This was challenging the traditional gender roles, as many men found themselves out of work. Conflict within the household had become a IMPACT OF THE PPA 27 major issue. Similarly, in Mexico City, the urban poor, especially the men, felt excluded from job opportunities. Some men were turning to alcohol. Women were left with the double burden of income earning and child rear­ ing, which put pressure on traditional gender roles and fueled the increase in domestic violence. In Mongolia, alcoholism, crime, and domestic vio­ lence were seen as symptoms of poverty, particularly by women. Some PPAs have focused on the informal sector and nonremunerated activities, which in many cases, represent a major part of women's lives. Social ill-being and exclusion Many PPAs have shed light on social ill-being, which includes isolation and exclusion. Excluded groups are not always identified in household surveys. Neither is the fact that their access to productive resources might be constrained by political, cultural, and social factors. In Zambia, the PPA highlighted the fact that children were increasingly going into pros­ titution and that child-headed households were becoming more common. In Guatemala, the PPA data showed that alcoholism was a major problem for men in the indigenous areas. This had not previously been acknowl­ edged. Most of these men were unemployed or underemployed and felt excluded from the limited opportunities for employment. In Armenia, single pensioners were conSistently ranked by communities as the poor­ est-not because they had the least income but because they were isolated and socially excluded. In Eastern Europe, the PPAs' analysis of social con­ nections revealed that the poor tend to be connected horizontally-that is, within their own networks-for survival and to reduce vulnerability. As a result, poor households tend to remain excluded. ln contrast, the better­ off households tend to be connected both horizontally and vertically­ that is, to better-off networks-which enabled them to improve their situation. In Mongolia, the PPAs highlighted the fact that there was a weakening of kinship networks but that the most vulnerable were those excluded from kinship and other social networks. Illegal activities, crime, and violence Household surveys often are not able to access information on illegal activities because of the reluctance of the respondent to answer questions from an enumerator she or he does not trust. PPAs, however, have been able to shed light on the relationship between poverty and illegal activi­ ties. For example, the PPAs in Zambia and Jamaica revealed that prosti­ tution, crime, and violence were major concerns among the poor. People were feeling increasingly scared, unsafe, and insecure as community coherence was threatened because of violence. In some communities, women and the elderly were reluctant to use public transport, particu­ larly at night, because of safety concerns. In Mongolia, Thailand, and Cambodia, economic stress had forced some poor people into such degrading or illegal activities as begging or theft. (Box continues on the following page.) 28 CAN THE POOR INFLUENCE POLlCY? Box 5. (continued) Seasonality In many PPAs, seasonality analysis highlighted great differences in poverty, vulnerability, and coping strategies throughout the year. In South Africa, for example, the PPA revealed that payment of school fees coin­ cided with a season of financial stress resulting from a high incidence of sickness and hard work combined with shortages of money and food. The household survey in Tanzania concluded that 22 percent of the poor had access to safe water from protected sources, indoor plumbing, standpipes, and covered wells with hand pumps. But the survey overlooked the sea­ sonal dimension of access to safe water and therefore overestimated the access. The PPA, which collected information from the same villages, revealed that in two-thirds of the villages thought to have access to safe water, access was actually a major problem. In the dry season, as water tables fell, people were forced to walk farther for water or switch to such unsafe alternatives as uncovered dug wells, ponds, streams, and rivers PPAs also portray the reality of poor people's lives. In Equatorial Guinea the results of the PPA highlighted the feelings of hopelessness and despair many people felt after years of declining well-being and repression. Suicide-not generally considered an issue in Africa-was mentioned as a problem. The results of this PPA were described by one Bank economist as "terrifying." In the postconflict countries of Burundi, Rwanda, and Uganda, it was not possible to undertake household surveys. In these countries, the PPA proved to be a very useful tool in providing initial data on poverty and conflict impacts. Explanatory Power of the PPAs Many PPAs provide insights into the dynamics and processes of impov­ erishment (see box 6). Priorities of the Poor Although some problems highlighted by the PPAs were already known, the PPAs have made it clear that the poor have the capacity to analyze the causes of their vulnerability and rank their priorities. In PPAs car­ ried out in Ghana, Mali, and Nigeria, for example, the poor said that physical isolation and lack of access to water were problems. In Costa Rica, the PPA highlighted linkages between horne ownership and status in society. IMPACT OF THE PPA 29 Box 6. Examples of Explanations Provided by PPAs Why some women were not working in Mexico City: The PPA in Mexico found that some women in Mexico City were unwilling to leave their houses and go to work. Because they did not have tenancy rights, they were afraid that their houses might become occupied in their absence. Why the poor spend a "disproportionate" amount of money on clothing in Mali: The results of the quantitative survey showed that a disproportionate amount of money was spent on clothing. The PPA explained that clothing and cloth are investment items in addition to being status symbols and therefore play an insurance role. Why migrants with money still lack access to land in Zambia: The PPA explained that the social status of certain groups sometimes determines their economic status. Migrant groups might lack access to high-value land not because they lack money but because they lack entitlement in the view of local social institutions that determine land ownership. Lack of social status therefore prevents migrants from gaining title because social institutions actively prevent transfers of land. Why people were not using health facilities in Kenya and Pakistan: The PPAs explained that communities were discouraged from using health facili­ ties because health staff were often rude and condescending. Beyond the Household Unit: Combining Data Sources Household surveys often interview only the head of household (usually a man). PPAs typically gather information on intrahousehold issues from more than one perspective, and also explore interhousehold and community-level social issues in addition to gathering household data. PPAs have focused on individual caSe studies of people, providing insights into the dynamicS of poverty and survival strategies; intra­ household dynamics, revealing both the unequal allocation of resources among household members and the impact of power relations on the poverty of women, men, and children within the household; inter­ household dynamics, illustrating, for example, the fact that female­ headed households might rely on interhousehold transfers; household­ level information; and a community perspective highlighting the diver­ sity of social or cultural groups and their Wide-ranging coping strate­ gies. Local people's understanding of their poverty can be increased if the PPA-especially if it includes a PRA-involves the community in the analysis. In Zambia, one participant in the yearly participatory poverty monitoring stated that the research had enabled the people in the com­ 30 CAN THE POOR INFLUENCE POLICY? munity to get together to discuss their problems and reflect on their sit­ uation, that of their neighbors, and the community as a whole. Owen (1997) adds that by using PRAs, the PPA in Mozambique encouraged communities to become conscious of their life conditions, opportunities, strengths, and limitations. This, he says, is particularly important where government has limited capacity to assist people in many areas of the country. In summary, PPAs are deepening the understanding and providing a dynamic picture of poverty. For example, all of the following insights have emerged from Zambia's PPA: child-headed households, child labor, crime, violence, and prostitution as coping strategies; increased feelings of insecurity and lack of safety as an outcome of these strate­ gies; seasonal fluctuations in sickness, rates of work, and access to food as triggers of greater vulnerability; and the impact of these new dimen­ sions on people's behavior as individuals, as household members, and as part of a community. Attitudes and Policy Change Formulation of more appropriate and poverty-focused policies can be constrained when Bank staff and government officials involved in the policy dialogue have different attitudes. Some governments have little immediate political incentive to help the poor because the poor are often not organized, have a weak voice, and are difficult to reach. And most Bank staff have little direct experience with poverty. Some PPAs have helped to change the attitudes of both Bank staff and senior government policymakers, thereby contributing to policy formulation. It is rarely possible to establish clear causality between the PPA and policy change because policymaking is part of a wider social process. In addition, it is usually difficult to separate the impact of the PPA from that of the poverty assessment. However, some indicative evi­ dence is presented below. World Bank Insights arising from the PPAs are contributing to the broader debates within the World Bank on how to measure and monitor poverty, inte­ grate social dimensions into policy and project work, and increase the impact of the Bank's operations by adopting participatory approaches. There is a growing realization of the value of integrating quantitative and qualitative data in the analysis of poverty, in order to produce bet­ ter measurement, better analysis, and, through more appropriate policy IMPACT OF THE PPA 31 recommendations, better action (Carvalho and White 1997; Chung 2000). Influencing the World Bank lending program In certain instances, PPAs have successfully contributed to a shift of pol­ iey emphasis. In Nigeria, for example, the World Bank had been focus­ ing on health and education, yet the PPA highlighted that the poor viewed water and roads as the priorities. There is now a greater focus on water and roads. In Ghana, the PPA contributed to a shift of empha­ sis within the Bank to rural infrastructure and the quality and accessi­ bility of education and health care (see Norton 1996), which was subsequently followed by the preparation of the Village Infrastructure Project. In Ecuador, the PPA highlighted the fact that women were reluctant to work away from home because of street crime and violence. The poverty assessment identified the provision of street lighting and guarded public buses in the evening as effective ways to address this problem. In Zambia, the World Bank's Social Fund supported some of the priorities identified by the communities in the PPA, and a health project now includes cost recovery conditions as identified in the PPA. In Niger, the PPA influenced the design of the proposed Infrastructure Project to be more poverty focused and include pilot rural operations. And in Burundi, the Bank designed a community-based poverty proj­ ect, which used the recommendations of the PPA. In other cases, the PPA impact has been less evident. The poverty assessment in Kenya reflected the major findings of the PPA, but the results have not been extensively incorporated into other country reports. In Costa Rica, delays in the analysis and dissemination of the findings have limited the impact of the PPA. Rapid assessments using PPA approaches were used to better under­ stand the social impacts of the financial crisis in East Asia. Initial surveys were undertaken in Thailand, the Philippines, Indonesia, Cambodia, and Laos. 1 The objective was to consult with a cross-section of organiza­ tions-including community groups, local and international NGO net­ works, academic institutions, labor unions, professional associations, other donors, and government departments-to determine shifting pat­ terns of vulnerability. Focus groups, rapid assessment techniques, and participatory exercises were used. These initial assessments contributed to creating the framework to begin a dialogue with governments and other donors and jointly formulate strategies for action (see appendix B). In all these countries, there was a time lag in obtaining reliable statis­ tical data. The advantage of the initial rapid assessments was to quickly produce a series of hypotheses about the potential impacts of the finan­ 32 CAN THE POOR INFLUENCE POLICY? cial crisis on the poor. The participatory surveys highlighted the new social dimensions of the crisis beyond unemployment, price changes, access to services, and the credit crunch, to include intrahousehold dynamics, coping strategies, and social capital. These data now form the basis for further ongoing problem identification with the objective of providing a baseline and defining the issues for more detailed, sys­ tematic, and representative participatory surveys. For example, this next step was taken in Thailand, where a national participatory assess­ ment, using the PPA approach, was designed as part of the Bank's Social Investment Project. The objectives of this assessment were to, first, increase the Bank's and the country's understanding of the shifting pat­ terns of vulnerability as the impacts of the crisis deepen; second, inform Bank and government policymakers and therefore influence policy; and third, strengthen the capacity in country to undertake participatory sur­ veys and to analyze results, particularly by consolidating the results of participatory and traditional surveys. In addition, the ADB worked with the governments of Lao and the Philippines to undertake more detailed participatory assessments on the impacts of the crisis. Links to World Bank policy documents The results of some PPAs have been reflected in Bank policy documents. An example is the Bank's "Taking Action for Poverty Reduction in Sub­ Saharan Africa" (World Bank 1996i), the product of the Bank's Africa Region Poverty Task Force that resulted from extensive dialogue with development partners. The task force was established to assess the Bank's operations in the Africa Region, and the report is now being used as a basis for the Bank's strategy in Africa. In addition, a series of PPAs in Zambia, Mali, Ghana, and Nigeria identified both physical iso­ lation and lack of access to water as major concerns. As a consequence, it was recognized that rural water and roads infrastructure had been neglected areas of investment for the Bank. The report recommended that these should be priority areas in the future. In Gabon, the results of the PPAinfluenced the Bank's decisions to undertake a Public Expendi­ ture Review in the health and education sectors. Links to the country assistance strategy (CAS) are difficult to deter­ mine at this stage. However, five examples in which the CAS was dearly influenced by the PPA and the poverty assessment are Armenia, Zam­ bia, Niger, Ethiopia, and Rwanda. In Armenia, the PPA highlighted the importance people place on health and education. The CAS emphasizes protecting access to these sectors. In Zambia, the PPA highlighted the limited access the poor have to public services. The CAS has made this a central theme. In Niger, the value added of the participatory process for the poverty assessment and the PPA was recognized and was adopted for the Niger CAS. In Ethiopia, the results of the quantitative IMPACT OF THE PPA 33 survey were delayed because of data problems. The CAS for Ethiopia therefore drew extensively on the data from the PPA. In Rwanda, the PPAresults fed into the CAS, the agriculture strategy note, and an agri­ culturalleaming and innovation loan. The importance of using poverty assessment to focus the CAS on the Bank's overarching objective of poverty reduction is now widely recog­ nized in the Bank. Thus, in order to more effectively focus the CAS and country programs on poverty, the Bank is shifting from mandatory one­ time poverty assessments to long-term strategic poverty monitoring that combines periodic household surveys with periodic participatory research. The impacts of some PPAs on poverty reduction strategies are begin­ ning to emerge. For example, PPAs are being used to consult with the poor as part of the process of participation, in addition to using the results of the PPA to diagnose poverty. Chapter 4 discusses this in more detail. National Level Attitudinal change starts with appreciating the value of how the poor perceive their situation. In Tanzania, the government was initially cau­ tious about the PPA exercise but became more receptive when the PPA highlighted the capacity of local people to analyze their own problems. Policymakers began to understand the value of including the poor in the policy dialogue. Similarly, in Benin the PPA strengthened the inter­ est of the Ministry of Planning in consulting the poor through a partici­ patory assessment. In Zambia, the government was influenced by the priorities expressed by the poor in a ranking exercise. The Ministry of Health has been using the results of the PPA and the poverty assessment to develop policy. In other countries, the poverty assessment and PPA have opened up the policy debate, enabling discussions of once highly sensitive issues. In Swaziland, the workshop convened in February 1997 to dis­ cuss the results of the PPA was the first government-sponsored work­ shop on national poverty. Key insights from the PPA on such issues as women's rights, land tenure, and the role of traditional authority were given higher priority in the policy agenda as a result of this workshop and the dialogue surrounding the PPA. In Lesotho, three key themes emerged from the PPA that were not identified in the household sur­ veys: alcoholism, political factors, and corruption. Through the govern­ ment's action plan, these issues were placed on the policy agenda. As the process has developed in Lesotho, government ownership has increased, and the topic of corruption has now appeared in speeches and policy discussion documents. 34 CAN THE POOR INFLUENCE POLICY? Opening up the policy debate can be a conflict-ridden process. The results of both the PPA and poverty assessment were a shock to people in Cameroon inside and outside the government, as poverty had not previously been acknowledged as a serious problem. Ownership had not been developed among key policymakers during the PPA process, because the central government was not strongly committed to poverty reduction. As a consequence, there was little initial acceptance or use of the results. The poverty assessment and PPA did seem to have an impact at the local government level, where officials expressed a great deal of interest in replicating the methodology of the PPA. Strengthening the Capacity to Deliver Policy The impact of a PPA on strengthening the capacity to deliver poverty­ focused policies can be assessed by identifying new institutional align­ ments and partnerships that arise as a result of the PPA. Increased dialogue and consequent partnerships can also contribute to widening the constituency for reform, increasing ownership, and strengthening the commitment to poverty reduction. World Bank The extent to which PPAs have had an impact on the Bank's capacity to fulfill its poverty reduction mandate is difficult to determine at this early stage. As stated above, the links between the PPA and poverty assess­ ment, the lending program, and the CAS are evident in only a few coun­ tries. The Bank is now developing an interdisciplinary approach to the diagnosis of poverty and the analysis of how all types of institutions affect the poor. This approach will lead to a better understanding of the problem of poverty and increase the Bank's capacity to work with the rel­ evant institutions. In addition, the Bank is in the process of ensuring that the findings of the WDR 2000/2001 influence its policies and projects, with the objective of increasing empowerment and security for the poor. National Level In some countries the process of compiling the PPA has helped to create a dialogue and partnerships for policy delivery. One of the strengths of the Mozambique PPAwas the diversity of the involved institutions (uni­ versity, government, NGOs) and researchers. The multi-institutional approach has strengthened relationships between the various partici­ pating institutions (Owen 1997). In Argentina, increased coordination between government agencies and programs has been developed. In IMPACT OF THE PPA 35 addition, dissemination of the results of the PPA has validated the methodology and contributed to the development of an integrated (qualitative and quantitative) approach to monitoring and evaluating social programs undertaken by different organizations. In other countries, the PPAs have increased the capacity of certain civil society institutions as well as government. In Cameroon, the Bank manager of the PPA stated in an internal communication to team mem­ bers that "involving local institutions and holding workshops with both government and civil society are mechanisms for expanding ownership of the poverty problem and in-country capacity to analyze and address it." In some cases, the researchers and intermediary institutions that undertook the PPA were empowered by the process. In South Africa, for example, the local researchers later adopted an activist role. In Ghana, the capacity of local organizations to undertake credible participatory research has been developed, with the local NGO, Centre for Develop­ ment of People, benefiting from extensive training and institutional linkages created by the PPA process. In Uganda, the PPA impact has even extended to the budget (see box 7). Through dialogue at the community level, communities that are no longer passive recipients of a policy might become more committed to policy delivery. In some communities, PRAs resulted in local people identifying their priorities, which were later followed up in the form of projects supported by various agencies. In South Africa, for example, the PRA work became a catalyst for communities to initiate a project to benefit the poor. The impact of PPAs has been limited where follow-up has not been extensive, leading many to question the value to the poor of such work. Indeed, at the workshop in Mozambique organized for this study, participants explained that many communities had "respon­ dent fatigue--fadiga dos informantes." The workshop concluded that many communities, especially those accessible from major cities, are the subject of excessive research, and "agreed ... that before initiating any study, a review be undertaken of existing data and material pertaining to the area" (Owen 1997). Determinants of the Level of Impact Methodology Of the 43 PPAs reviewed for this study, 21 (the ones with sufficient data) were analyzed in more detail to quantify the level of impact and take the first step in exploring the effects of a variety of possible explanatory variables. 2 From the data in appendixes A and B, a list of key impact variables was identified. For each variable, a rating of high, medium, 36 CAN THE POOR INFLUENCE POLlCY? Box 7. Can the Poor Influence the Budget? Case Example from Uganda What is the Medium- Term Expenditure Framework (MTEF)? • The Ugandan government adopted an MTEF under which medium­ term budget priorities are formulated, consistent with Uganda's Poverty Eradication Action Plan and medium-tenn financial stability. • Under the MTEF, line ministries are provided global budgetary ceilings on which to base their sector allocations. Sector working groups com­ prising the Finance Ministry, line ministries, technical advisers, and some civil society representatives develop sector priorities within these limits. • Given this resource envelope, a comprehensive review of all sector spending proposals is undertaken. This requires an analysis of trade­ offs of various funding decisions among and within sectors on the basis of affordability and intersectoral priorities. This new process forces ministries to prioritize early in the budgeting process. • This review feeds into the Budget Framework Paper (BFP) and the annual Background to the Budget. Participation at the central level • Since 1998-99, civil society organizations have been involved in the dia­ logue on priorities and spending commitments, and public debate in the media has been encouraged. However, officials recognize that there is still a long way to go to open up civil society and engage the media. • In 1998-99, the government implemented the Uganda Participatory Poverty Assessment Project (the UPPAP), for which the poor in rural and urban areas were directly consulted. The results of the UPPAP influenced budget allocations. For example, a higher weighting was given to provision of safe water supply in central and district-level bud­ gets as a result of communities identifying access to clean water as a pri­ ority. Findings from the UPPAP were also included in the Background to the Budget 1999-2000. • Involvement of civil society is also encouraged by publication of (a) an abbreviated version of the BFP (the version that goes to the cabinet before expenditure allocations are approved); (b) an annual Background to the Budget; and (c) a detailed summary of the composition of expen­ diture for all sectors for the three-year MTEF, as an appendix table in the Budget Speech document. • To broaden consultation in the budget process, donors are invited to join sector working groups and participate in the public expenditure review, where discussions focus on sector priorities of government expenditure and on the consistency of government assumptions regard­ ing external financing and donor financing plans. • In the 2000-01 budget process, the Poverty Eradication Working Group was established, comprising Ministry of Finance officials and donor and civil society representatives. The group reviews each sector work­ ing paper for a poverty focus. It then makes recommendations on inter­ IMPACT OF THE PPA 37 and intrasectoral allocations of resources and on poverty-focused out­ put indicators, based on the latest poverty analysis. • The budget process also provides an opportunity for parliament to take a more strategic look at the government's expenditure plans and exam­ ine how the government is performing in the implementation of its overall budget strategy. • A strategy to increase public awareness and transparency to further the budget process is currently being developed. This involvement will enhance the evolving partnership between civil society and govern­ ment. Participation at the district level • Responsibility for the provision of a large number of services was devolved to district and urban authorities. This increased people's par­ ticipation in the decisionmaking process, and made decisions more transparent and public officers more accountable. The long-term aim is to integrate central and local government budgetary processes and devolve spending decisions to local governments to enable them to respond to district poverty priorities. • Recent UPPAP findings demonstrate major differences in the poverty profile among districts. This resulted in policymakers' recognizing the need for flexibility in the use of central government conditional grants to districts. • In partnership with the Ministry of Local Government, the UPPAP will work directly with nine districts, initially to strengthen their capacity to consult poor communities for the purposes of district planning and budgeting. Monitoring budget expenditures • The government established a Poverty Action Fund (PAF) to enhance transparency and monitoring of HIPe and other donor resources going to expenditure programs focused on poverty. The PAF involves both civil society and government in monitoring the impact of PAF outlays, and the government holds quarterly meetings to discuss delivery against budget allocations. • The budget process is being further developed to open up multiple channels of accountability. For example, to increase transparency in decentralized management of resources, advertisements are placed in the press indicating amounts disbursed to each district by sector. In the education sector, budget allocations for schools are posted on school notice boards. • In addition, the Poverty Monitoring Unit integrates annual household surveys, conducted by the Uganda Bureau of Statistics, with other data sources (e.g., participatory analysis, sector surveys, line ministry data lJ o.urces) to ensure that impacts of policy are understood and policy development is informed by poverty data and the perceptions of the poor. 38 CAN THE POOR INFLUENCE POLICY? low, or zero was assigned to each country PPA on the basis of desk work, discussions with participants, and field research in the five countries the author visited for this study. The ratings are largely subjective; they are not objectively measured indexes of a PPA's success. In the future, more empirical research will be required. The results of the analysis are sum­ marized in table 6. The analysis of the 21 PPAs suggests a significant influence on the diagnosis of poverty in 71 percent of the cases examined. Twenty-nine percent of the PPAs had a significant impact on policy formulation, both in the Bank and in country, while in only 24 percent of the cases did the PPA have a significant effect on the country's capacity to deliver some policies. The analysis involved classifying the PPAs in a 3 x 3 matrix based on the composite impact index (ell) and a variety of possible explanatory variables. The ell used the ratings assigned to four key impact vari­ ables. These variables and the weights assigned to them were as follows: DUP-deepening the understanding of poverty (1) IWP-influencing World Bank policy (2) IeP-influencing country policy (2) lCD-increasing capacity to deliver policy (4) Table 6. Summary of PPA Impacts Percentage of Number of PPAs Percentage of PPAs, PPAs with (out of 21 analyzed) by impact significant Impact variable None Low Medium High Low Medium High impact" 1. Deepening the 0 6 10 5 28 48 24 71 understanding of poverty 2. Influencing policy 8 7 4 2 33 19 10 29 at the World Bank 3. Influencing policy at 9 6 4 2 28 19 10 29 the national level 4. Increasing country's 13 3 3 2 14 14 10 24 capacity to implement policy • Significant impact medium or high rating. IMPACT OF THE PPA 39 The four rating levels were assigned a score as follows: none = 0; low = 1; medium = 2; high = 3. For each of the 21 country PPAs, the CII was calculated as follows: CII = 1 (DUP rating) + 2 (IWP rating) + 2 (ICP rating) + 4 (ICD rating). The maximum attainable score was therefore 27, calculated as follows: ClI 1(3) + 2(3) + 2(3) + 4(3). The next step was to define a series of independent variables that had potential to explain the level of PPA impact as measured by the Cll. For each independent variable, subjective ratings of low, medium, and high were assigned for each country PPA. These results are set out in table 7. Pairs of impact variables were then chosen and charted against the ClIo Only high and low ratings were included to highlight the more marked differences observed among the PPAs. Table 7. Variables NumberofPPAs (out of21) Low Medium High Impact variable None extent extent extent World Bank 1. Ownership within the World Bank 0 10 6 5 (by staff, deparbnents) 2. Bank management support 0 11 5 5 3. Links to poverty assessment 2 8 5 6 4. Links to country assistance strategy 0 19 0 2 5. Team work 7 5 6 3 Country level 1. Involvement of policymakers 0 7 6 8 2. Involvement of other stakeholders 0 8 9 4 3. Ownership by government 0 8 6 7 4. Dissemination at the national level 0 9 4 8 Community level 1. Skills of researchers 0 7 8 6 2. Dissemination to communities 13 6 2 0 3. Length of time in field 0 4 9 8 4. Cost 0 7 7 7 5. action with communities 9 6 6 0 40 CAN THE POOR INFLUENCE POLlCY? Main Findings When the CII was plotted against the subjective estimates of the quality of the PPA research team, there was a clear positive correlation (see fig­ ure 2). PPAs judged to have high-quality teams averaged more than 15 out of a possible 27 on the CII. Those judged to have medium-quality teams averaged 7, and those with low-quality research teams averaged only 2. The relationship between the CII, the quality of the PPA manager, and Bank management support revealed a high level of interaction between the latter two variables (see figure 3). Where both Bank man­ agement support and PPA manager quality were high, average ClI was high (17 out of a possible 27). However, even high-quality PPA man­ agers were unlikely to produce high-impact PPAs without strong Bank management support-the PPAs in that category scored only 7 out of a possible 27. There were no PPAs with high Bank management support and low manager quality; hence the zero ClI score in the lower left cor­ ner of figure 3. When the ClI was plotted against links to the poverty assessment, there was a clear positive correlation (see figure 4). PPAs judged to have a greater link to the poverty assessment averaged a ClI of more than 19 out of a possible 27. Those judged to have medium links averaged 5, and those with limited links averaged only 2. To have a significant impact, PPAs need to be linked to the poverty assessment. Figure 2. PPA Impact by Quality of Research Team 20 ~ -0 ..5 15 t; 8. .§ 10 .S:! .;;;; 8. 5 E (3 0 Low Medium High Quality of Research Team IMPACT OF THE PPA 41 Figure 3. PPA Impact by Quality of PPA Manager and Level of Bank Management Support 20 ~ ..E 15 1 .§ 10 '1 E 5 Quality of PPA (3 Manager o Low Bank Management Support Figure 4. PPA Impact by Link to Poverty Assessment W~--------------------------~ 18 16 14 ~ -0 ..E 12 1:; 8. 10 .§ .!! .;;; 8 0 0­ E 6 0 u 4 2 0 Low Medium High Link to Poverty Assessment 42 CAN THE POOR INFLUENCE POLICY? The relationship between CII, ownership by the government, and ownership within the World Bank revealed a high level of interaction between the latter two explanatory variables (see figure 5). Where there was a high degree of ownership in the Bank and by government, the cn reached 20 out of a possible 27. Ownership by both the Bank and gov­ ernment is important to achieve a high-impact PPA. There was no instance of a PPA with high World Bank ownership and low govern­ ment ownership; hence the zero Cll score in the top right comer of fig­ ureS. When the Cll was plotted against the extent to which policymakers were involved, there was a clear positive correlation (see figure 6). Where there was a high level of policymaker involvement, the Cll was more than 16 out of a possible 27. Those PPAs judged to have medium involvement averaged 7 and those with limited involvement averaged only 3. The level of PPA impact depends to some extent on the level of policymaker involvement. The following chapter builds on this analysis of the key variables in more detail, analyzing case examples to elucidate recommendations for good practice. Figure 5. PPA Impact by World Bank and Government Ownership 25 1:; 20 &. .§ 15 J! ~ .- --0 '" c &.­ E 10 0 u 5 World Bank Ownership 0 low Government Ownership IMPACT OF THE PPA 43 Figure 6. PPA Impact by Level of Policymaker Involvement Low Medium High Level of Policymaker Involvement Notes 1. See Robb (1998) for a summary of these initial surveys. 2. The section titled ''Determinants of the Level of Impact" was compiled with assis­ tance from James Edgerton of the World Bank's Social Development Department. 3 Emerging Good Practice r-phis chapter identifies good practices that should be considered when ~ undertaking participatory policy research for policy change. Emerg­ ing good practice builds on the diverse impacts of key variables discussed in the previous chapter. It is divided into three main areas in which issues are similar and linked: first, issues to be considered from an institutional perspective within the World Bank;1 second, good practice when manag­ ing a PPA in country, at the national level, including how to open up the dialogue in participatory policymaking; and third, emerging good prac­ tice in conducting participatory research with the poor at the community level, and the principles behind this method of data collection. There is no unconditional good practice in this type of work because the best approach will be determined by the context. However, box 8 gives some suggestions for good practice and minimum standards that have emerged from experience with the Bank's PPAs. These issues are then discussed in more detail throughout the chapter. At the World Bank: Initial Steps and Follow-Up This section is divided into five main parts: (a) professional input and commitment, (b) ownership of the PPA in the Bank, (c) management support and follow-up, (d) PPA design, and (e) linking to the Bank's country assistance strategies. Professional Input and Commitment The first step in initiating a PPA and poverty assessment is to ask, Will the outcome drive policy reform within the country and in the work of the Bank? Whether PPA and poverty assessment will move from an aca­ demic exercise to influencing policy depends on the extent to which the 45 46 CAN THE POOR INFLUENCE POLICY? Box 8. Twelve Hallmarks of Good PPAs World Bank 1. The Bank's role is to provide support (technical or financial) to the government to enable the government, not the Bank, to lead the process. 2. The PPA research agenda is discussed with country team members, leading to broader ownership and understanding of results within the Bank. 3. Results of the PPA are combined with household survey data by the government, with support from donors if necessary. Such analysis should then influence World Bank poverty assessments and the coun­ try assistance strategies. 4. Bank managers and staff observe the PPA being conducted in the community so as to better understand the strengths and weaknesses of the data. Country level 5. Government leads the process, and support should be secured from the beginning. Key policymakers and administrators are included in designing, planning, and implementing the PPA and analyzing the results. 6. Timing and extent of involvement of other stakeholders (NGOs, line ministries, unions, religious groups, local social science institutes) are attuned to the social and political environment. 7. In-country capacity to conduct ongoing PPAs is strengthened so PPAs can feed into the policy dialogue. 8. PPAs can contribute to the development of Poverty Reduction Strat­ egy Papers by including the poor in the consultation process; provid­ ing data for poverty analysis; and where the PPA is an ongoing process, building country capacity to monitor poverty. Community level 9. Local research teams are trained to conduct high-quality participa­ tory research, with an understanding of both the principles and tech­ niques. 10. Communities are involved in analysis of the data. 11. Results of the PPA are disseminated to the communities involved in the policy research and to agencies that can follow up at the commu­ nity level with action and projects. 12. Results are presented in a clear and concise manner. Bank and, more specifically, the sponsoring Country Department is committed to poverty reduction. Although there is no one approach to poverty reduction, and the definition of poverty is broadening (see EMERGING GOOD PRACTICE 47 box 9), PPAs have yet to be as generally accepted as traditional house­ hold surveys. However, the Bank is now moving toward undertaking ongoing poverty analysis and monitoring as opposed to one-time poverty assessments, and is recognizing the importance of including the poor in this analysis. Experience has shown that the PPA manager needs to have a diverse set of skills, including technical methodological skills and skills in man­ aging a participatory policy dialogue. Operating at a policy level and opening up the policy dialogue in country often mean that conflict will occur. Conflict is not always negative--from it, greater understanding of the problems of the diverse groups involved can evolve. An under­ standing of people and their motivations, as well as sensitivity, tact, and diplomacy, is required when opening up a policy dialogue. This is never a smooth process: it is unpredictable, and no matter how skillful the PPA manager, the process might not go according to plan. Who Owns the PPA in the Bank? Ownership within the World Bank, across departments, emerges as a key issue when considering the impact of PPA exercises on World Bank policy and projects. For the PPAs in Pakistan, for example, there was limited ownership and understanding of the process. Consequently, the results were not reflected to a significant extent in other World Bank documents. In Cameroon, changes in the team managing the country program occurred while the poverty assessment was being prepared. Within the country department, the PPA results had limited credibility Box 9. What Is Poverty Reduction? The Bank is broadening its view of poverty reduction, as reflected in the comments below by economists and sociologists affiliated with the Bank. • "Commitment to poverty reduction is dependent upon the government's pub­ lic expenditure priorities. An example may be the targeting ofclean waterfor the poor, which would consequently improve their health and thus increase their productivity." • "[Poverty reduction is] increasing income and general assets to a level where the poor are less vulnerable to risks and falling below a certain level." • "Poverty reduction is giving people greater control and the means to deter­ mine their lives." • "Poverty reduction starts with the poor's perceptions of their own in a process of sharing strategies, priorities, and solutions holders." 48 CAN THE POOR INFLUENCE POLlCY? with those who were not part of the process. Additionally, keeping poverty issues on the agenda proved difficult when the CFA (Commu­ naute Financiere Africaine) was devalued as the emphasis shifted to macroeconomic issues. To achieve greater policy relevance and broader ownership, a broader team approach is important. In Armenia, for example, the manager of the poverty assessment had in-depth country knowledge, built up respect among key policymakers and within the country's academic community, and encouraged a team approach within the Bank. In addi­ tion, the PPA manager worked closely with those managing the house­ hold surveys and the country department's macroeconomist to establish a research agenda for the PPA. As a result, the process had the following outcomes: first, the results of the PPA were reflected in the poverty assessment; second, the country program and the CAS integrated the results of the poverty assessment; and third, the poverty assessment was well received and used by policymakers in Armenia. Management Support and Follow-Up Limited management support and follow-up within the Bank have sometimes led to lost opportunities. In Madagascar, for example, there was a high degree of in-country support because key policymakers were included from the beginning. With changes in the Bank management, however, there was a delay in follow-up of more than a year and a half, and the commitment and interest of the government consequently weakened. In Equatorial Guinea, the information was controversial and the Bank was reluctant to continue the process. Appropriate follow-up measures are sometimes difficult to identify because the outcomes of the PPA and poverty assessment consultations are not always reported accurately. In one country, many NGOs and high-ranking government officials openly opposed the results of the poverty assessment. In addition, many felt unhappy that their views were sought during the consultation but then not included in the final poverty assessment. Yet within the Bank this poverty assessment was considered technically sound and successful. A recommendation for good practice is to monitor not just the outcome of the policy dialogue or the poverty assessment but also the process and outcomes of the par­ ticipation and consultation. For example, CASs, poverty assessments, and PPAs could document who was consulted and how, and the major lessons learned from consulting each of the key stakeholders. Decentralizing the management of the PPA to resident missions might be appropriate in some countries because it is difficult to coordi­ nate the PPA process from Washington. The manager of the Tanzania EMERGING GOOD PRACTICE 49 PPA, for example, suggested the need to strengthen that resident mis­ sion to enable it to undertake frequent PPAs and contribute to a broader poverty assessment. Teams could be located in the field, and people skilled in the analysis of poverty could be located within the mission. To increase the capacity of the resident mission, training in participatory policy research could be cond ucted and tool kits provided. Where appropriate, the NGO officers and social scientists (recently recruited in many resident missions) could assist in such poverty-focused work. PPADesign Some PPAs can be strengthened by the use of sampling methods. For example, the selection of PPA sites could be informed by traditional household survey data. In Kenya, the Welfare Monitoring Survey (WMS) was used to identify the poorest districts in each of six provinces. Trust and understanding should be developed among those who use different approaches to defining research agendas and collecting and analyzing data with the aim of influencing policy. The integration of data sets will evolve through this trust building. Both survey and par­ ticipatory assessment practitioners need to understand the limitations of various data sets, appreciate the biases in their own research meth­ ods, and know when alternative methods can compensate for some of these limitations. In an attempt to better understand the various approaches to poverty analysis, the local NGO research team (Participatory Assessment Group) in Zambia is currently undertaking participatory poverty monitoring exercises and combining the results with those of the household survey carried out by the Central Statistics Office. In other countries, policy­ makers have visited research teams in the communities. In Costa Rica, for example, a senior official from the Ministry of Economic Planning was involved with the research and consequently was better able to appreciate the value and limitations of the PPA. And in Armenia, where the manager of the poverty assessment built trust among those manag­ ing the household survey, the Bank's PPA team, and government poli­ cymakers, the resulting integrated analysis of poverty was widely used both by the Bank and by government policymakers. Another PPA design issue is the need to ensure that the results are shared with various stakeholders. Dissemination of results should be part of the PPA planning and budget, but in most PPAs this has not been the case. If the information gathered is not fed back to the communities, the participatory nature of the work is incomplete. There are several important reasons to feed back information from the PPA: to validate the information; to continue the process of constructing a dialogue with 50 CAN THE POOR INFLUENCE POLICY? communities so that semipermanent linkages are created; to show respect for the partnership with the community by sharing the infor­ mation; to continuously reevaluate the relationship of the PPA facilita­ tor (for example, the Bank) with the various stakeholders, especially the poor; to increase the credibility of the information and thereby enhance the potential of the PPAs to influence policy formulation and delivery; to facilitate a process whereby the poor monitor and evaluate the impact of the PPA; and to encourage action at the community level. In designing a dissemination strategy, the demands of the various stakeholders should be considered and key stakeholders should be involved. Where governments have not been involved, results have been mixed. In Cameroon, for example, the results of the PPA were per­ ceived as threatening to the government. Thus, the impact of the PPA was greatly reduced. To build a political base for policy change, effective use of the media as part of a communications strategy can help to increase understanding between the government and the public. Different documents might be needed to meet various stakeholder demands. For example, those at the community level might be more interested in detailed site reports of their community, whereas line min­ istries might want a country-level document. To increase awareness and to disseminate the broad results and policy recommendations of the PPA, countries such as Zambia, Guatemala, and Lesotho have produced clear, well-written, short summary documents that have contributed to widespread ownership and understanding. Another suggestion is for the Bank to produce a separate document on the PPA results in addition to integrating these results into the overall poverty assessment. This could give the PPAmanagers more autonomy and accountability. The design stage should include consideration of how the data will be presented. In Ghana, for example, the information from the PPA was relatively complex and extensive, making incorporation into other World Bank reports time-consuming. In other PPAs, it might be appro­ priate to use the visual diagrams from the PRA exercises (see appendix D) in the final report as a means of conveying information. One reason that PPAs have not resulted in more action has been the lack of specificity in the presentation of results. Wherever possible, therefore, proposals should be presented in matrix form, detailing the following: • Actions that could be taken immediately • Actions that require policy change • Cost requirements • Whether a short or long time is required for results EMERGING GOOD PRACTICE 51 • Administrative order or legislation required • Which ministry, donor, or NGO could take responsibility for carrying out the action. To follow up on such proposals, the PPA should include a monitoring component. Link to Country Strategies To better reach the poor, the results of PPAs and poverty assessments should be closely linked to the World Bank's CASs. Their impact on CASs has been weak because of broad constraints on adopting partici­ patory approaches in both projects and policy work. These constraints include the following: • Accountability. In some areas, it is not always possible to assess the quality and extent of participation. Stakeholder analysis and a plan for including stakeholders in the evolving dialogue are not always clearly presented. Thus, it is difficult to track the process and com­ pare the level and quality of actual participation with the level and quality of planned participation. • Support. Some participatory activities are limited because of the lack of time and funding. In both project and policy work, it is sometimes difficult and time-consuming to obtain funding to include a wider cross-section of stakeholders. Trust funds (grants given by bilateral aid agencies) are available but can be difficult to access for policy work. Core Bank funding is often not available, and many govern­ ments are still unwilling to borrow money for such activities. Pres­ sure to conform to ever-tightening deadlines often undermines broader participation and consequent ownership and commitment. • Evidence. A few people in the Bank and some government officials still question the cost benefit of participation. In 1996, the Operations Evaluation Department surveyed the man­ agers of completed and ongoing poverty assessments (see World Bank 1996j). Only 46 percent of those who answered the question, "What influences the impact of poverty assessments?" believed that the poor should participate in the design and preparation of such assessments. A draft OED report, "Participation Process Review" (World Bank forth­ coming), took note of a World Bank task manager survey on participa­ tion, conducted in May 1999, which revealed that the most significant constraints to participation in Bank operations were a lack of time and 52 CAN THE POOR INFLUENCE POUCY? money, rigid project cycles, and inadequate incentives and management support. In this survey, 81 to 88 percent of task managers agreed or strongly agreed that primary stakeholders should participate exten­ sively in Bank-supported work. For structural adjustment loans and sector adjustment loans, 68 percent agreed. There is now a move to increase the poverty focus of operations by overcoming barriers such as strategic issues-weak links between the PPA and the poverty assessment, between the poverty assessment and the CAS, and between the CAS and operations; lending-emphasis on loans approved rather than on poverty reduction goals; and impact­ focus on input and disbursement indicators rather than on laying the foundation for assessing impacts on the poor. Another Bank report, "Taking Action for Poverty Reduction in Sub­ Saharan Africa" (World Bank 1996i), notes that "poverty reduction is rarely a central or motivating theme for the business plan or country assistance strategies, although responsiveness on this issue has recently improved!' (p. 15). The report contends that CASs are too general to address poverty and that much of the poverty focus of projects is lost by the time the lending program is implemented. The report further states that CASs usually do not make poverty reduction a core objective of economic development programs, that poverty reduction is incidental to macroeconomic stability or lending, and that the link between the reform agenda and poverty reduction usually is not made. The report adds that past CASs have lacked a "strong strategic vision on poverty reduction and clear monitorable actions for reducing poverty" and argues that this shortcoming at the operation level is often rooted in; (a) a lack of information on poverty, (b) inadequate analysis, (c) a disinterested attitude toward poverty reduction, and (d) Bank management's willingness to compromise on poverty reduction to maintain good country relations and to be satisfied with lending operations that address aggregate growth with little attention to the distribution of growth .... Operational decisions, therefore, tend to be based more on sector interests than on poverty reduction [whereas poverty is] a multisector issue requiring an integrated strategy (p. 20). The report calls for the Bank to revamp its strategy to include respon­ siveness to the needs of the poor, which in turn, requires a better under­ standing of poverty-precisely what the PPA can deliver, in conjunction with household surveys. There is now a demand for better poverty analysis to help both the Bank and governments focus their projects and policies more effectively. To achieve this, PPAs should aim to become a building block and not just an adjunct to CASs and policy framework papers. Experience from EMERGING GOOD PRACTICE 53 past PPAs shows that this linkage is greater where the research agendas for the PPA and the poverty assessment have been developed with those working in country departments and on CASso This cooperation can be time-consuming and requires more preparation, but the payoff is a greater impact on the CAS. Another report, "Poverty Reduction and the World Bank" (1997c), details how many of the CASs have become dis­ tinctly more poverty focused, particularly those for Sub-Saharan Africa, ever since the May 1996 directive from senior management to put poverty reduction at the center of the country assistance strategies. Other recent developments include more poverty-focused guidelines for CASs and the rewriting of the Operational Directive on poverty. The reports note that all CASs that are written a year or two after a poverty assessment incorporate the main findings of the assessment, although some do so more comprehensively than others. Since the introduction of the PRSP in 1999, the nature of the CAS has been gradually changing. The CAS will become more like a "business plan" linked to the country's poverty reduction strategy (see figure 8 in chapter 4). A summary of this section is provided in box 10. At the Country Level: Linking PPAs to the Process of Policymaking Using the PPA examples, this section looks at the major issues to be con­ sidered when working with institutions in country. It is divided into the following parts: starting point-understanding the political environ­ ment, creating a conducive policy environment, who controls the research agenda and outcome, and strengthening the policy delivery framework. Starting Point-Understanding the Political Environment Participatory policymaking involves linking information from commu­ nities into a broader policy dialogue that includes a cross-section of stakeholders. In moving from community-level research results to pol­ icy analysis, issues surrounding policy change should be considered. For example, policy formulation is an inherently political process. Rules, legislation, traditions, networks, ethnic alliances, patronage, political allegiances, and bureaucratic structures all interact to form a complex and fluctuating policy environment. Key questions, therefore, include what factors affect policymakers' decisions to create, sustain, alter, or reverse polices; what are the legal complexities of policy change; and what influence does individual survival in an institution, institutional 54 CAN THE POOR INFLUENCE POUCY? Box 10. Factors for the World Bank to Consider to Increase the Impact of PPAs Professional input and commitment • Promote poverty reduction as a clear commitment. The extent to which country departments and country directors at the Bank are committed to poverty reduction will affect the impact of the PPA and poverty assessment. Where this commitment is not clear, operations will tend to be biased toward sector interests rather than poverty reduction. • Measure performance of country directors by the poverty focus of the country assistance strategy (CAS), pipeline projects, and adjustment policies. • Develop skills to conduct poverty assessments and PPAs. Challenge individual behavior, approaches, and motivations. • Observe participatory research in communities to understand the strengths and weaknesses of PPAs. Poverty analysis • Develop trust and understanding between those who managed data collection for the various approaches (surveys and participatory research) and those who are doing the poverty analysis. • Promote a team approach within the Bank and include different disci­ plines to enhance the understanding of the various dimensions of poverty. Ownership in the Bank • Establish broad ownership within the Bank for greater policy rele­ vance. • Create the research agenda for both the poverty assessment and PPA with others working in country departments. Management support and follow-up • Increase the capacity of resident missions for poverty analysis. • Support governments to undertake continuous participatory poverty monitoring, as in Zambia (see box 2), to build up time sequence data. • Monitor not just the outcome of the policy dialogue (the PPA, poverty assessment, and CAS) but also the process of participation and consul­ tation. Also monitor the follow-up of the PPA and poverty assessment recommendations. PPAdesign • Build government capacity to link participatory research with house­ hold surveys (as in Vietnam). Support the building of an iterative process whereby traditional surveys and participatory research inform each other on an ongoing basis. • Help design PPAs that include dissemination strategies. EMERGING GOOD PRACTICE 55 • Build government capacity to produce clear, well-laid-out reports and different reports for different audiences. Detail the process of consulta­ tion in each report. • Assist the government in the use of the media to promote communica­ tion with the public and increase the political base for policy change. Link the PPA and poverty assessment to the CAS • Ensure that PPAs and poverty assessments are building blocks for the CAS. • Work to ensure that the poverty assessment drives policy reform, both in country and in the work of the Bank. • Identify, in the CAS, clear, monitorable actions for reducing poverty that link to the poverty reduction strategy papers. • Build on existing social knowledge in the country. survival in a government, and the maintenance of a regime within a country have on policy choice? A further complexity of the policymaking process is the relationship between policy formulation and implementation. Policymaking and implementation are not disconnected but are part of ongoing interre­ lated processes of change (Grindle and Thomas 1991). But while some policymakers might be willing to incorporate certain issues in the pol­ icy agenda as statements of intent, they might be less willing to imple­ ment the resulting policies because of the political dimensions of implementation (see Wildavsky 1979; Moser 1993; and Wuyts, Mackin­ tosh, and Hewitt 1992). It is within this dynamic that the World Bank is trying to influence policy and therefore needs to understand the often hidden influences on policy decisions, including the many institutional, formal, personal, and informal networks that can either help or hinder implementation. For example, in some of the countries where PPAs have been under­ taken, poverty has not been high on the political agenda. Limited polit­ ical support, or a lack of trust between the government and the World Bank, has led to a lack of support in country for some PPAs. In Cameroon, there was a perceived lack of support from the central gov­ ernment, in part because some key policymakers felt excluded from the PPA dialogue. Although the fieldwork was considered to be good qual­ ity and the results relevant, the government was not willing to embrace the findings of the PPA or to initially include in the political agenda con­ troversial issues emerging from the PPA. In general, open political environments provide greater opportuni­ ties for building consensus in regard to poverty issues. For example, in 56 CAN THE POOR INFLUENCE POLICY? Costa Rica, where there is a tradition of bringing marginal groups into the political sphere, the government was eager to better understand poverty from the perspective of the poor and welcomed the PPA. Simi­ larly, in Argentina, the government requested assistance from the World Bank to undertake participatory research. As a result, a strong level of commitment and coordination existed between the Bank and the gov­ ernment in the preparation of the poverty assessment and the PPA. In contrast, in Mali, because of the sensitivity of the poverty issue, the PPA had to be renamed the Living Conditions Survey and open dialogue on poverty was constrained. In countries where poverty is highly sensitive, however, not all poli­ cymakers will be opponents. Individuals respond to a great many fac­ tors, including bureaucratic structures, political stability and support, technical advice, and international actors (see Grindle and Thomas 1991). Some might support the PPA if they perceive it to be for the good of their society, since not all policymakers are just rent seekers. It is good practice to identify and include those who support the idea of the PPA at the beginning of the dialogue and gradually build up broad-based support. Such good practice requires that Bank teams have an in-depth country knowledge of policymakers and that they develop relation­ ships with and understanding of the key players. The experience with PPAs is showing us that merely presenting to policymakers the results of new information generated through PPAs does not guarantee policy change. As a result, more recent PPAs have also focused on the policymaking process and the political context of policy choice and policy change. Creating an Environment Conducive to Poverty Dialogue Without government support, or even with limited support, the impact of the PPA is lessened. Because the ultimate objective is to influence pol­ icy rather than just produce technically sound documents, the value of conducting a PPA with little government support should be questioned. With limited support, a key issue will be what happens when the research results run counter to the government's interest. Thus, dialogue is needed to build trust and understanding between the Bank and the government before the PPA is undertaken. Generating a more open climate can help ensure that the government is less threatened by the PPAresults and that the PPA thus will have greater impact. The participatory process will vary greatly from country to country, and the inclusion of different stakeholders within the PPA and poverty assessment should be attuned to the country's overall political, social, economic, and institutional environment. In this kind of highly context­ EMERGING GOOD PRACTICE 57 specific work, it is not possible to provide a blueprint; personal judg­ ment is required. In some countries it might be appropriate to include a cross-section of stakeholders rather than targeting only a few policy­ makers. In South Africa, for example, the unexpected closure of the South African Reconstruction and Development Office meant that the initial strategy of focusing on one particular department was rendered inadequate (see May and Attwood 1996). Maintaining a receptive attitude is not easy in a dynamic environ­ ment, where unexpected conflict often occurs and agendas and people change. Continuous follow-up and dialogue with various stakeholders are therefore recommended. This approach requires a shift from top­ down prescription to a more flexible process approach, with local dia­ logue being maintained in country. The challenge for many PPAs, and for the Bank's wider country programs, is to maintain the new partner­ ships created through such dialogue. Who Owns and Controls the Research Agenda and Outcome of the PPA? At the national leveL ownership and commitment of stakeholders have varied among the PPAs. The Bank's experience has shown that the involvement of key policymakers from the beginning enhances owner­ ship and commitment. Where appropriate, the following measures can help to increase policy impact: • Involve policymakers in the early planning of the PPA • Bring key policymakers into the field to participate in the PPA • When sharing a report with government policymakers, include local communities who contributed their analysis • After the results are presented, convene workshops with policy­ makers and local people • Negotiate high-level commitment to follow up the PPA and monitor the implementation of key recommendations. In Argentina and Zambia, key government officials were included from the beginning and often led the process. As NGOs and other stakehold­ ers were gradually included, the room for dialogue on poverty increased. This approach led to greater understanding and trust between the government and the NGOs. In South Africa, stakeholder involve­ ment from the beginning was a time-consuming but important step in a complex process of dialogue, with a high level of ownership and com­ mitment evident. In contrast, in Togo and Cameroon, key policymakers were not included early in the process and, therefore, the PPA's impact 58 CAN THE POOR INFLUENCE POLICY? has been limited. Similarly, in Lesotho, the government was initially not included and there was limited ownership. Local ownership was cre­ ated only when the action plan was formulated by the government with a cross-section of stakeholders. In regard to control, Owen (1996), in his analysis of the PPA in Mozam­ bique, discusses the difficulty of satisfying the demands of multiple stakeholders. He asks, "Whose PPAis this?" Diverse and sometimes con­ flicting demands have the potential to undermine the participatory nature of the PPA, with the institutions that control the process wanting to produce documents according to predetermined deadlines and docu­ ments that represent their point of view. Owen further points out that where control has been relinquished there may be a tradeoff between ownership and quality. Box 11 discusses the complexity of achieving ownership even where a participatory process has been adopted. Control and ownership of the PPA are also linked with the govern­ ment's ability to negotiate with the World Bank. Generally, if donors adopt a top-down approach to assisting in policy formulation, there will be limited ownership and commitment on the part of the government. Several government officials in Guatemala felt excluded from the PPA process, and relations between the Bank and the university that under­ took the PPA were weak and antagonistic. Ownership of and commit­ ment to the PPA results were, therefore, limited until the university published an independent document on poverty in the country, without any World Bank input. Although the information from PPAs might be relevant and result in changes to policy documents, without ownership there will be no long­ term shifts in attitude. It is recommended that for greater ownership, the research agenda should not be determined solely in Washington. Those who influence policy in country should be part of the discussion. This process might take much longer than anticipated, so the PPA design should be flexible to accommodate unexpected delays. Delays become more likely as more stakeholders become involved, and it is not always possible to predict how or even if consensus will be achieved (see box 12). Strengthening the Policy Delivery Framework Policy change is not just about writing a new policy document-it is also about implementing that policy. To link policy formulation to imple­ mentation, good practice is to focus on the following: • Increasing in-country capacity for ongoing research • Creating channels for ongoing dialogue among a cross-section of stakeholders EMERGING GOOD PRACTICE 59 • Opening up a process of continual negotiation on the political agenda, in which the views of the poor are taken into account • Maintaining partnerships. Box 11. Handing Over the Document Does Not Equal Owner­ ship Zambia: There was extensive dialogue with a cross-section of stakehold­ ers in the Zambian poverty assessment and PPA and, as a consequence, there was a strong and widely shared feeling of ownership of the process and the action plan. The Zambians drafted the recommendations section of the poverty assessment. However, in discussions with the local research team in Zambia,' one government official asked about the PPA: What is there on this document's cover to show that it is owned by the gov­ ernment? There is no coat ofarms or government logo, no preface by any government official. An NGO representative added, The World Bank calls a national workshop at Mulungushi International Conference Center, introduces the poverty assessment, and hands over the ownership ofthe poverty assessment to the Permanent Secretary chairing the workshop. Just like that and the Bank thinks it has resolved the own­ ership issue. It had been clearly stated and widely understood from the beginning that the poverty assessment was a Bank document. Although one objective is government ownership, it might not be appropriate to expect some gov­ ernments to feel ownership of documents that were initiated in Wash­ ington and carry the World Bank logo. Some governments might not even want ownership, but might want the document to remain identified as a Bank document in order to promote an independent assessment. However, in other cases it might be appropriate for the Bank and the gov­ ernment to publish a joint document. South Africa: The PPA included key policymakers from the beginning and ownership gradually developed among high level stakeholders. For example, the cabinet met twice to discuss the PPA. The first meeting took two hours and was chaired by Thabo Mbeki, the Deputy President of South Africa. •For this study, a local research team was contracted to review the process and impact of the PPA. For a full report, see Mutesa and Muyakwa (1997). 60 CAN THE POOR INFLUENCE POLlCY? Box 12. Participation Is More Than Holding Workshops Pakistan: The poverty assessment was the first economic-sector work in Pakistan to be widely disseminated and discussed. The workshops were followed by many positive press reports and increased awareness of poverty issues. The process helped encourage the government to form a group specifically to look at poverty issues. There was a general feeling that the poverty assessment was a good analysis but that it was too narrow because it used only the consumption measurement of poverty. How to measure poverty was the subject of extensive debate. Government officials and NGOs felt that the main mes­ sage from the assessment was that poverty in Pakistan had declined. This was disputed by some Pakistani economists, who stated that different measurements would produce different results, and by NGOs that had extensive countrywide experience. Stakeholder views had been expressed in various workshops for the poverty assessment but many felt these views had not been adequately reflected in the final document. As a consequence, some commented that the assessment was the Bank's "justification for structural adjustment" and challenged its objectives. One senior government official had attended many workshops but felt that his extensive participation during the workshops and written comments had not been considered. The ques­ tion was raised about which institution controlled the research agenda and outcome of the poverty assessment. The main message from this experience is that participating in work­ shops is not the end of a process of participation. A final consensus might not be feasible, so differing views should be reflected in the final docu­ ment. Furthermore, if people's views are not included, that should be explained. A recommendation is that PPA and poverty assessment man­ agers should know how to organize workshops and do appropriate fol­ low-up, including incorporating the views of all participants in the research results where possible, or at least the main themes emerging from the research. The quality and follow-up of workshops will affect both the impact of the PPA and the relationship among participating stakeholders. In most countries, it will be important to build a constituency for reform beyond the government because societies are becoming increasingly pluralistic and change often depends on a variety of partnerships. The role of other international donors, which have the power to influence national policy, should also be considered. The United Nations Devel­ opment Programme (UNDP) is currently undertaking poverty analysis in some countries using participatory methods. In Togo, the UNDP was a partner in the PPA exercise, and its resident mission continues to pro­ mote participatory analysis. In Ecuador, UNICEF used PPA methodolo­ gies to evaluate the impact of its program. EMERGING GOOD PRACTICE 61 Some PPAs have been carried out in partnership with institutions that specialize in social research (universities, networks of social scien­ tists, etc.). Such partnerships help to increase the capacity of such insti­ tutions while avoiding the duplication of research and helping to ensure that PPAs become part of the body of social knowledge. The process of policy implementation often alters intended policies. It is, therefore, important to understand the linkages between intention (policy) and outcome (implementation), and identify and include those who will implement policy in the policy dialogue. Administrators at the central and local levels must be included in the PPA. To increase under­ standing of the various research approaches, it is also crucial to include statisticians from line ministries. For example, in Kenya, the Central Bureau of Statistics assisted in coordinating the PPA. Because governments and donors have traditionally focused on sec­ tors as opposed to cross-cutting themes, it might be difficult to place participatory research results within one institution. A recommendation is to identify an institution in country where such data could be ana­ lyzed, coordinated, and disseminated. Many countries have collected great quantities of participatory data but lack follow-up and coordina­ tion. Finding an entry point for participatory research results might encourage more continuous research by a cross-section of institutions, thus contributing to broadening the policy dialogue and eventually to an increased government and Bank commitment to poverty alleviation. See box 13 for a summary of this section. At the Community Level: Including the Poor This section analyzes how to undertake participatory research at the community level, focusing on good practice to achieve credibility and legitimacy of the PPA. The section is divided as follows: research teams, management of research teams, and research process. Research Teams Composition The composition of the research team working at the community level is usually context specific. In general, men and women should be equally represented, and familiarity with local culture, especially a knowledge of local languages, is essential. In Zambia, for example, the research team comprised one manager (male), and five male and four female facilitators of mixed ages and ethnicity. This team then split into mixed gender groups of three to four researchers and spent two to three days in each community. In Tanzania, 35 researchers split into teams of five or six and worked in six different provinces. 62 CAN THE POOR INFLUENCE POLICY? Box 13. Factors to Consider at the National Level to Increase the Impact of PPAs Understand the political environment • Secure support from the beginning; government leads the process. • Undertake the PPA only after potential political implications have been thought through. • Use the institutional, formal, personal, and informal structures and networks, and understand the impact they have on policymakers. This requires Bank teams to have an in-depth knowledge of the country. Create a conducive policy environment, if possible • Question the value of conducting a PPA for which there is limited gov­ ernment support. • Build dialogue to create a more open climate, so that governments feel less threatened by the resulting data. • Maintain a policy dialogue through continuous follow-up with various stakeholders. • Attune stakeholder involvement to the overall political, social, eco­ nomic, and institutional environment in country. There is no blueprint approach to the timing of stakeholder inclusion in the policy dialogue. Promote ownership • Include key policymakers from the beginning. Develop relationships with and understanding of the key players. • Include key policymakers and administrators in designing, planning, and implementing the PPA and analyzing the results. • Consider publishing PPA results as a government document where pOSSible. Data should be government owned. • Know how to organize workshops with appropriate follow-up. Work­ shops are not the end of a process of participation. Final consensus might not be achieved, so the documents should reflect the differing views. If people's views are not included, that should be explained. The quality and follow-up of workshops will affect the impact of the PPA and the relationship among participating stakeholders. • Use PPAs to contribute to the development of Poverty Reduction Strat­ egy Papers by induding the poor in the consultation process, provid­ ing data for poverty analysis, and where the PPA is an ongoing process, building country capacity to monitor poverty. Strengthen the policy delivery framework • Identify a credible institution in which participatory research could be analyzed, coordinated, and disseminated. Investigate provincial capacities. • Work with institutions (universities, networks of social scientists, and the like) already undertaking social research to ensure that research is not duplicated and the PPA becomes part of the body of social knowl­ edge. EMERGING GOOD PRACTICE 63 Preparation Teams should be well prepared before going to research sites. PPA expe­ rience has shown that even where teams are experienced in participa­ tory methods, at least two weeks of training are required to discuss the complexities of undertaking national-level policy analysis; match par­ ticipatory tools with the research agenda; decide on methods of record­ ing and reporting; create an initial framework for analysis of results; build up a team spirit; and discuss attitudes and behavior. Compromis­ ing on training time leads to poor-quality research. Teams should also be aware of major policies linked to the research agenda before going to communities. Skills The skill and role of facilitators become increasingly important to achiev­ ing credibility when participatory exercises are extended from the proj­ ect level to the national level for large PPAs. The speed of scaling up, often to fit with donor agendas, has often led to compromises on the quality of research. If the facilitation of participatory methods is poor, data could be biased, vulnerable groups excluded, and outcomes inac­ curately analyzed. This bad practice has hurt the credibility of partici­ patory methods. Good-quality work requires a combination of factors, including a good attitude, technical skills, and experience on the part of the facilitator. In Mexico, it was difficult to find a suitable national consultant who was not politically affiliated to coordinate the PPA. In addition, control­ ling the process of gathering information proved problematic because the teams attempted to follow their own agenda. In Togo, the teams in the field had limited skills to analyze the results. In Mozambique, in an internal evaluation of the preliminary research phase, it was concluded that teams were too unfamiliar with the communities to develop trust, and some were not able to apply the methods effectively. The major question now emerging is how to integrate the diverse data sets into a comprehensive analysis of poverty. Some have also argued that integration could be relevant at the data collection stage (see Chung 2000; Ravallion 1996). Integrating quantitative and qualitative research using the same teams has implications for the types of skills required by research teams. Whereas questionnaire surveys require enu­ merators, participatory research requires facilitators who have a com­ pletely different set of skills, behaviors, and attitudes. Therefore, although it might not be feasible to expect a team of enumerators to con­ duct credible participatory research, different teams could be used for different research techniques (for example, PPAs in India [Uttar Pradesh and Bihar] and Kenya). 64 CAN THE POOR INFLUENCE POUCY? Management of Research Teams A key issue for good-quality participatory research that is emerging from this study is how to effectively manage research teams. Two major concerns require further investigation: Diverse team structure Most PPA research teams have been selected to represent the major groups in society. In Tajikistan, where participatory research was under­ taken to support a World Bank poverty alleviation program, team mem­ bers were selected to reflect the composition of Tajik society. The team consisted of men and women of all ages (college students, middle-aged people, elders) and education levels (from village schoolteachers to doc­ tors and academics), from rural and urban areas, and from all major eth­ nic groups. The objective was to design a team that was not biased toward anyone subgroup, especially the more educated urban elite. During debriefing sessions and informal discussions with fieldwork­ ers, the research manager was able to gather a great deal of information as long as she did not show preferential treatment toward any group. This meant breaking some social rules in Tajikistan by making room for the less-educated rural woman to voice her opinion. However, it also meant creating opportunities for the elder male to represent the team in meetings with local officials. The manager stated, "While on the whole this choice had positive results for the team, participation practitioners need to be aware that this minisociety is not necessarily easy to man­ age." 2 Certain members of the team tried to control the discussions based on their societal role. In Tajikistan, social hierarchies are designed along education, age, and gender lines. There is also a hierarchy among regional ethnic groups and among castes within some groups. The man­ ager noted that although she was able to supervise and effectively man­ age the debriefing sessions, the dominant people were able to take over the report writing, which was done in separate groups. Psychological toll of poverty research Another challenge is managing the psychological toll of poverty research. PPAs, which are based on the premise of seeing poverty from the point of view of the poor, might expose fieldworkers to some degree of trauma for which they are not prepared. In Tajikistan, although the field workers had been involved in surveys and other studies, most of them lived in the capital and had little information about the depth of poverty in the regions. The manager stated that as fieldwork progressed into its second week, some fieldworkers broke down as they described their day's work. In Equatorial Guinea, as well, the poverty was more EMERGING GOOD PRACTICE 65 severe than expected and in this case also, field workers broke down during debriefing sessions. The outcome is often that fieldworkers feel depleted emotionally and physically, which could affect the quality of their analysis. Research Process Selection of an institution Identifying an appropriate institution to undertake the research can be difficult. Local knowledge of credible, neutral institutions is required. In general, PPAs have been more successful when the selected institution has some existing capacity to undertake participatory research; for example, a research institute, NGO, or social science network. However, some organizations claim to have experience in participatory research but do not have the capacity to undertake good-quality research, thereby compromising the credibility of the PPA. To increase credibility, it might be appropriate to use an existing NGO network, where there is often a wealth of knowledge and skills. The advantages of using these networks, as opposed to training new teams, are as follows: • Many NGOs have already established trust with communities and undertaken participatory research. • The results could be followed up by the NGOs working in the com­ munities, thereby ensuring that the research is not purely extractive. The limitation here is that the research results would be biased toward communities where the NGO has already had some impact, and the poorest communities might not be included. • The PPA research could help to strengthen the capacity of existing NGO networks. • Information could be collected by NGOs over time, and links estab­ lished between the NGOs, policymakers, and statistical departments. It should be noted, however, that few NGOs have the skills and capac­ ity to undertake good-quality research on a large scale and that some NGOs may have sector biases. Raising expectations The research process in some PPAs has been viewed as exploitative because it takes the community's time, raises expectations, and under­ mines self-reliance. Facilitators should, therefore, clearly state the objec­ tive of their visit. An example of bad practice is producing community wish lists instead of analyzing the community's needs. Furthermore, if the agency then funds the priority identified on the wish list without community participation and capacity building, dependence on the 66 CAN THE POOR INFLUENCE POLlCY? outside organization increases, community self-reliance is undermined, and false expectations are raised. PPA researchers in Pakistan, Mozambique, and Zambia reported that some communities expressed hostility toward the research teams, espe­ cially where there was extensive research with limited follow-up. In Armenia and Moldova, communities expressed frustration and anxiety over being involved with many research exercises with no improve­ ment in their situation. In these countries, the fieldworkers also reacted with frustration and some accused the participants of complaining rather than doing and being stuck in old ways. The manager of these assessments suggested that the fieldworkers were reflecting the frustra­ tion of the participants. Time spent in communities In many communities, it is easier and quicker to interact with the local elite, thereby missing the poorest (who are often less articulate, over­ worked, and unable to attend meetings) and women (who do not often leave their homes and are used to being excluded). To overcome this limitation, facilitators need to be aware of the power relations in the community and the composition of the community as a whole. Some PPAs have rushed the research process in order to meet deadlines, often leaving out the poorest and those on the periphery. The difficulty of undertaking participatory research in urban areas has been an issue in many PPAs (see Norton 1994) where more time and flexibility are required than in rural areas. For example, Moser and Hol­ land (1996) highlight the issue in Jamaica of confidentiality in wealth ranking and fear of being identified as part of the research because of safety. In the urban areas in Zambia, it was difficult to identify social groups, and people were occupied and not willing to participate. In other urban areas there might be a question of safety for the research teams, especially for women researchers, as was the case in Costa Rica and Zambia. Tools There is a widely held belief that for participatory research to be more accurate, the tools and techniques should be standardized. However, flexibility can be strength, for the approach, tools, and techniques will vary depending on the community. But in some circumstances it is pos­ sible to use certain standardized participatory methods on a wide scale to generate numeric information. Beneficiary assessments have quanti­ fied results based on a sampling frame, as in Costa Rica and Madagas­ car. The UNDP's PPA in Bangladesh used standardized methods for focus discussion groups and the identification of priorities (see UNDP 1996). The utilization survey conducted by Action Aid in Syndhupal­ EMERGING GOOD PRACTICE 67 chowk, Nepal, used participatory mapping in more than 130 villages to generate service utilization data. 3 In some household questionnaire surveys, questions are preset by outsiders and the respondent is not likely to know the interviewer. PPAs that use the participatory rural appraisal tools (visuals and group analy­ sis) typically elicit more accurate responses when • Institutions conducting the research are known and trusted by the communities • Group dialogue and analysis encourage people to challenge inaccu­ rate responses • Data are triangulated (checked with informants and data sources) to test for accuracy and to find areas that need probing • Researchers and local people learn from the process • Marginal groups are targeted • Data are analyzed by the community. Skilled facilitators are needed to conduct this type of participatory research. Where skills have been lacking, the accuracy of PPA data has suffered. During the research process, teams can learn from each other in reg­ ular meetings where tools and approaches are reviewed and differences between various social groups discussed. Site reports could be compiled as a result of the meetings and later disseminated to communities. Local officials should be included where appropriate and results of the partic­ ipatory research at the community level shared with them. See box 14 for a summary of this section. Analysis and Synthesis: Combining PPAs with Household Survey Data In the past, poverty analysis was dominated by quantitative data derived from nationally representative household surveys. Since the beginning of the 1990s, participatory research has been increasingly used to define poverty and influence policy. The need to combine par­ ticipatory research with household survey data is now more accepted, as illustrated in recent literature. However, at the operational level, household survey data are used more extensively in poverty analysis and are still seen to be more credible than data from PPAs. This section discusses some of the strengths and weaknesses of the most important surveys now used in poverty analysis, focusing mainly on household surveys and PPAs; and highlights some of the tensions that have arisen from attempting to combine these data sets. 68 CAN THE POOR INFLUENCE POLlCY? Box 14. Factors to Consider at the Community Level to Increase the Impact of PPAs Research teams • Develop trust between the research teams and communities. • Be aware of bad practice in participatory rural appraisals (PRAs). Facilitators need experience, skills in applying the tools, and the abil­ ity to hand over control. • Training of teams takes at least two weeks to discuss the complexities of undertaking national-level policy analysis; match participatory tools with the research agenda; decide on methods of recording and reporting; create an initial framework for analysis of results; build up a team spirit; and discuss attitudes and behavior. Experience has shown that compromising on training time leads to poor-quality research. • Be aware of major policies linked to the research agenda before going to communities. Management of research teams • Be aware of the difficulties in managing diverse research teams that often represent different ages, genders, and ethnic groups. • Be aware that research teams working with poor communities may experience some degree of trauma for which they are not prepared. Managers should understand that this outcome is possible. This is an emerging issue, and more training is required for both field researchers and managers to find ways in which such outcomes can be better man­ aged. Research process • Share information with communities on an ongoing basis. • Do not undermine community self-reliance. • Be aware of respondent fatigue and raising expectations. Many com­ munities-especially those accessible from major cities-are the sub­ ject of excessive research. • Review existing data and material pertaining to the area before initi­ ating any study. • Identify credible, not just experienced, institutions to undertake research. Use existing NGO networks where appropriate to promote follow-up. • Allow for more flexibility in urban than in rural areas. • Link results of PPA with other institutions for follow-up. • Write clear site reports to disseminate to communities. • Recognize the limitations of the PPA. Participatory poverty research is not a methodology for empowerment. EMERGING GOOD PRACTICE 69 Methodologies • Adapt the methodologies to the research agenda. • Use PRA for greater community-level analysis and ownership. Be aware of the dangers of rapidly scaling up PRA methods, which can undermine the quality of the research. • Avoid biases-triangulate data. • Quantify and record the number of people involved in the participa­ tory research. Analysis and synthesis • Understand the difficulties of drawing macro conclusions from micro analysis. • Present clear policy messages--do not present everything Background to Household Surveys World Bank poverty assessments have used different types of house­ hold surveys since underpinning all poverty statistical analysis is a need for a wide variety of data. Table 8 provides a summary of the main household survey types. Typically, a national household income or expenditure survey, or a multipurpose Living Standards Measurement Study (LSMS), is under­ taken to provide basic information on the patterns of poverty. Anumber of countries have based their poverty analysis almost exclusively on national income and expenditure surveys. It is now widely recognized that this approach is one-dimensional, and where possible, these data are supplemented with other data from such sources as demographic and health surveys. In order to have a single survey cover a range of top­ ics, multitopic surveys were developed. In Africa, a common form of multitopic survey has been the Priority Survey-a single-visit survey that includes household consumption estimates. The most comprehensive and ambitious multitopic survey is the LSMS. Many World Bank poverty assessments use data collected through the LSMS. Data are collected by an enumerator who typically makes two household visits, each usually lasting three to four hours. The Priority Survey is similar to the LSMS but has a shorter question­ naire and usually covers a larger sample of households-8,OOO as com­ pared to the 2,000 to 5,000 covered by the LSMS (Carvalho and White 1997). The first LSMS in a country can take between 18 and 36 months and costs between US$500,OOO and US$1 million. More recently, the World Bank has been developing the Core Welfare Indicators Questionnaire (CWIQ).4 The CWIQ is a household survey 70 CAN THE POOR INFLUENCE POLICY? Table 8. Summary of Household Survey Types Household survey Advantage Limitation Multitopic surveys Measurement and analysis Time-intensive collection (for example, LSMS of different poverty and analysis and Priority Survey) dimensions, their inter­ relationships and correlates Demographic and Health-poverty measurement, Measurement of other health surveys health behavior analyses, dimensions of poverty basic poverty diagnostics limited, diagnostics limited Employment surveys Analysis of employment Limited use for poverty patterns, wage income measurement and analysis (linked to education) diagnostics Single-topic surveys Income-poverty measurement Limited diagnostics (or another single dimension) possible Rapid monitoring Quick and cost-effective Income-poverty surveys and service monitoring of key welfare measurement not satisfaction surveys indicators, often with a focus possible, limited (for example, Core on measuring beneficiaries' diagnostics Welfare Indicators access to, use of, and Questionnaire) satisfaction with services Source: Adapted from the World Bank Poverty Reduction Strategy Sourcebook (2000, p. 43) at the following address: http://www.worldbank.org/poverty/strategies/chapters/data/data.htm. that uses structured questionnaires and probability-based samples. It draws extensively from market research methodologies. It is used mainly to monitor development objectives through the use of leading indicators such as beneficiaries' access to, use of, and satisfaction with services. The CWIQ is based on large samples (in Ghana, the sample was 15,000 households), short questionnaires, easy data collection, quick data entry and validation, simple reporting, and fixed core and flexible modules. The CWIQ, by virtue of its streamlined format, can yield results more quickly than other household surveys. The World Bank is planning to pilot, in Tanzania, a Community Ser­ vice Delivery Survey, which combines a simple household survey based on the CWIQ model with a participative needs assessment survey. The main objective will be to monitor the delivery of local government ser­ vices. The survey will be facilitated by local government and filled in by communities. The idea will be to aggregate the results for each district and then present them to communities so that they are able to compare their village'S services with those of others in their district. EMERGING GOOD PRACTICE 71 Key Differences and Similarities of Household Surveys and PPAs Table 9 compares the kinds of data collected by household surveys and PPAs, as well as differences in collection, analysis, and synthesis of data. The different survey approaches have evolved from different tradi­ tions. Whereas household surveys determine one reality and attempt to predict behaviors by testing hypotheses (positivist tradition), PPAs seek diversity and present what can sometimes be uncomfortable results reflecting many realities of a diverse and unpredictable environment (post-positivist or constructivist). Unlike household surveys, which col­ lect statistical data on the extent of poverty through standardized meth­ ods and rules, PPAs focus on processes and explanations of poverty as defined by individuals and communities within an evolving, flexible, and open framework. Participatory research is more open-ended and interactive. Rather than looking for statistically significant relationships to explain behavior, it emphasizes multiple realities and divergence. Thus, it is important to be clear about which paradigm informs and guides the researcher's approach (Guba and Lincoln 1996). Traditional survey data can be used to count, compare, and predict. The strength of the PPA is not in counting but rather in understanding the hidden dimensions of poverty and analyzing processes by which people fall into and get out of poverty. PPAs also seek diversity and rec­ ognize that behavior is difficult to predict; moreover, comparisons are often not possible in a dynamic situation. Booth and others (1998) make a distinction between contextual methods (for example, PPAs) that aim to capture social phenomena within their social, cultural, economic, and political context, and noncontextual methods (for example, household surveys) that are designed to collect information that is untainted by the context. Quantitative and qualitative There has been a tendency to see a dichotomy between traditional household surveys, which are considered quantitative and objective, and PPAs, which are considered qualitative and subjective. In practice, however, these divisions are not as clear and are often misleading, since subjective questions are increasingly being used in traditional surveys and many PPAs contain quantified information and analysis. Further, there is a qualitative dimension to traditional survey work. In house­ hold surveys, for example, interviewers and analysts will interpret infor­ mants' answers subjectively. In the best poverty analysis, the two merge into one integrated analysis (for example, the World Bank's poverty assessments for Armenia and Zambia, and the Ugandan government's 1999 Poverty Status Report). For clarification, methods and data should 72 CAN THE POOR INFLUENCE POLICY? Table 9. Characteristics of Household ~ .....,.n'" and PPAs Household survey PPA Deductive Inductive One reality Multiple realities Representative sampling Purposive sampling More breadth More depth Structured interviews are used Semistructured interviews, focus to collect data group discussions, and participa­ tory visual exercises are used to collect data Noncontextual methods Contextual methods Collects both quantitative and Collects both quantitative qualitative data and qualitative data Seeks statistically significant Looks for meaningful patterns; relationships identifies causality and explains statistical correlation Less rapid: can take 18-36 months More rapid: can take 6-9 months to complete to complete Methods drive the questions Questions drive the selection of participatory methods used Outcome oriented Process oriented Household as primary unit of analysis Intrahousehold relations, social be clearly separated. For example, PPAs are a contextual method that collect quantitative and qualitative data, and household surveys are a noncontextual method that produce quantified data (see Hentschel 1999 and Booth and others 1998). Types of nata collected Neither household surveys nor PPAs are more accurate than the other, since each produces different types of data, fulfilling different informa­ tional requirements and illuminating various dimensions of poverty and what it means. While household surveys can provide information on the extent of poverty, PPAs provide explanations, shed light on com­ plexities, and identify the priorities of the poor, making possible new levels of analysis. A PPA alone will not give the whole picture; neither will a household survey. Household surveys often interview only the head of household (usually a man). PPAs typically gather information on intrahousehold issues from more than one perspective, and also EMERGING GOOD PRACTICE 73 explore interhousehold and community-level social issues in addition to gathering household data. The accuracy of a method should also be judged by the extent to which it yields fruitful answers to the questions being asked. Further, a technically accurate method can be inappro­ priate if it is not the best and/or most feasible way to answer a given question. Quality of collection and analysis It is now more widely recognized that scaling-up (carrying out larger­ scale research beyond individual communities) of participatory tech­ niques has led to the quality of information being compromised. Likewise, household surveys have been criticized for manipulating data and producing misleading results-that is, that which is measured in household surveys is all that matters. What is measured is usually deter­ mined by outsiders who may have limited knowledge of local people's realities. Chambers (forthcoming) states that there is a need for codes of behavior when analyzing participatory research. He adds that it is nec­ essary to repeatedly examine how information and knowledge are gen­ erated. "This means critically straining for honest reflection on how one's own ego, mindset, institutional context, and social and political interests combine to select and shape both personal knowledge and the form it is given when passed on to others." A further limitation of both household surveys and PPAs is respondent fatigue-many respondents have complained about the demands on their time. For PPAs, research teams should begin to analyze information dur­ ing the research process. However, analysis and synthesis require highly trained teams to ensure that the results are valid. In South Africa, a two­ day workshop on report writing was convened for the PPAresearchers, and card sorting techniques were used with the communities to analyze the material and determine categories for the reports. Policymakers could be involved at this early stage of analysis to better understand the process. Quick and early feedback to key individuals could help policy­ makers understand the preliminary findings and feel some early own­ ership before the final report is issued. Some PPAs have collected valuable information, but not all of it has been useful to policymakers. PPAs should try to achieve "optimal ignorance 115 (Chambers 1993), so that information is collected only on issues relevant to policymaking. Careful selection of methods that link to the identified research issues is required. In Mozambique, the PPA presented too much information to policymakers. This was the result of a lack of coordination between the research agenda and methods applied in the field, as well as the report­ ing style of the coordinating institution. PPAs have achieved less credi­ bility when the results have been too broad, too obvious, or too complex for policy use. 74 CAN THE POOR INFLUENCE POLICY? Influence of knowledge and power In the process of data collection, analysis, and synthesis, the key ques­ tion is, Who controls the selection of data used to influence policy? The handling of data is often determined by power relations, and power influences the construction and use of knowledge. As Chambers (forth­ coming) states, "It is that power forms and frames knowledge and that interpersonal power distorts what is learnt and expressed." In most tra­ ditional surveys, control remains in the hands of those outside the com­ munity, especially in • Designing the questionnaire, which is inflexible and based on what policymakers want to know. Questions are generated in the capital city, reflecting the researchers' bias. • Asking the questions, with control remaining with the interviewer, and respondents often feeling inhibited by power differentials (espe­ cially between educated enumerator with paper and pen and illiter­ ate respondent; male enumerator and female respondent; urban enumerator and rural respondent). Respondents frequently react to such power relations by telling the enumerators what they want to hear. • Analyzing the data, which remains outside the community, as does control of its publication. Once results are accepted, they are repeated and consequently widely believed. Chambers (1997) notes, "To this day, the extent to which sur­ vey results are socially and personally constructed remains under­ researched, under-reported and under-recognized" (p. 95). Participatory research is undertaken by facilitators using a diverse set of participatory tools determined by the research agenda and local con­ text. Enabling the poor to participate leads to a reversal in the relation­ ship between the community and the outsider that is implicit in traditional surveys. Facilitators of participatory research need different skills and behavior, including listening to and respecting the expertise of participants, building trust, handing over control, and allowing the community to define the poverty issues that matter. The poor are viewed as participants or partners in the research process, data are shared with them, and the analysis of research results takes place within the com­ munity. The poor thus have more control over the research process, and their capacity to appraise, analyze, plan, and act is recognized. However, even though the analysis of PPAs is controlled by commu­ nities to some extent, when this information is translated into macro policy messages and results are aggregated, local people may lose the control and results may not be fed back to communities for comment EMERGING GOOD PRACTICE 75 and verification. Complex and detailed community-level information is valuable for both project design and policy formulation. However, inac­ curacies sometimes arise from extrapolating to the national level for pol­ icymaking as information becomes too generalized and the context ignored (see Attwood, 1996 for a case study in South Africa of this issue). Criteria for measuring robustness It is recognized that there is a need to strengthen the rigor and thus the quality of participatory research. Sample surveys, including the LSMS, are based on the principle that behavior can be measured, aggregated, modeled, and predicted according to statistical measures of reliability or "robustness." One way to test the robustness of PPA data is to add questions to household surveys based on the findings of the PPA. How­ ever, many key PPA conclusions may be context specific and it is not always possible for the results to be representative at a national level, standardized, or aggregated. Many PPA practitioners would argue that it is not always desirable to aggregate and generalize. The strength of some PPA data is their diversity and context-specific nature, as priori­ ties vary across different communities / districts / regions. Guba and Lincoln (1981) argue that traditional criteria for robustness are inappropriate for participatory research and should be defined dif­ ferently. Moreover, many surveys are judged on sampling error, but Stone and Campbell (1984) contend that there is also a nonsampling error such as "contextual bias" (for example, cultural differences), which surveys do not take into consideration but which influence the robust­ ness of the results. There is a widely held belief that for participatory research to be more robust, the tools and techniques should be standardized. Flexibility, however, can be a strength, as the approach, tools, and techniques will vary depending on the community. But in some circumstances it is pos­ sible to use certain participatory methods on a wide scale to generate quantitative information. Beneficiary assessments have quantified results based on a sampling frame. The UNDP PPA in Bangladesh used standardized focus discussion groups and the identification of priori­ ties. Also in 1991, the Utilization Survey conducted by Action Aid in Syndhupalchowk, Nepal, used participatory mapping in more than 130 villages to generate data about service utilization. 6 Chambers (1997) argues that relevance is also an important consideration--can the results be used for learning and action? Bias In both PPAs and traditional surveys, bias emerges through the inter­ pretation of answers and, most critically, the analysis of results. In par­ 76 CAN THE POOR INFLUENCE POLICY? ticipatory research, changing the relationship between the outsiders undertaking the research and members of the community is not an easy process. In a few recent PPAs, the outside facilitator remained dominant and community members tended to say what they thought the facilita­ tor wanted to hear. PRA visual exercises can help to reduce such distor­ tions by opening up the discussion and analysis. But some distortions might still exist, because the process of compiling PPA results involves many stages of information filtering (see figure 7). Where PPAs are more closely linked to the policymaking process, it should be recognized that they may not be politically neutral. In household surveys, bias emerges through preset questionnaire designs, the enumerator's interpretation of answers to the preset questions, and analysis of results. From micro (community level) to macro (policy level) Although community-level PPA information is valuable for project design, inaccuracies sometimes arise in extrapolating from the com­ munity level to the national level for purposes of policymaking, as it is not easy to filter and translate complex messages from the local level. These inaccuracies, however, do not always occur. For example, the Zambian PPA used a small number of communities in different parts of the country, and they had certain characteristics that were administra­ tively uniform and climatically similar. School fees had to be paid in December and January all over the country, and these months were stressful for all rural areas. Thus, a simple message was created. The lesson is that different types of conditions need to be better identi­ fied, as well as the degree to which they can be generalized for policy purposes. Combining PPAs with Household Surveys To ensure that PPA data do not remain an add on" to the poverty analy­ II sis, the surveys should be combined throughout the research process into four stages: design, implementation, analysis and synthesis, and dissemination (see table 10). Design stage Trust and understanding should be developed among those who use different approaches to defining research agendas and collecting and analyzing data with the aim of influencing policy. Both survey and par­ ticipatory assessment practitioners need to understand the limitations of various data sets, appreciate the biases in their own research meth­ ods, and know when alternative methods can compensate for some of these limitations. In Zambia, in an attempt to better understand the various approaches to poverty analysis, the government has located EMERGING GOOD PRACTICE 77 Figure 7. Information Filters and Biases: Case Study of the PPA in Zambia REAUTY Community h ,----I ~ Selection of community members and methods Research team's analysis of site reports - Implementing agency's - cleanup of site reports Incorporation of site report analyses into PPA by World Bank staff in - Washington l Areas of information filtering and potential biases Incorporation of PPA information into the final ­ poverty assessment Poverty assessment used by policymakers I • POUCY the local NGO research team (Participatory Assessment Group, PAG) at the Central Statistics Office (CSO). PAG is currently undertaking par­ ticipatory poverty monitoring exercises and combining the results of these exercises with the household survey work of the CSO. 78 CAN THE POOR INFLUENCE POLICY? Table 10. of the Data Sets Can Be Combined When How Design stage • Build trust and understanding between those undertaking the PPA and the household surveys • Match sample design for PPA and household surveys • Use results of PPA to influence household survey design, and vice versa Implementation stage • Take policymakers and statisticians to the communities • Include statisticians from central statistics office in the PPA research field teams-this may be appropriate in some countries • Gather perception variables in household surveys Data analysis and • Triangulate for validation and analysis by synthesis comparing PPA and household survey results. To test the robustness of PPA, key results can be included in the more representative household surveys. PPAs can assess the validity and interpretation of household data at the local level • Combine results of the surveys for one set of key policy recommendations Dissemination stage • Feed back main results from both the PPA and household surveys to civil SOCiety and communities The selection of PPA sites can be informed by traditional surveys. For example, in Kenya, the Welfare Monitoring Survey (WMS), which was based on a nationally representative sample of some 12,000 house­ holds, was used to identify the poorest districts in each of the six provinces. These districts became the center of focus for the PPA. Within each of these districts, two WMS clusters (roughly eqUivalent to a vil­ lage) were randomly selected for the PPA, and the WMS survey enu­ merators most familiar with the selected clusters were then attached to the PPA teams to serve as guides. Thus, the PPA was conducted in a subsample of clusters used for the WMS. In Guatemala, detailed par­ ticipatory research was conducted in 10 villages that were later included in the LSMS. Chambers (forthcoming) states that there are important tradeoffs when designing participatory research. These include the following: scale and representativeness versus quality-the larger the scale the more representative, but the more difficult to assure quality; scale ver­ sus timeliness for training, fieldwork and analysis-the larger the EMERGING GOOD PRACTICE 79 scale, the more time and resources needed for training, fieldwork supervision, and analysis; scale versus resources for follow-up--for a given level of resources, larger scale diminishes scope for follow-up with communities, and for policy-related workshops; standardisation and analysability versus open-endedness and difficulty of analysis; care and comprehensiveness of analysis versus timeliness in influenc­ ing policy; the qualifications and nuances of academic standards ver­ sus simplified messages for policy influence. Participatory research and household surveys may be conducted interactively, so that they enhance each other. If a PPA is conducted after the household survey, the results will explain, challenge, reinforce, or shed new light on household survey data. The results of the household survey can also, of course, explain, challenge, or reinforce the PPA (see Carvalho and White 1997; Chung 2000). If the PPA is conducted before the household survey, the PPA results could assist in generating hypotheses, shaping the design of the household survey, and develop­ ing survey questions appropriate for the respondents. Ideally, this should be an ongoing process whereby both PPAs and household sur­ veys are conducted periodically and feed into each other (see figure 1). The results of past PPAs indicate that when they are used in conjunction with household surveys, the final assessment is a much fuller analysis of the varying dimensions of poverty, and the policy recommendations are more relevant and informed. The sequencing will be determined by the context in country. In Armenia, for example, the PPA was conducted after the survey work and was able to illuminate areas not covered in the survey, such as reciprocity and lGnship networks and the impacts of crime. In Mongolia, the results of the PPAwill be used to determine the research agenda of the next LSMS. Implementation stage Increase awareness of methods by going to the communities: A key recom­ mendation is for policymakers to go to the field and be involved in the research process, in order to understand the strengths and limitations of different approaches and to gain insight into the reality of poor com­ munities. For example, in Costa Rica, a senior official from the MiniStry of Economic Planning went with the research teams to the communities and consequently was better able to appreciate the value and limitations of the PPA. Composition of PPA teams: In some countries, it may be appropriate to include statisticians from the central statistics office in the PPA field teams. This was done, for example, in Pakistan and Mongolia. Gather perception variables in household surveys: Household surveys could be used to gather data on perceptions using different approaches, 80 CAN THE POOR INFLUENCE POLICY? such as using more open-ended and semistructured questions with a random group of people, or by including subjective questions on wel­ fare. In general, World Bank LSMSs have yet to incorporate such vari­ ables. However, the recent LSMS in Guatemala included questions on trust and social organizations. Analysis and synthesis stage Comparing survey results: As stated above, Carvalho and White (1997) argue that it is possible to examine, explain, confirm, and/or enrich information from household surveys to PPAs and vice versa. The results from household surveys and PPAs can be triangulated (validated through cross-checking). Apparent conflicts in data can be further researched. To test the robustness of PPAs, key results can be included in the more representative household surveys. PPAs can assess the valid­ ity and interpretation of household data at the local level. However, when one is synthesizing data, it is not always possible to directly compare different data sources. For example, it can be mislead­ ing to use aggregated wealth-ranking PPA data from different commu­ nities since communities determine the ranking criteria, which will most likely vary from community to community. As a result, comparisons of such PPA data with household survey data are not very meaningful. Some PPAs have attempted to undertake such comparisons. For exam­ ple, in the Kenya PPA (see Narayan and Nyamwaya 1996), the results of the Poverty Profiles from the Welfare Monitoring Survey (1992) were compared with the PPA. The report concluded that in three of the five districts, the results of the two approaches were almost identical, with a similar percentage of people falling below the conventional poverty line. And in Tanzania, the PPA report noted the similarity of results from two separate surveys: 50.3 percent were identified as poor and very poor by the PPA, while 49.7 percent fell below the poverty line in the Human Resources Development Survey (HRD) (Narayan 1997). It should be stressed that although such comparisons may have value as an indicator for further investigation, these data sets are not directly comparable. Combining results for policy recommendations: Some countries are begin­ ning to produce a clear set of policy recommendations based on the results of PPA and household survey data (for example, Armenia, Uganda, Zambia, Vietnam). Dissemination stage As stated above, one of the principles of participatory research is to feed back the findings to communities. This is rarely done in the case of household surveys. However, in some countries the PPA and household survey data have been integrated into one set of policy recom­ EMERGING GOOD PRACTICE 81 mendations, which have then been discussed with communities for fur­ ther policy feedback (for example, Uganda). Mongolia Case Example Mongolia is a good case example of how a PPAhas been combined with the household survey.7 The PPA, called the Participatory Living Stan­ dards Assessment (PlSA), was the first exercise of its kind in Mongolia to use participatory learning and action methods to broaden and deepen understanding of poverty at the national level. It was conducted by the National Statistical Office (NSO) in 2000 with assistance from the World Bank and other international agencies. It was intended to inform national policy, in part as an essential building block for Mongolia's Poverty Reduction Strategy Paper. The LSMSs were conducted in 1995 and 1998 and remain the most reliable sources of quantitative data on poverty in Mongolia. The PlSA is linked to the lSMS in three main ways: (a) research sites for the PlSA were selected to correspond to the 1998lSMS sites; (b) the results of the PlSA will be used to determine the research agenda for the next LSMS; and (c) capacity was built at the NSO to conduct similar par­ ticipatory assessments in the future and to promote better integration of data derived from both household surveys and PPAs. The PLSA aimed to complement and, to the extent possible, update and expand earlier poverty analyses carried out on the basis of the 1995 and 1998lSMSs, as well as to broaden public discourse on poverty in Mongolia, which has turned largely on distinctions between deserving and undeserving poor. In the past, antipoverty strategies such as the National Poverty Alleviation Program (NPAP) have been conceived as social assistance and formal public safety nets, rather than as public action to enhance the capabilities of poor and vulnerable groups to sustain their own livelihoods. In addition, there has been little under­ standing of the multiple dimensions, causes, and consequences of impoverishment and vulnerability; of differentiation among the poor and the places they live (implying that very different forms of public action may be required to reach different groups of poor people); of poverty dynamics and distinctions between chronic and transitory poverty; and of how the poor themselves define ill-being and well­ being. Although there was some participatory action-research in partic­ ular localities throughout Mongolia during the 1990s, and some strengthening of local capacity to carry out such analysis, the PLSA rep­ resents the first exercise of its kind to bring these skills to bear on national-level understanding of poverty and the formulation of future antipoverty strategies. It was also the first experience on the part of NSO in applying participatory methodologies in poverty analysis. 82 CAN THE POOR INFLUENCE POLICY? Using participatory research methodologies, the PLSA permitted a deeper analysis of certain issues that LSMS and other household survey methodologies are often not well equipped to address, such as poverty dynamics over time, spatial dynamics in livelihood strategies, and processes that affect individuals and communities as well as household units. Headcount data mask the fact that the location of poverty may shift over time through migration, for example; and they disguise com­ plex rural-urban linkages which are themselves dynamic. In the future, a time series survey could also yield data on these issues. Such data could then be integrated with results of the PPA. The PLSA was designed to ensure a high level of complementarity between existing quantitative data from the LSMS and other surveys, and the new qualitative (and, to a lesser extent, quantitative) data aris­ ing from the PLSA. This was achieved in the following ways: • First, the field research was guided by hypotheses that emerged from an initial desk study of the 1995 and 1998 LSMSs and other surveys. • Second, the sampling approach (see below) entailed revisiting many of the same clusters that were sampled under the 1998 LSMS. • Third, an attempt was made to include in the analysis, where possi­ ble and relevant, newly analyzed and previously unavailable quan­ titative data from the 1998 LSMS. • Fourth, an action plan was prepared to guide further analysis of the 1998 LSMS data by NSO staff, which would assist in deepening the poverty profile when used in conjunction with the PLSA findings. 8 This action plan dealt with, among other things, the construction of simple household-level asset indexes to complement the analysis of vulnerability. The selection of provinces (aimags), districts (sums), and communities that participated in the PLSA was guided by three principles: (a) the need to ensure complementarity and comparability with existing quan­ titative data; (b) the need to capture as much as possible the diversity in living conditions among rural and urban communities; and (c) the need to balance sample size (number of participating communities) with depth of analysis. In accordance with these principles, the PLSA followed the broad­ level sampling frame used for the 1998 LSMS. At each site, the research teams held focus group discussions with three men's groups, three women's groups, and one youth group, with 7 to 15 people in each group. A total of 220 focus group discussions and 269 individual house­ hold interviews were conducted, involving more than 2,000 partici­ pants. This sample is of the same order of magnitude as the 1998 LSMS. EMERGING GOOD PRACTICE 83 Certain logistical factors impeded this ideal sample frame from being followed in all cases, however. In the rural field sites, the considerable distances that research teams had to travel, owing to extremely low pop­ ulation density, presented a significant challenge to gathering together sufficient people for focus group discussions. In Ulaanbaatar, some com­ munity members were reluctant to participate when they realized they would receive no payment or other material incentive for doing so. These problems probably led to some degree of sampling error or self­ selection bias in some groups. Within these practical constraints, the sampling of households and individual participants in communities was guided by participatory wealth ranking. Using this technique, focus groups stratified their com­ munities according to locally relevant parameters of different levels of household well-being. The parameters were themselves elicited through the use of the wealth-ranking method. Using the resulting stratification as a sampling frame, individual households (and individuals within them) were then randomly selected within each stratum, to generate a purposive-random sample. This method combined the advantages of purposive sampling, to ensure that the full range of diversity in living standards was represented, with some measure of random sampling. The PLSA did try to disseminate the results through the media. How­ ever, this proved to be difficult, since the media were at that time more occupied with the national elections. The government intends to dis­ seminate the results of the PLSA by publishing a shortened version with the key policy messages. Box 15 provides a summary of this section. 84 CAN THE POOR INFLUENCE POLICY? Box 15. Summary of Emerging Good Practice for Integrating Data Sets Develop trust and understanding The starting point is developing an understanding of the different approaches, and trust among those who control research agendas and those who select, collect, and analyze data used to influence policy. Confront limitations of own data sets Practitioners need to confront the limitations of various data sets and to appreciate the hidden biases, lack of objectivity, and the like, in their own research methods. It is important to see where alternative methods may address some of these limitations. Ongoing process of household surveys and PPAs If the PPA is conducted after the household survey, the results may explain, challenge, or reinforce household survey data. If the PPA is conducted before the household survey, the results of the PPA may assist in generat­ ing hypotheses, shape the household survey questionnaire, and design and develop appropriate survey questions that will be understood by the respondent. Household surveys can help define a research agenda for the PPAs. Ideally, this should be an ongoing process whereby both the PPA and household surveys are done intermittently and feed into each other. Use survey data to select sites for the PPA Traditional surveys can identify the poorer areas for PPA research. Increase awareness ofmethods by going to the communities A key recommendation is that policymakers go to the field and be involved in the research process, in order to understand the strengths and limita­ tions of different approaches and gain insight into the reality of poor com­ munities. Institutional context The existing institutional frameworks, both in country (central statistical offices) and within the World Bank, currently provide an entry point for the quantitative data sets and the link with policy analysis, but this is less so for participatory data. The challenge is how to move from research results to policy analysis by finding an appropriate institutional entry point for various data sets and for longer-term analysis. EMERGING GOOD PRACTICE 85 Notes 1. Some of the issues highlighted here may be appropriate only for the World Bank. However, the author hopes that other institutions will find the Bank's experience useful. 2. Gomart, E. Personal communication. July 1997. Washington, n.c. 3. See Mukherjee (1995) for other participatory methods being used to generate com­ mensurate data. 4. For the CWIQ website, see http://www4.worldbank.org/afr/stats / cwiq.cmf. 5. Chambers (1993) defines" optimal ignorance" as the need not to know everything -the key is to find out as much as you need to know. He states (p. 19) that "it requires experience and imagination to know what is not worth knowing, and self-discipline and courage to abstain from trying to find it out." Cornwall (2000) contributes the concept of "appropriate imprecision/' where "there is no need to know everything exactly" (p. 43). 6. See Mukherjee (1995) for other examples of the generation of quantitative data through participatory methods. 7. Details for this case example are adapted from Dulamdary, Shah, and Mearns (2001). 8. This work is being used as an input to continuing World Bank and UNDP assis­ tance to enable NSO to strengthen its regular Household Income and Expenditure Survey (HIES), which will include additional LSMS-type modules in order to rationalize future survey instruments for measuring living standards in Mongolia. 4 Linking PPAs to Poverty Reduction Strategies introduction of the poverty The recentbackground to shiftdevelopment reduction strategychapter represents a significant explains the the in development thinking. This It (PRS) of the PRS.l then shows how the PPA is relevant to the development of the poverty reduction strategy by focusing on four key features of the PRS that benefit from direct consultations with the poor: poverty analysis, consultation during formulation of the strategy, monitoring of implementation, and eval­ uation of outcomes. Background to the Poverty Reduction Strategy Paper During the 1990s, governments and civil society saw an increasing need to change the way that countries develop and implement national poverty reduction strategies. This recognition was based on the fundamental idea that to substantially reduce poverty, it is essential to implement both policies that promote growth, and social policies and sectoral programs that directly improve the living conditions of the poor. This approach and emphasis on policies to reduce poverty were also behind the launch of the enhanced HIPC Initiative at the G7 Summit in Cologne in mid-1999, which made debt relief conditional on the formulation of a poverty reduction framework. The approach respond­ ed to the concerns of many civil society organizations, including the Jubilee 2000 international debt campaign. After the East Asian crisis, the World Bank introduced the compre­ hensive development framework (CDF) 1999, which focused on a more holistic approach to development. The CDF seeks a better balance in policymaking by highlighting the interdependence of all elements of development-social, structural, human, governance, environmental, 87 88 CAN THE POOR INFLUENCE POLlCY? economic, and financial. It emphasizes partnerships between govern­ ments, donors, civil society, the private sector, and other development actors. Perhaps most important, the country leads the process, both owning and directing the development agenda, with the Bank and other partners each defining their support in their respective country plans. The eDP and other donor frameworks provided the basis for introducing the Poverty Reduction Strategy Paper (PRSP). In September 1999, the World Bank and the IMP agreed to major changes in their operations to help low-income countries achieve sustainable poverty reduction (see box 16). Henceforth, programs supported by the two institutions will be based on country-driven poverty reduction strategies (PRSs), developed in consultation with civil society and summarized in PRSPs. The PRSPs also provide the basis for debt relief under the enhanced HIPe Initiative as well as for all World Bank and IMP concessionallending (see figure 8). 2 Box 16. Why PRSPs Are Different • PRSs are locally generated and owned national strategies formulated through a wide participatory dialogue within government and throughout society. Although participation is now widely accepted at the project level, PRSPs are different because participation is focused at the policymaking level. There is no blueprint for participation-an understanding of the political economy of policy choice and policy change will result in different participation strategies. • Poverty analysis includes direct consultation with the poor through, for example, a PPA. Including the poor increases the understanding that poverty reduction requires a long-term and multidimensional approach, in which growth is a necessary but insufficient condition for sustained poverty reduction. The PRS focuses on how to target institutional and policy change that will enable poor people to participate in achieving and benefiting from growth. • Public spending and choices of costed alternative public actions are more closely linked to poverty analysis within a stable macroeconomic environment over a time frame of at least three years. • The effectiveness of public actions and expenditure plans is monitored through country-determined poverty outcome indicators, which depend on participation to improve accountability in implementation. • PRSs encourage accountability of governments to their own people and domestic constituencies rather than to external fundersi the poor to become active participants, not just passive recipients; and donors to provide more predictable medium-term financial support for domestic budgets. LINKlNG PPAs TO POVERTY REDUCTION STRATEGIES 89 Figure 8. PRSP Operational Linkages Overarching country poverty strategy St le.g.,The Gambia's Strategy for groakeholder inPUt Poverty Alleviation,Uganda's Poverty ~ UPS' Civil SOCle;'--COtnll/(./f)lty Eradication Action Planl , dOllors, etc 0";0'"<-· ,\\"t\(':; \)\~\) C\)'<\ fJ"(':;v I'-e\\ '0'1 \\"Ie \¢<;f!' W => C) o ~V) "OW 2'":~ §.g 00. t.> -0 '" c: t'" '" 0::: '" a: YEAR 1: PRSP Govt. drafted. Unked to YEAA2: PASP YEAA3: PASP annual budget cycle and Progress report. Progress report. MTEF. Joint assessment Updated as Updated as presented to boards of necessary necessary IMFandWB IMF: Poverty Aeduction World Bank: Country and Growth Assistance Strategy (CAS) Facility (PAGF) (synthesized to a business planl ~ Policy lending, including Project lending Program lending Poverty Aeduction Strategy Credits {PASCI Impacts measured by public actions and poverty outcome indicators and fed into ongoing dialogue. Intermediate targets linked to budget and outcome indicators CDF-Comprehensive development framework MTEF-Medium-Term Expenditure Framework PASP-Poverty Aeduction Strategy Paper 90 CAN THE POOR INFLUENCE POLICY? Civic engagement in the PRS process is important for the following reasons: a. Experience has shown that widening consultation in national policymaking can build ownership of policies and actions (including both political and administrative commitment). b. Participation can also contribute to more accountable government. Transparency is increased when the public have a better under­ standing of government processes; institutions are strengthened and accountable; the poor are more informed about government's commit­ ment to tackling key poverty issues; and governments are held accountable to their domestic constituencies for actual performance. c. Building the role and capacity of nonstate institutions through participation can balance the power of the state. d. In the process of consultation, civil society organizations can provide specialist and local knowledge to improve the quality of policy­ making. Although not all civil society organizations are repre­ sentative and some are politically aligned, some genuinely represent the views of poorer citizens and interest groups. e. The poor are empowered through bringing their analysis, priorities, and voice into the decisionmaking process, thereby making the policy framework more relevant and responsive to their needs. f. Equity and social integration are promoted through appreciation of varied needs within society (by geographic region, gender, ethnic and age group, and so on). Participation can lead to creating durable, inclusive political systems (which are particularly important in ethnically diverse societies). g. Partnerships can be built between governments, business, and civil society groups, leading to joint actions to achieve poverty reduction goals. How to Include the Poor in the PRSP Process: Operational Implications Preliminary Steps for Consultation in the PRS Process Participation is a complex political process; thus, several important preliminary steps should be taken in planning a nationwide partici­ patory process. First, understanding the policy environment, the government's degree of openness and its commitment to poverty reduction, is a key starting point. Since political structures can determine LINKING PPAs TO POVERTY REDUCTION STRATEGIES 91 the extent of participation, political obstacles to implementing pro-poor policies should be understood. Second, conduct a stakeholder analysis to identify stakeholders, evaluate their interests and capacities, and determine what type of participatory process will best incorporate their views. Third, drafting participation action plans can be a useful tool to detail the path for participation, promote discussion and consensus about who should be involved, and provide a basis for monitoring progress. These plans vary from country to country, depending on the political context and the extent of participation the government feels is appropriate. An action plan can define the boundaries of participation and therefore enable the public to have more realistic expectations. In some countries, narrow participation (even only within government) may be more appropriate at the beginning of the process. Initially, all views may not be accepted by government, but even a limited debate can present new knowledge, improve the quality of policymaking, and ultimately broaden the support for policy implementation. Different groups, such as parliament, local government, local representative bodies, civil society organizations, private sector groups, and the poor, can be gradually included in the process at a later stage. The parti­ cipation action plan should build on existing elected and democratic bodies and processes (such as the budget cycle) to strengthen-not undermine­ the local electoral process. The ideal process for selecting groups to include in the consultation involves joint decisionmaking by the government and civil society organizations. Transparent decisions about who participates, and when and how, will add legitimacy to the participatory process. Fourth, key areas for building capacity also need to be identified at the beginning of the process. These include the government's capacity to carry forward a reform process; the capacity of civil society organi­ zations to be increasingly involved in the macroeconomic debate; and the capacity of the judiciary, the legislature, and the media to be more effective. Finally, information about the planned participation process needs to be disseminated at the beginning, within government and to the public, in order to inform civil society of their expected involvement. Such dissemination can be promoted through media involvement, where politically feasible. Entry Points for Including the Poor in PRSs There are four key stages in the PRS cycle where PPAs can be a useful tool for reaching the poor and eliciting their views, which can then be incorporated into the PRS. 92 CAN THE POOR INFLUENCE POLICY? a. Poverty analysis. The PRS can incorporate information from the PPA on the multidimensional aspects and causes of poverty. b. Formulation and dissemination of the PRSP. The priorities of the poor should be reflected in the goals set forth in the PRSP. This can include the sequencing of public actions, including macroeconomic and structural reforms, the choice of indicators for monitoring implement­ ation of poverty reduction strategies, and budget allocations. c. Monitoring the implementation of the PRS. The PPA can provide policymakers with information on the effectiveness and relevance of both poverty reduction strategies and the institutions that implement them, as well as delivery of the budget and quality of services. d. Evaluating outcomes of the PRS. Outcomes reported during the PPA should be integrated with other data on outcomes gathered from other sources, and used to inform decisions about whether to change policies and budget allocation. Below are examples of various country processes that may be strength­ ened by widening government and civic participation. Participation in poverty analysis As described in chapter 2, including the poor in the diagnosis of poverty can deepen our understanding of the many dimensions of poverty. One of the key questions in the Joint Staff Assessment Guidelines3 is "whether the poor have been consulted (for example, by conducting a partici­ patory poverty assessment), and how these results have been utilized and combined with household survey data." This highlights the increased importance placed on including PPAs in poverty analysis by the Bank and the Fund. Participation in macroeconomic policy formulation National level dialogue can promote a public debate around national policies, strengthen political participation, and support good govern­ ance. In many countries formulating PRSs, participation has been organized through convening national and regional workshops (which include locally elected officials, the private sector, unions, and the like), as well as through dialogue with community groups, specialized focus group meetings, media discussions (radio, newspapers), traditional forums (village heads, district chiefs meetings), and direct consultations with the poor through a PPA Many countries have used existing forums for consultation. For example, in Uganda, the PRSP was discussed at national and regional meetings originally convened to promote LINKING PPAs TO POVERTY REDUCTION STRATEGIES 93 members of parliament's involvement in the budgeting process. In Tanzania, PRSP discussions are linked to the participatory public expenditure review process. Consultation in formulating the PRS presents an opportunity for the public to engage in new areas that previously were not always in the public domain, such as the poverty and distributional impacts of reforms; environmental impacts of reforms; and links between growth and poverty, including issues of equity. Where possible, such assessments can use multiple data sources, including PPAs. The information could help inform an assessment of alternative policy options and appropriate sequencing. Both before and after assessments are useful for policy­ makers and civil society when they discuss alternative reforms and sequencing in light of the potential impacts on various vulnerable groups. In many countries, the capacity to have a dialogue on such issues remains limited. Uganda is the exception. The Ugandan Debt Network, one of the groups representing civil society on the Drafting Committee of Uganda'S PRSp, debates these issues. Further, the information in Uganda'S PRSP stimulated some debate around difficult policy tradeoffs, although still more work is required. Participation in the budgeting process PPAs can help proVide policymakers with a better understanding of the priorities of the poor. Further, negotiation among different interest groups on various public action choices can lead to broader ownership and wider consensus (see box 7 for ways the poor can influence the budget). Certain steps can be taken to increase participation in the budget process: a. The PRSP should present various aggregate spending scenarios to reveal tradeoffs among different macroeconomic and fiscal policy options. With this information, groups can weigh the benefits of various options for the allocation of resources. b. Elected assemblies (national and local) and domestic interest groups should be included in the process of scrutinizing plans and budgets. Medium-term public spending plans, which influence annual budgets, can incorporate poverty reduction priorities, especially if processes are transparent and accountable. The expertise of parliamentary committees should be strengthened, so they can examine budgets with an understanding of tradeoffs. c. Where possible, budgets may be published-even at the local level. This can give people an understanding of what they should expect and could demand. 94 CAN THE POOR INFLUENCE POLICY? Participation in monitoring and evaluation Participation in monitoring and evaluation can promote transparency and accountability and increase the ownership and acceptance of findings. Participatory research can enhance people's awareness of their rights and strengthen the claims of the poor. For monitoring and evaluating the PRSs, data can be used from multiple sources beyond those usually controlled by government, such as specialized academic and NGO studies and PPAs. There are several points of entry for participation in monitoring and evaluating the PRSP: a. Goal setting. Setting clear goals can promote a shared understanding of priorities, add transparency to the process of allocating resources, and provide a benchmark against which to monitor the success of policies. b. Selection of outcome and impact indicators. The PRSP should move from tracking disbursement to monitoring delivery of goods and services (number of school books received at the school, schools built), and then outcomes (literacy rates). c. Impact on beneficiaries. Participatory monitoring can be used to check that public services actually benefit intended beneficiaries. Poverty Impact Assessments of Macroeconomic and Structural Reforms Linking PPAs to the Macroeconomic Policy Dialogue The PRSPs developed so far suggest that more needs to be done to develop an open and informed debate in PRSP countries around economic policies and structural reforms. This can be done in three ways: first, improve access to information; second, strengthen analysis of the poverty impacts of macroeconomic and structural reforms; and third, draw civil society groups into discussing these issues and build their capacity in this area. The analysis of the poverty impacts of reforms should be an integral part of the development of PRSPs and of Bank and Fund-supported reforms, as it allows countries to evaluate different policy options before they are implemented, compensate groups that are adversely affected by policy changes, and reformulate policies that do not reduce poverty and increase growth. Analysis should be undertaken early in countries' preparation of their PRSPs to contribute to the national debate on policy choice, monitoring, and evaluation. LINKING PPAs TO POVERTY REDUCTION STRATEGIES 95 Analysis of the poverty impacts of macroeconomic and structural policies is often limited because of a lack of data or, more commonly, data exist but are fragmented and underutilized. Further, there are often weak links between the poverty analysis and policy choices, so the Bank and the Fund, as well as governments and other donors, are giving this type of analysis high priority. In the future, the challenge will be to integrate data from various methods (for example, household surveys, PPAs, NGO surveys, and in­ country studies) to better understand the past impacts and potential impacts. In addition, donors could build the capacity of national institutions to provide training for civil society organizations in financial programming, the poverty impacts of macro reforms, and the analysis of policy tradeoffs. This would contribute toward a more informed public discussion, and respond to the request of some civil society groups for assistance in better understanding the economic debates. Linking PPAs to the IMF's Poverty Reduction and Growth Facility Programs supported by the IMF's Poverty Reduction and Growth Facility will be modified to reflect the countries' PRSs. Policies to be implemented under these programs will have a greater focus on growth and poverty reduction.4 However, research is needed into how programs and policy reforms affect the poor, particularly (a) macroeconomic adjustments, such as tax increases, reduction or elimination of subsidies, and exchange rate alignment; (b) structural reforms, such as lib­ eralization and civil service reform; and (c) public expenditures. Traditional household surveys and PPAs, as well as data gathered through other research methods by various organizations, will be crucial to understanding the poverty and distributional impacts of reforms. Such analysis can lead to better and more pro-poor program design. Country Examples of the Links between the PPAs and PRSPs Summary of Participation in PRSPs A major achievement of the PRSP initiative has been the recognition of the importance of government ownership. As a result, there is emerging, in most countries, a greater commitment to broader participation in policymaking and a more diverse dialogue on poverty issues through direct consultations with stakeholders, including poor communities. However, at this early stage, the process of participation in the PRSPs is 96 CAN THE POOR INFLUENCE POLlCY? in a developmental phase. For example, some full PRSPs were completed with limited time to develop full participation beyond consultation. Full participation would have helped to ensure that the PRSPs benefited fully from the participatory process. The guidelines for the full PRSP state that there is no time limit for the completion of a full PRSP and the timing should be determined by the government. The World Bank and IMF Boards have also stressed that the quality of PRSPs should not be sacrificed to speed of preparation and countries have been encouraged to take the necessary time required. Some esos have argued that the link between the PRSP process and the HIPe Initiative has affected the quality of participatory processes. For full PRSPs, it would be useful to develop milestones that indicate progress in the participatory process. The interim PRSPs (I-PRSPs) do not require full participation as the main objective of the interim strategy is to detail a plan to develop the full PRSP. However, in the interim PRSP, there should be some consultation on developing a participation plan for the fullPRSPs. Some esos have questioned the concept of ownership in some countries where the Fund and the Bank retain a strong influence over the final document. esos have also stressed the importance of greater public discussion in the choice of macroeconomic and structural reforms. As stated above, this will require more detailed poverty impact analysis of past and future reforms. It would also be useful if the rationale for policy choices and tradeoffs was made more explicit in PRSPs as well as in IMF and World Bank documents. Finally, it would be important to continue the ongoing efforts to adapt macroeconomic frameworks in a flexible manner to integrate the main poverty reduction objectives arising from the consultation process. Current Status of the Links between the PPAs and PRSPs Table 11 provides a summary of the impact of PPAs on recent PRSPs. To date, 38 PRSPs have been completed, of which 4 are full and 34 are interim PRSPs. The impact of the PPAs on PRSPs is varied and has been mainly dependent on (a) how recently the PPA was undertaken, (b) the level of involvement of key policymakers in the PPA, and (c) technical advice given to the government from donors in formulating the PRS. At this early stage, it is not expected that PPAs will have a significant impact on I-PRSPs, since the interim guidelines do not specify the direct participation of the poor, the identification of a full set of priority public actions, or the selection of indicators.s Such inputs are only expected as part of the full PRSP. However, many PPAs are already having an impact on both the full and interim PRSPs. The impacts fall into four main UNKING PPAs TO POVERTY REDUCTION STRATEGIES 97 areas: (a) formulation of the PRS~ (b) poverty analysis in the PRSP, (c) budget priorities and public actions set out in the PRS~ and (d) PRSP indicators. The impact of the PPA in each of these areas has varied greatly, but table 11 is useful for a first glance. For example, out of the 38 countries that have completed interim or full PRSPs, 28 (73 percent) have in the past conducted a participatory analysis of poverty that included direct consultations with poor communities. Of these 28 countries, 10 (42 percent) used the PPA as part of the consultation process to include the poor in formulation of the PRSP (see column 1). Fourteen of the 28 countries (50 percent) referred to the results of the participatory poverty analysis in their analysis of poverty (see column 2). In Uganda, Vietnam, Lao, and Niger, the data from the PPA were used to a greater degree: the priorities of the poor identified in the PPA were also reflected in the budget and/or public actions (see column 3). Finally, in Uganda and Guinea, the selection of indicators for the PRSP was influenced by PPA data (see column 4). Out of the 38 full and interim PRSPs, 17 countries (45 percent) stated in their PRSPs that they intend to undertake a PPA in the future. Case Examples Uganda and Vietnam are cases where the PPA process is effectively linked to the PRSP (see appendix E and Norton 2001 for more details on the Uganda example, and Turk 2001 for more details on the Vietnam example). Both PPAs were designed to have a greater impact than simply providing information and, as a result, were linked to other established processes, such as budgeting, decentralization and planning at the local level, and household surveys. In Vietnam, the PPA finding that poor people had a lack of information about their legal rights was included in the I-PRSP as an issue that needed to be addressed. In Uganda, the government implemented the Uganda Participatory Poverty Assessment Project (the UPPAP) in 1998 and 1999, in which the poor in rural and urban areas were directly consulted. The results of the UPPAP have been used by policy makers in Uganda'S Poverty Eradication Action Plan (PEAP) /PRSP, as detailed in table 12. A two-way information flow can strengthen policymaking, with upward flows (data generated from PPAs) presented to policymakers, and downward flows (information about government policy and budget choice) put into the public arena to better inform communities (McGee and Norton 2000). For example, in Uganda, the UPPAP present­ ed information to policymakers, who fed it into the budgeting process. Table 11. Impact of PPAs on Poverty Reduction Strategy Papers PPA status PPA impact on [-PRSPs and PRSPs Country and PPA PPA Poverty Budget priorities dateofPRSP conducted planned Formulation' analysis!' and public actions' Indicatorsd FullPRSPs Uganda Three-year OngoingPPA March 2000 project com­ "" "" "" "" menced 1999 Burkina Faso May 2000 1998 2001 • "" • • Tanzania October 2000 1995 and 1997 No • "" • • ~ Mauritania December 2000 No No • • • • Interim PRSPs Albania May 2000 No Planned but no date specified • • • • Benin June 2000 1993 No • • • • Bolivia January 2000 1999 No "" "" • • Cambodia October 2000 1998 October 2000­ January 2001 "" "" • "" Cameroon August 2000 1994 No • • • • Central African Republic No No • • • • December 2000 Chad July 2000 NoPPA Perceptions of Poverty Study • • • • for mid-2000 Ethiopia November 2000 1997 and 1999 PPAof1997 may be updated • • • • if required for the full PRSP «:l «:l The Gambia October 2000 Three-year project com­ OngoingPPA '" '" • • menced 1999 Georgia November 2000 1997 No • • • • Ghana June 2000 1993-98 Planned but no date specified • • • • Guinea October 2000 1993-98 Planned but no date specified '" '" • '" Guinea Bissau September 2000 Rapid PPA 1998 April- July 2001 • • • • Guyana October 2000 No No • • • • Table 11. (continued) PPAstatus PPA impact on ]-PRSPs and PRSPs Country and PPA PPA Poverty Budget priorities dateojPRSP conducted planned Formulation" analysis" and public actions" IndicatorsO Interim PRSPs (continued) Honduras No No March 2000 " " " " Kenya 1994 and 1996 Planned but no ~ July 2000 date specified " " " Lao 1998 October 2000­ ~ ~ ~ March 2001 May 2001 " .... Lesotho 1994 No 8 December 2000 " " " " Macedonia 1998 No November 2000 " " " " Madagascar 1993-94 No November 2000 " " " " Malawi 1999 2001 ~ August 2000 " " " Mali 1993 No July 2000 " " " " Moldova 1997 September 2001 November 2000 " " " " Mozambique 1995 No February 2000 " " " " Nicaragua August 2000 1999-2000 No ttl ttl • • Niger October 2000 1996 November 2000­ March 2001 • ttl ttl • Rwanda November 2000 1998 No ttl ttl • • Sao Tome and Principe No No • • • • April 2000 Senegal May 2000 No No • • • • Tajikistan March 2000 No No • • • • ..... <:> Tanzania MarchZOOO 1995 and 1997 No • • • • ..... Vietnam March 2001 1999-2000 Planned ttl ttl ttl • Yemen December 2000 No No • • • • Zambia July 2000 1994--2000 Ongoing ttl • • • Note: The data for this table were drawn from the interim and full PRS papers. In some countries (such as Cameroon), the PPA had a more exten­ sive impact than was documented in the strategy papers. • PPA used as a method to include the poor as part of the participation plan for the formulation of the interim or full PRSP. b PPA results used in the PRSP's poverty diagnosis. C Priorities of the poor identified in PPA influenced budget and/or public actions identified in the PRSP. d Choice of goals and monitoring indicators influenced by PPA data. 102 CAN THE POOR INFLUENCE POLICY? 1. Poverty analysis • The Poverty Monitoring Unit in the Ministry of Finance integrates annual household surveys, conducted by the Uganda Bureau of Statistics, with other data sources (participatory analysis, sector surveys, line ministry data sources) to ensure that policy impacts are understood and policy development is informed by poverty data and perceptions of the poor. • The outcome of the Uganda PPAP was that in addition to income and access to health care and education, poor people emphasized security problems (due to war, insurgency, cattle rustling, and domestic violence), corruption, isolation, lack of access to clean water, and lack of access to information on government policies as priority concerns. The PPA also highlighted the location­ specific nature of poverty and the most vulnerable groups. These key poverty issues are now incorporated into the household survey questionnaires for further analysis. 2. Formulation of the PRSP • Goals: One of the four goals of the PRSP in Uganda is to ensure good governance and security. • Public actions: Recent UPPAP findings demonstrate major differences in the poverty profile of different districts. This resulted in policymakers' recognizing the need for more fleXibility in the use of central government conditional grants to districts. • Indicators: Indicators are linked to PRSP goals and cover economic opportunities, human development, security, and empowerment (democratization and decentralization, human rights, law and order). • Budget allocations: Significantly more resources, including HIPC resources, have been directed to improving water supply. The findings from the UPPAP were included in the Background to the Budget 1999-2000. Measures to increase political accountability are being considered for funding with HIPC savings. With the Ministry of Local Government, the UPPAP will work directly with local governments to strengthen their capacity to consult poor communities for the purposes of district planning and budgeting. 3. Monitoring implementa­ • Monitoring the change in poverty analysis: tion of the PRSP Yearly the UPPAPs will be undertaken to build up trend data on changes in poverty and well-being. • Budget delivery: The budget process is being developed to open up multiple channels of accountability. For example, to increase transparency LINKING PPAs TO POVERTY REDUCTION STRATEGIES 103 PPA on the PRSP in decentralized management of resources, advertisements are placed in the press indicating amounts disbursed to each district by sector. In the education sector, budget allocations for schools are posted on school notice boards. • Policy effectiveness and relevance: The government established a Poverty Action Fund (PAF) to enhance transparency and monitoring of HIPC and other donor resources allocated to expenditure programs focused on poverty. The PAF involves both civil society and government in monitoring the impact of PAF outlays, and quarterly meetings are held to discuss delivery against budget allocations. Sectors are requested to consider strengthening the links between service delivery and performance monitoring by local political leaders. 4. Evaluating outcomes • The government intends to strengthen the role of elected village councils in monitoring the performance of public service delivery in the new PEAP. • Participatory monitoring of the implementation of the PEAP will be integrated into the government's poverty monitoring framework. • Mechanisms for local-level accountability and mOnitoring of service delivery to the poor are being considered. Note: This table is based on Bird and Kakande (2001). In turn, the government increased communities' access to budget data by publishing allocations at the local level, thereby increasing transparency. This gave people a better understanding of what they should expect and what they could demand. Next Steps for PPAs From the analysis of the links between the PPAs and the PRSPs, four areas are emerging as important for the next round of PPAs: a. In the past, PPAs have presented clear data on sectors that poor people consider to be a priority (such as access to health care, education, and potable water). The next step for new PPAs is to detail priorities within these identified sectors to help policymakers make more informed public action choices. In addition, new PPAs should identify within the sectors the critical mechanisms, including 104 CAN THE POOR INFLUENCE POLICY? appropriate institutions, that are likely to be the most effective and efficient for implementation and service delivery to the poor. b. In many countries, PPA findings have raised civic engagement in the policy dialogue. But many PPAs have been narrow bureaucratic requirements to develop policy options, rather than part of ongoing processes to influence policy. The next step is for PPAs to assist in developing the capacity of civil society to better negotiate policy options with the government. To support this and to develop an independent civic engagement process around poverty issues (that would include mass communications and other information­ based media), PPAs could provide information to civil society. Such findings from PPAs could catalyze the debate and dialogue on poverty issues and, in so doing, could move PPAs beyond one-time, restricted surveys. PPAs could also be used to sensitize parlia­ mentarians and other political leadership to poverty dimensions and outcomes. c. Most PPA findings are not prioritized in the light of resource constraints and are not used for decisionmaking about resource allocation, spending, and performance across sectors. The next step is to link the findings of PPAs to public action choices with the objective of influencing national budgets. d. Many PPAs have produced valuable new data on poverty. The next step is to institutionalize the approach to ensure that PPAs become part of a participatory monitoring system that influences public action choices over time. The challenge now is to move from isolated PPA research studies to ensuring that PPA consultations become part of the broader national policy dialogue and political decisionmaking, as well as part of a system to monitor the implementation of the commitments made by governments and donors. The Challenge for PPAs The moral imperative for giving the poor a voice in the poverty debate is self-evident. The bonus is that engaging with the poor also leads to better technical diagnosis of problems and better design and imple­ mentation of solutions. Through PPAs, the poor deepen our under­ standing of poverty and can influence policymaking. This new approach challenges traditional power relations and calls for a variety of partner­ ships that require trust, openness, and integrity. LINKING PPAs TO POVERTY REDUCTION STRATEGIES 105 Both poverty and policy change are inherently linked to the political process in any country. But when undertaken in an environment of increased trust, PPAs can present opportunities for a more open dialogue and greater understanding between the powerless and those in power. Notes 1. This chapter is based on "How the Poor Can Have a Voice in Government Policy" (Robb 2000). 2. The PRS is presented to both the IMF and World Bank Executive Boards, which make a judgment as to whether the PRS provides the basis for the institutions' assistance. The staff of the Fund and the Bank provide the Boards with a joint staff assessment of the PRS. 3. See http://www.worldbank.org/poverty/strategies/index.htm. 4. For more details, see http://www.imf.org/external!np/prgf/2000/eng/key.htm. 5. The differences between a full and an interim PRSP are defined in World Bank and IMF(l999). Appendixes Appendix A. Methodology Appendix B. Impact Appendix C. Poverty Assessments, Completed and Scheduled (by Country), Fiscal Year 1989-2000 Afpendix D. Examrles of PRA Exercises In Thailand (1998 and Zambia (1996) Appendix E. Country Case Examples Appendix F. Social Aspects of the East Asian Crisis: Perceptions of Poor Communities Appendix G. Methodology of This Review Appendix A. Methodology Country, timing, and cost Context Bank Context in country Institutions involved Methodology Level ofparticipation AFRICA Benin Manager of the PPA also Limited permission sought A unit in the Ministry of Plan­ RRA: Twenty-three villages and some Communities: Information sharing. Partial PPA completed; respansible for overall from central government, ning assisted with coordina­ urban communities were covered in five three weeks fieldwork PA. Outside consultant which was supportive of tion. Sevetal NGOs were of the regions (the sixth had already been Others: The government was coop­ in 1993. assisted in the PPA. Vari­ the approach. Local gov- consulted. extensively covered); RRAs involved erative and receptive. Discussions ous divisions in the emment extensively semistructured interviews, children's with NGOs and government dur­ Cost. $4O,(KX) Bank consulted at all involved. Stable political drawings. ing management workshop. stages. environment. Burundi Manager of the PPA also Government strongly sup- The study was coordinated PRA: AJist of criteria was agreed upon Some participation within the Bank, Oct-Dec 1997 respansible for overall ported the PPA as part of by a Pover1y Committee con- with government for selecting the com­ with country economist reviewing PA. The PA and PPA the wider PA. although vened by the Ministry of PJan­ munities, including degree of impact of topic lists and preliminary results. ,.... Cost $130,(KX) were requested and some were skeptical about ning, and the study brought the conflict, proportion of the community ~ strongly sponsored by the lack of statistical signif- together UNDP and the Bank di'!flaced, socioeconomic status, degree Others: Strong participation from the country director. An icance of results. New lend- as the two main partners for of isolation from roads and markets, government, with senior officials extemaJ consultant, ing in Burundi had been pover1y reduction. At the sug­ access to social infrastructure, and agro­ attending PRA training course, for trained at IDS Sussex, suspended following the gestion of the Bank, the com­ climatic zone. Ten communities were cov­ example. Very active participation provided training to the 1996 coup, and the new mittee was widened to ered. Results presented in summary at a fromUNDP. local consultants who government believed that include other key ministries in technical workshop before the report was carried out the PPA. a favorable assessment in poverty reduction issues. written. the PA could lead to new lending. Cameroon Human Resoun:es was Debt-distressed country. CARE-Cameroon with sup­ BA: In. results of the two exercises. Tanzania Manager of the PA was Government was coopera­ University of Tanzania (but SARAR, PRA: A team of 36 people visited Communities: Information sharing Preparation: interested in and aware tive and fully involved at capacity limited). 85 villages over 40 days. A total of 6,000 with no immediate follow-up. Feb/March 1995; of the work being car­ the district level. people were involved. Fieldwork: May. ried out in Tanzania. Others: Government was coopera­ tive and attended policy Cost $100,000 workshops, which were coordinated with the Bank's social sector review and CEM preparation. Togo The PA was completed Social unrest prevailed UNDP. Fifteen unemployed RRA: Semistructured interviews; infor­ Communities: Information sharing. Two weeks Nov 1994; alongside the environ­ from 1992 to 1993. Before graduates were trained. One mation sheets; children's drawings one week Feb 1995 mental assessment. COD the PPA, the government team of 5 and a second team depicting poverty. Covered all rural Others: Donors' participation more (seven teams working was very supportive and and the UNDP had already of 10 led by a Dutch consul­ regions plus the capital. Forty villages extensive than government's. at the same time). committed to the begun a policy debate tant. covering five regions and urban neigh­ Discussion of results during a series aproach. Lines of com­ about poverty. borhoods in Lome. of regional workshops with NGOs Systematic Client Con­ munication were clearly and government. sultation Fund established. The Resi­ dent Mission was c0op­ erative. Uganda The PPA was conducted QviI war in certain areas. Ministry of Planning, UNDP, RRA, pictorial drawings. The PPA was Communities: Information sharing. One week 1992. One of with the PA. Government willing to and the University. conducted only in areas where quantita­ the first ppAs. accept that poverty exists. tive infonnation did not exist, that is, in Others: Involvement of other insti­ the war zones. tutions limited because of time c0n­ Cost $3,(XX) straints. .... ..... IJ1 Zambia The PA and PPA man­ Government gradually Nine-person interdisciplinary BA and PRA: Interview guide for semi- Communities: Moved beyond Research Sept.-Nov. agers worked closely included through the Sys­ team of researchers. The team structured interviews with individual. information sharing-the poor 1993. throughout the process. tematic Client Consultation later formed an NGO called and groups. Ten research sites over a vari- were consulted on an ongoing The PA manager had approach. the PAG. ely of communities (urban and rural). basis. PAG returned to the commu­ Funded by Sida, supported qualitative nities on a yearly basis to assess the $100,ooJ techniques in a previous changes in their welfare/poverty. Bank project in Zambia (Social Recovery Project) Others: Extensive stakeholder con­ and promoted the sultation. Zambians drafted the rec­ BAiPRA approach in ommendations sections of the PA. the Bank. (Table continues on the following page.) Appendix A. (continued) Country, and cost Context Bank Context in Institutions involved Level LATIN AMEIuCA AND CARIBBEAN Argentina Before PPA was under- The government requested Ministry of Social Welfare BA: Conversational interviews and par- Communities: Information sharing. PPA started in Oct taken, time had been the assistance of the Bank through the direct tial observation. The initial PPA was of 1995. Estimated dura­ spent building an under- in conducting qualitative involvement of the minister. limited scope and involved only a few Others: Ministry and Minister of tion six months. PA standing between the research. Good coordina- NGOs. SIEMPRO under the rural areas. The objective of the PPA was Social Welfare fully involved. Aunit already completed. technical team and the tion among government Ministry of Social Welfare. to test methodologies and develop insti­ has been established within the COD team, which agencies. The initial activi- PSA and PROINDER under tutional support. In fact, after the initial ministry to monitor poverty and engendered a positive ties were carried out dur­ the Secretariat of Agriculture. exercise, PPAs for two provinces (Salta social programs. A seminar has attitude toward the PPA ing the preparation of the and Missions) have been planned. been held with high-level govern- from the outset. Some Social Protection Project ment officials. Strong interest has questions were raised by (Ln AR-35495), particularly already been expressed by other the COD on whether the Component C: Technical departments. NGOs will be >-> information would be Assistance for the Improve- involved in the execution work. >-> a.. "sound bite"-focused. ment of Social Information The dialogue between the govern­ (SIEMPRO). ment and the NGOs has gradually increased. Brazil Focus on education and Strong interest by govern- Ministry of Education and BA Communities: Information sharing. Nine months employment. ment in the qualitative Ministry of Planning approach. Others: UJcaI, state, and federal govenunent. Costa Rica Coordinated with the PA The government was very No NGOs were involved. The SA in four regions; 262 interviews Communities: Information sharing. 1995, two months manager who lives in supportive of the process. government wants to include fieldwork. Honduras. Unes of com- Senior officials from the them extensively at the dis- Others: Govenunent was munication between the Ministry of Economic Plan­ semination phase. extensively involved from the Cost $36,500 managers of the PA and ning were involved from beginning. PPA were, therefore, the beginning. often unclear. Ecuador The manager of the PA The government neither UNICEF cofinanced the PRA: seven villages and one urban com- Communities: The PPA was called a Preparation: April 1994 had no access to funds supported nor objected to process. Two NGOs were munity. SSIs and workshops. Rural Qualitative Survey as it was Fieldwork: May 1994 from the Bank and had the PA or the PPA. involved in both the rural and IeIt that the process was not partici­ Meetings with stake­ to raise the funding. As urban areas. Government patory but more infunnation shar­ holders: Oct. 1995. such he was unable to institutions were not exten­ ing. NGOs went back to share the recruit consultants from sively involved at any level. results of the studies with several Cost $70,txXl the Bank's technical communities. Dutch Trust Fund department. From the beginning, the manager Other.;; Participation of was able to clearly government institutions was mini­ define the information mal. The NGOs were extensively he considered to be involved. Interest of nonparticipat­ relevant. ing NGOs was very high. Guatemala The PPA was The government would Liaised with the university BA. Two three-person teams. Average of Communities: Information sharing. Phase 1 in early 1993 undertaken without have liked to be more but relations between the 15 days in every municipality; 223 inter­ Phase 2: three months, extensive consultation involved in the decision- Bank and the university have views; 22 focus groups. Participatory Others: The government produced Nov. 1993-Jan. 1994. with the Country making process of the PPA. not been strong. UNDP and mapping too sensitive to undertake and its own publication using the .... ..... Department. UNICEF initially supportive. subject to misinterpretation. Research results of the BA. 'J teams could not stay overnight in some communities for security reasons. Mexico Clear lines of communi- Major devaluation. Strong 50s (Government Poverty BA: Four teams interviewed 722 people Communities: Information sharing. InteIv:iews conducted cation established initial support lessened as Agency) actively participated in four areas (two urban, two rural). in Feb. and March between the PPA advisor other priorities took over. in the fieldwork. All consul­ Qualitative research and conversational Others: UNDP and UNICEF cofi­ 1995. Conducted with and the PA manager. tants hired were from NGOs. interviews. nanced. The capacity of the SOS to thePA. However, communica­ conduct qualitative assessments tions with the supervisor increased. undertaking the PPA in the field were difficult. (Table continues on the following page.) Appendix A. (continued) Country, timing, and cost Context Bank Context in country Institutions involved Methodology Level ofparticipation EIlROPE AND CENTRAL AsIA Albania The report was managed Individual field researchers Various: Individual interviews with Communities: Information sharing. The Green Cover and written by a senior contracted. No institutions households; interviews with key infor­ report was dated Aug economist and was nar- involved in the research. mants inducting academics, expat and 1996; most compo­ rowly focused. One part local staff of agencies implementing land nents were carried out was devoted to ruml- privatization, and microcredit Jan-July 1996. urban migrants squat­ ting on the outskirts of Cost about $50,000, the capital and one other inducting World Bank city. The other part was time and travel. In­ focused on the beneficia­ country research com­ ries of the agriculture ..... ..... ponent ranged from microcredit program. ()() $13,cm to $25,cm (paid for by UNDP). Armenia Wanted to coordinate Ministry of Economy In the PA, Armenian Assem­ Seven hundred semistructured Communities: Information sharing. Started in 1994. Com­ the PA with the Social bly of Armenia. Most other interviews with individuals pleted June 1995. Investment Fund. Good NGOs were involved in emer­ Others: The PPA manager and the relations with COD. Chun:h was also with local officials, medical personnel, field researchers (professional Fieldwork in Oct 1994 Senior management teachers, and aid workers. anthropologists and social scien­ -March 1995. support. tists) presented field research find­ ings at several workshops to local NGOs, government officials in Yerevan, and international NGOs. Their input was incorporated into the final report. Azerbaijan SORGU Institute attached to Seventeen interviewers; mainly sociolo­ Communities: Series of stakeholder Fieldwork conducted the Baku Institute of Sociology gists and education personnel with previ­ workshops will be convened and from Aug 1995-Jan and Political Science. NGOs ous experience of quantitative and will include the poor, to feed back 1996. and government assisted with qualitative fieldwork. Semistructured the preliminary findings, elicit com­ selection of sites. interviews with groups of five and eight ments and critiques, all of which people. Results combined with commu­ will be incorporated into the final nity surveys conducted in 91 population report and recommendations. points throughout the country in parallel with a national household survey in Nov.-Dec. 1995. Georgia PPA designed to comple- Government informed, on In-country research was part Various: Semistructured, in-depth Communities: Information sharing. Draft PPA completed ment other poverty sur- boord, otherwise not of a project financed by the household interviews. Semistructured April 1997. veys (income and involved. UNDP. Project managed by interviews with"expert" informants­ expenditure, etc.) and local social scientist and one aid workers from local and international contribute to the CAS. deputy. NGOs and donor organizations; head doctors; school directors and teachers; and offictals. .... .... <.0 Moldova The manager of the PA Loca1 NGO formed by and Various: Semistructured, in-depth PPA began in June made considerable effort working under the auspices of household interviews. Semistructured 1996 and completed in to coordinate other proj­ an American NGO. interviews with "expert" informants- June 1997. ects with the PPA aid workers from local and international (including the Social NGOs and donor organizations; head Investment Fund, an doctors; school directors and teachers; agriculture sector social officials. assessment, micro­ finance, etc.) in terms of selecting regions, highlighting issues, and trying to gather comple­ mentary data rather than repeat previous reseaJXh. (Table continues on the following page.) Appendix A. (continued) Country, timing, and cost Context Bank Context in country Institutions involved Methodology Level ofparticipation Ukraine PA consisted of several World Bank manager and a Various: Semistructured, in-depth Communities: information sharing. Completed 1996. romponents, one of U.S. anthropologisl contracted household interviews. Semistructured which was the PPA. with a Kiev-based. sociological interviews with "expert" informants- Others: Results were presented in resean:h institute and some aid workers from Ioca1 and international several workshops for academics, individual researchers to con­ NGOs and donor organizations; head NGO representatives, and govern­ duct the interviews through­ doctors; school directors and teachers; ment officials (and Ukraine office out the country. and officials, etc. World Bank staff) upon completion of the field research; their input was incorporated into the final docu­ ment. SOUTH ASIA Pakistan The manager of the PA The government did not The Federal Bureau of Stati.'l­ PRA: Local consultants were recruited. Communities: information sharing. .... Feb.-July 1994. Fieldwork for two was given limited time 10 complete the PA. support or oppose the PPA. tics was involved in selecting However, some the communities. Roving tearns were used. Others: Workshops were held with t:5 months. Many felt that the PPA government officials and a wide cross-section of stakeholders information was not NGOs disagreed with the for the PA. adequately represented PA's conclusions. Although in the PA. The PPA was there was consultation, conducted after the some stakeholders felt their household survey analy­ views were not considered sis was completed. The and that the ongoing supervisor of the PPA national poverty debate was an outside consul­ was not represented in the tant. The Human finalPA. Resour<:es Division and COD managed the PPA. Notes: See list on pp. xxi-xxili for definitions of abbreviations and acronyms. The column describing the levels of participation has limited value and is only indicative. To be more accurate, a multiple stakeholder analysis of participation using the stakeholders' own indicators would be required. The diversity of experiences of the PPAs has been affected by many factors, including the context in the World Bank and in country. This is detailed in the table, as are the methodologies employed to elicit the views of the poor. Appendix B. Impact Impact on Impadon Impadon Country PPA highlights World Bank borrower other institutions Lessons learned AFIOCA Benin Children's drawings were This was one of the first The PPAs increased the interest used to understand their PPAs in the Bank, and its of the Ministry of Planning in perceptions of poverty. results initiated the oogo­ conducting qualitative ing dialogue on the use of assessments. qualitative and quantita­ tive information. Those working on the PA stated that the PPA made the PA more interesting and readable. ,..., Burundi The PPA results stressed Ongoing: The country Ongoing: The government is UNDP has used the PPA • The PPA was useful in a postconllict situation as a ,..., N the vicious cycle of team has recommended currently reviewing the poverty results to feed into its own rapid way to gauge the principal poverty issues hunger, health problems, that the Bank undertake a note, which includes the results poverty reduction work. when quantitative data were not available. and low agricultoral out­ new community-based of the PP~ and intends to • A full assessment needs to be made of the skills put The new phenome­ poverty project, the develop its own poverty reduc­ and experience available within the country to non of child-headed design of which will use tion strategy. conduct the PPA. Where the teams have previ­ households resulting the recommendations of ously done neither PRA nor poverty work, two from deaths in the conflict thePPA. weeks of training is insufficient, and they may was highlighted during need external technical assistance to analyze the PPA. In urban areas, results. This PPA did not produce the depth of the PPA extracted the stl>­ analysis expected, primarily because the teams ryline of how the infor­ had too sharp a learning curve during the mal sector had been fieldwork. affected by the tmis and • PRA teams consisting entirely of economists (one embargo. of the Burundi teams) tend to be weak. They focus too much on extracting a number and do not properly document all the qualitative infor­ mation a community is giving. (Table continues on the following page.) Appendix B. (continued) Impact on Impact on Impact on PPA World Bank borrower other institutions Lessons learned Cameroon The emphasis given by Although macroero­ The results of the PA and PPA NGOs and other institutions • Working with NGOs in preparing the PA and the poor to problems of nomic management and were a shock ro Cameroonians involved in the PPAs under­ PPA provided a highly cost-effective means of hunger, nutrition, and debt issues predominate both inside and outside govern­ srood the value of the tapping inro expertise and capacity. high food expenditures in the country dialogue, ment, as poverty had not previ­ approach and appreciated the • The effectiveness of the exercise depends on the justified and amplified some effort was made to ously been acknowledged as a opportunity to engage in dia­ willingness and commitment of government ro the focus on addressing integrate a poverty serious problem. Ownership logue on poverty issues with engage in dialogue with civil society and on its food insecurity in the reduction strategy inro was not developed among key the government, the Bank, and determination ro tackle the poverty problem poverty reduction strat­ the CAS, building on the policymakers, as the central other donors. identified. This commitment was largely absent egy. The PPA also high- results of the PA/PPA. government was not strongiy in Cameroon, and the results of the PPA were lighted problems of Key elements are support committed ro poverty reduction published without extensive government isolation (transport sys­ for small-sca1e food pro- or ro building on the results of support. There was, therefore, limited learning !em) and governance duction, processing. and the PA/PPA process. Some local and shifting of attitudes. (decentralization). It pro- marketing, and measures government officials did • The composition of the team in the Bank affects ...... vided key insights into ro enhance the status of develop a keen interest in the the way the information is managed, dissernin­ N N the gender dimensions of women, including land PPA and in replicating its ated, and analyzed. There was limited ownership poverty, confirming the and legal reform, rural methodologies elsewhere. in the country and secror departments, and the disproportionate work- infrastructure, and girls' PPA was managed in the Teclmical Department load of women, and the education. Some viewed • The PPA was a vaJuable instrument for bringing fact that changing gender the PPA as having limited the concerns of the poor into the dialogue. roles bring new opportu­ credibility, with some • The PPA provided critical new insights (gover­ nities and new burdens. infonnation being too nance, isolation) and reinforced the priority of generic. Interpretation of tackling food insecurity and poor infrastructure. the data in the Bank was • Ensuring gender balance in the PPA yielded key limited because of lack of insights into the dynamics of poverty. time. • Involving local institutions and holding workshops with both government and civil soci­ ety are mechanisms for expanding ownership of the poverty problem and in-country capacity to analyze and address it. EquarorW The PPA was considered It is too early ro assess the UNDP Assistant Resident Rep­ • The information may be accurate but if the insti- Guinea sensitive and was rewrit­ impact on the government, resentative in country and the tutionaJ frameworks of the borrower and the ten in the Bank. which has not yet seen the Executive Director of the Bank Bank make them unable to embrace the results, rewritten Green Cover version. have requested a meeting to the impact will be limited. di 1996 FYR Macedonia' 1999 Algeria 1999 Russia (update) 1999 Latvia 2000 Scheduled Updates (2) Moldova 2000 Jordan 2001 Tajikistan 2000 Morocco 2001 Turkey 2000 South Asia Scheduled (1) Completed (11) Croatia 2001 Bangladesh' 1990 Scheduled Updates (1) India' 1990 Hungary 2001 Nepal' 1991 Pakistan' 1991 Latin America and the Caribbean Sri Lanka' 1995 Completed (29) Pakistan (update)" 1996 Bolivia' 1990 India (update)' 1997 Chile 1990 Bangladesh (update)' 1998 (Table continues on the following page.) 136 APPENDlXC Appendix C. (continued) South Asia-continucd Kenya' 1995 India (update)' 1998 Mauritania' 1995 Nepal (update)' 1999 Mauritius 1995 India (update)' 2000 Senegal' 1995 Zambia' 1995 Scheduled Updates (1) Zimbabwe' 1995 Sri Lanka' 2001 Eritrea' 1996 Lesotho' 1996 Sub-Saharan Africa Madaga<;<;ar" 1996 Compieted (40) Malawi (update)' 1996 Malawi' 1990 Niger" 1996 Mozambique' 1991 Nigeria' 1996 Ethiopia' 1993 Tanzania" 1996 Ghana' 1993 Togo' 1996 The Gambia' 1993 Congo' 1997 Mali' 1993 Cote d'Ivoire' 1997 Namibia 1993 Gabon 1997 Sierra Leone" 1993 Guinea' 1997 Uganda' 1993 Chad' 1998 Benin' 1994 Djibouti' 1998 Cape Verde' 1994 Rwanda (update)' 1998 Guinea-Bissau' 1994 Burunm' 1999 Rwanda' 1994 Swaziland 2000 Seychelles 1994 Cameroon' 1995 Scheduled Updates (1) Comoros' 1995 Ethiopia' 2001 Ghana (update)' 1995 Total Number of Assessments: Completed-23 Scheduled-1 Scheduled Updates-14 Grand Total-l38 Notes: Assessments classified as completed are in gray or red cover, except for three assessments that were completed before Operational Directive 4.15: Poverty Reduction was issued. Schedule as of March 28, 2000. In East Asia and the Pacific, poverty assessments are not scheduled for Myanmar, due to its inactive status, and the Pacific Island States, because of limited Bank support. In Kol'I'.a, poverty is being monitored in the context of the structural adjustment loans, and the country economic report discusses the impact of the economic crisis on poverty. No poverty assessment is formally scheduled because the Bank's support for Korea is in response to the crisis and is expected to be short tenn. A poverty study for Papua New Guinea was completed in FYOO. In Europe and Central Asia. poverty assessments are not scheduled for the Czech Republic, Slovak Republic. and Slovenia, due to limited Bank support. Poverty assessments are scheduled for Bosnia and Herzegovina, Lithuania, Turkmenistan, and Uzbekistan in FY02. In Latin America and the Caribbean, poverty assessments are not scheduled for Suriname, due to its inactive status, and for the Organization of Eastern Caribbean States (OECS), due to limited Bank support. A poverty assessment update for Mexico is in green cover. In the Middle East and North Africa, poverty assessments are not scheduled for Iran and the Syrian Arab Republic due to limited Bank support. In South Asia, poverty assessments are not scheduled for Afghanistan, due to its inactive status, and for Bhutan and Maldives, due to limited Bank support. In Sub-Saharan Africa, poverty assessments are not scheduled for Botswana, Democratic Republic of Congo, Liberia, Somalia, and Sudan, due to their inactive status, and to Equatorial Guinea and Sao Tome and Principe, due to limited Bank support. A poverty assessment for South Africa, titled "Poverty and Inequality," was com­ pleted by the government in FY98. The Bank contnbuted to this report, including by undertaking an LSMS and participatory poverty assessments, and by preparing the poverty profile and background papers. Poverty notes have been completed for Burkina Faso (FY97) and Central African Republic (FY98). Additional poverty notes/studies will be prepared for Burkina Faso, Cameroon, Ghana, Kenya, Madagascar, and Uganda. , IDA borrower. Source: Table compiled by PRMPO, World Bank, Washington, D.C. APPENDIXD 137 Appendix D. Examples of PRA Exercises in Thailand (1998) and Zambia (1996) Example of PRA Exercise in Thailand Impact of the Economic Crisi" Khon Kaen DaIolt: 26 .loouory 1998 Focilil'Qtor. M:min WbeelM Parhcipants:~of Teparak Community 19 in Numwl Source: Robb and Zhang (1998). Example of PRA Exercise in Zambia Causes and Impact of Early Initiation of Sex among Girl, IAnolyzed by a group of girls, Chawomo Compound) The numbers inside !he ci