Publication: Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes: The Promise and the Reality
Loading...
Date
2016-02
ISSN
Published
2016-02
Author(s)
Editor(s)
Abstract
This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.
Link to Data Set
Citation
“Cataldo, Fabian; Kielmann, Karina. 2016. Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes: The Promise and the Reality. Health, Nutrition and Population Discussion Paper;. © World Bank. http://hdl.handle.net/10986/24038 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Integrating Quantitative and Qualitative Research in Development Projects(Washington, DC: World Bank, 2000-06)"Much of the early work on poverty was highly quantitative:... It became increasingly clear, however, that while numbers are essential for policy and monitoring purposes, it is also important to understand people's perception of poverty and their mechanisms for coping with poverty and other situations of extreme economic and social stress." Researchers have recognized over the past few years that quantitative analysis of the incidence and trends in poverty, while essential for national economic development planning, must be complemented by qualitative methods that help planners and managers understand the cultural, social, political, and institutional context within which projects are designed and implemented. This report is based on a two-day workshop held in June 1998, where outside research specialists and World Bank staff discussed the importance of integrating these research methods. The participants reviewed experiences in the use of mixed-method approaches in Bank research and project design. This report is a result of those discussions. The report examines the need for integrated research approaches in social and economic development, presents case studies of integrated approaches in practice, and talks about lessons learned. Part I describes the evolution of interest in, and the potential benefits of integrated research, and, Part II presents case studies on how integrated approaches have been used in poverty analysis, education, health, and water supply and sanitation, while Part III discusses lessons learned with respect to the use of integrated approaches, and assesses the benefits that can be achieved.Publication Right to Information(World Bank, Washington, DC, 2014-12-01)The findings from the study suggest that international pressure for more effective Right to Information (RTI) implementation only goes so far. The development of RTI laws with the encouragement, assistance, or insistence of the international community was a prominent theme throughout the case studies, particularly for EU countries during their accession process. But implementation is a less straightforward task, with many interlocking, moving parts, and international support comes in ad hoc fashion as the process unfolds. A strong implication from these findings is that a national coordinating strategy may be valuable for implementation. This kind of strategy document should take the interdependence of the drivers of effectiveness into account when drafting policies and rules for practice, and can serve as a guiding document when deciding on foreign funding priorities.Publication East Africa Public Health Laboratory Networking Project(World Bank, Washington, DC, 2016-04)This report summarizes the main findings from the application of performance based incentives linked to progress on a standardized, globally recognized metric - the stepwise laboratory improvement process towards accreditation (SLIPTA) checklist - under the East Africa Public Health Laboratory Networking Project (EAPHLNP) in Rwanda. The lab performance-based financing (PBF) pilot was introduced in the context of a well-established national PBF program dating back to the early 2000s. The flexible nature of the EAPHLNP and the favorable context in Rwanda provided an ideal backdrop to introduce PBF incentive payments to accelerate progress of five project supported labs towards accreditation. The evaluation found improved laboratory performance at all project-supported laboratories in Rwanda as measured by the SLIPTA scores. For the first time, laboratories were bringing in PBF revenues, instilling a culture of continuous quality improvements, and focusing management attention on accreditation. PBF appears to have contributed to an accelerated change, with PBF laboratories experiencing an overall greater increase in SLIPTA scores compared to project-supported laboratories in the other countries. No clear patterns were found in terms of improved test volumes or test accuracy, which were not part of the pilot scheme. While it was difficult to disentangle the effects of different interventions, the evaluation found a system-strengthening value to combining investments in modernizing laboratories, and strengthening human resources with PBF. Relationships between laboratory staff and clinicians improved, with laboratory managers having a greater voice in hospital management and lab staff increasingly valued and respected by clinicians. A spirit of teamwork prevailed at participating sites. Other countries considering PBF mechanisms for public health laboratories need to take into account lessons learned and assess the features which may be relevant to their own contexts. PBF schemes for laboratories need to be viewed as an integral part of a package of interventions that contribute to enhanced performance.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Global Economic Prospects, June 2024(Washington, DC: World Bank, 2024-06-11)After several years of negative shocks, global growth is expected to hold steady in 2024 and then edge up in the next couple of years, in part aided by cautious monetary policy easing as inflation gradually declines. However, economic prospects are envisaged to remain tepid, especially in the most vulnerable countries. Risks to the outlook, while more balanced, are still tilted to the downside, including the possibility of escalating geopolitical tensions, further trade fragmentation, and higher-for-longer interest rates. Natural disasters related to climate change could also hinder activity. Subdued growth prospects across many emerging market and developing economies and continued risks underscore the need for decisive policy action at the global and national levels. Global Economic Prospects is a World Bank Group Flagship Report that examines global economic developments and prospects, with a special focus on emerging market and developing economies, on a semiannual basis (in January and June). Each edition includes analytical pieces on topical policy challenges faced by these economies.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.