Publication: Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes: The Promise and the Reality
Loading...
Date
2016-02
ISSN
Published
2016-02
Author(s)
Editor(s)
Abstract
This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.
Link to Data Set
Citation
“Cataldo, Fabian; Kielmann, Karina. 2016. Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes: The Promise and the Reality. Health, Nutrition and Population Discussion Paper;. © World Bank. http://hdl.handle.net/10986/24038 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Related items
Showing items related by metadata.
Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Integrating Quantitative and Qualitative Research in Development Projects(Washington, DC: World Bank, 2000-06)"Much of the early work on poverty was highly quantitative:... It became increasingly clear, however, that while numbers are essential for policy and monitoring purposes, it is also important to understand people's perception of poverty and their mechanisms for coping with poverty and other situations of extreme economic and social stress." Researchers have recognized over the past few years that quantitative analysis of the incidence and trends in poverty, while essential for national economic development planning, must be complemented by qualitative methods that help planners and managers understand the cultural, social, political, and institutional context within which projects are designed and implemented. This report is based on a two-day workshop held in June 1998, where outside research specialists and World Bank staff discussed the importance of integrating these research methods. The participants reviewed experiences in the use of mixed-method approaches in Bank research and project design. This report is a result of those discussions. The report examines the need for integrated research approaches in social and economic development, presents case studies of integrated approaches in practice, and talks about lessons learned. Part I describes the evolution of interest in, and the potential benefits of integrated research, and, Part II presents case studies on how integrated approaches have been used in poverty analysis, education, health, and water supply and sanitation, while Part III discusses lessons learned with respect to the use of integrated approaches, and assesses the benefits that can be achieved.Publication Right to Information(World Bank, Washington, DC, 2014-12-01)The findings from the study suggest that international pressure for more effective Right to Information (RTI) implementation only goes so far. The development of RTI laws with the encouragement, assistance, or insistence of the international community was a prominent theme throughout the case studies, particularly for EU countries during their accession process. But implementation is a less straightforward task, with many interlocking, moving parts, and international support comes in ad hoc fashion as the process unfolds. A strong implication from these findings is that a national coordinating strategy may be valuable for implementation. This kind of strategy document should take the interdependence of the drivers of effectiveness into account when drafting policies and rules for practice, and can serve as a guiding document when deciding on foreign funding priorities.Publication East Africa Public Health Laboratory Networking Project(World Bank, Washington, DC, 2016-04)This report summarizes the main findings from the application of performance based incentives linked to progress on a standardized, globally recognized metric - the stepwise laboratory improvement process towards accreditation (SLIPTA) checklist - under the East Africa Public Health Laboratory Networking Project (EAPHLNP) in Rwanda. The lab performance-based financing (PBF) pilot was introduced in the context of a well-established national PBF program dating back to the early 2000s. The flexible nature of the EAPHLNP and the favorable context in Rwanda provided an ideal backdrop to introduce PBF incentive payments to accelerate progress of five project supported labs towards accreditation. The evaluation found improved laboratory performance at all project-supported laboratories in Rwanda as measured by the SLIPTA scores. For the first time, laboratories were bringing in PBF revenues, instilling a culture of continuous quality improvements, and focusing management attention on accreditation. PBF appears to have contributed to an accelerated change, with PBF laboratories experiencing an overall greater increase in SLIPTA scores compared to project-supported laboratories in the other countries. No clear patterns were found in terms of improved test volumes or test accuracy, which were not part of the pilot scheme. While it was difficult to disentangle the effects of different interventions, the evaluation found a system-strengthening value to combining investments in modernizing laboratories, and strengthening human resources with PBF. Relationships between laboratory staff and clinicians improved, with laboratory managers having a greater voice in hospital management and lab staff increasingly valued and respected by clinicians. A spirit of teamwork prevailed at participating sites. Other countries considering PBF mechanisms for public health laboratories need to take into account lessons learned and assess the features which may be relevant to their own contexts. PBF schemes for laboratories need to be viewed as an integral part of a package of interventions that contribute to enhanced performance.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.
Users also downloaded
Showing related downloaded files
Error: Could not load results for 'https://openknowledge.worldbank.org/server/api/item/relateditemlistconfigs/1b16f3a8-113e-5421-84c3-10dca5e7abed_downloads/itemlist'.