Publication: A Framework for the Economic Evaluation of Digital Health Interventions
Loading...
Date
2023-04-19
ISSN
Published
2023-04-19
Editor(s)
Abstract
Numerous digital health interventions have been piloted in response to the health care challenges low- and middle-income countries face. Because the opportunity cost of investing in digital health interventions can be large, countries must make choices about which interventions to scale up. To make good investment decisions about digital health interventions, there is a need to define and establish their value, and to use economic evaluation to make informed decisions, however DHIs present methodological challenges for economic evaluation. To address these challenges, this paper first creates a ‘gap map’ of digital evidence which reveals a dearth of economic evaluation evidence about digital health interventions; this lack can limit decisions on policy, programming, and appropriate scale-up of digital health interventions. To advance work in this field, this paper then develops an economic evaluation framework that can be used when determining the economic value of digital health interventions. Such a standardized approach, alongside guidance to assist the conduct and use of economic evidence, can improve decision making and investments in DHI under constrained health budgets. The resulting digital health intervention economic evaluation framework consists of 5 steps: (1) determine the context, (2) determine the intervention type, (3) establish the level of complexity, (4) set the analytic principles, and (5) represent the value proposition. Users of the framework should attempt to adhere to its steps and principles, but where this is not feasible or appropriate, they should provide justification for the methodological choice. The framework should facilitate methodological transparency, thereby improving the overall usefulness of economic evaluations of digital health interventions.
Link to Data Set
Citation
“Wilkinson, Thomas; Wang, Mengxiao; Friedman, Jed; Prestidge, Marelize. 2023. A Framework for the Economic Evaluation of Digital Health Interventions. Policy Research Working Papers; 10407. © World Bank. http://hdl.handle.net/10986/39713 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Integration of Health Systems and Priority Health, Nutrition, and Population Interventions : A Framework for Analysis and Policy Choices(World Bank, Washington, DC, 2008-08)A longstanding debate on health system organization relates to the benefits of integrating programs that emphasize specific interventions into mainstream health systems to increase access and improve health outcomes. This debate has long been characterized by polarization of views and ideologies, with protagonists for and against integration arguing relative merits of each approach. Recently, the debate has been rekindled due to substantial rises in externally funded programs for priority health, nutrition, and population (HNP) interventions and an increase in international efforts aimed at health system strengthening. In this paper the author present a conceptual framework and an analytical approach to define and assess the nature and extent of integration in relation to critical health system functions. The framework can also be used to systematically compare and contrast programs in different settings to generate meaningful evidence to inform policy. In this framework, the author defines integration as the extent, pattern, and rate of adoption and eventual assimilation of priority health interventions into each of the critical functions of a health system, which include, inter alia: (i) governance, (ii) financing, (iii) planning, (iv) service delivery, (v) monitoring and evaluation, and (vi) demand generation. The framework and the analytical approach are intended for evaluative and formative studies of policies, systems, and programs.Publication Impact Evaluation of Trade Interventions : Paving the Way(2011-11-01)The focus of trade policy has shifted in recent years from economy-wide reductions in tariffs and trade restrictions toward targeted interventions to facilitate trade and promote exports. Most of these latter interventions are based on the new mantra of "aid-for-trade" rather than on hard evidence on what works and what does not. On the one hand, rigorous impact-evaluation is needed to justify these interventions and to improve their design. On the other hand, rigorous evaluation is feasible because unlike traditional trade policy, these interventions tend to be targeted and so it is possible to construct treatment and control groups. When interventions are not targeted, such as in the case of customs reforms, some techniques, such as randomized control trials, may not be feasible but meaningful evaluation may still be possible. Theis paper discusses examples of impact evaluations using a range of methods (experimental and non-experimental), highlighting the particular issues and caveats arising in a trade context, and the valuable lessons that are already being learned. The authors argue that systematically building impact evaluation into trade projects could lead to better policy design and a more credible case for "aid-for-trade."Publication Costa Rica Case Study : Primary Health Care Achievements and Challenges within the Framework of the Social Health Insurance(World Bank, Washington, DC, 2013-01)The objective of this paper is to assess the key interventions Costa Rica has developed to expand health coverage for the poor and other vulnerable groups, with an emphasis on its approach to primary health care. Universal health coverage in Costa Rica is provided through a single national health insurance program. This program, which protects the poor without the pitfalls of a fragmented system, and the sustained policies that have enabled the building of a solid primary health care system, is broadly recognized as a success story. At the same, time new challenges are emerging to sustaining the success of Costa Rica's universal health coverage. Social Security of Costa Rica (Caja Costarricense de Seguridad Social, CCSS) faces increased production costs and demographic and epidemiological changes in a rapidly aging population. This report is divided into three broad sections: (1) objective of the case study and health system overview; (2) primary health care and the organization of health services within CCSS; and (3) agenda of key policy decisions for a renewed primary health care approach as part of a more responsive and sustainable health insurance system.Publication Using Allocative Efficiency Analysis to Inform Health Benefits Package Design for Progressing towards Universal Health Coverage(PLoS, 2021-11-29)Countries are increasingly defining health benefits packages (HBPs) as a way of progressing towards Universal Health Coverage (UHC). Resources for health are commonly constrained, so it is imperative to allocate funds as efficiently as possible. We conducted allocative efficiency analyses using the Health Interventions Prioritization tool (HIPtool) to estimate the cost and impact of potential HBPs in three countries. These analyses explore the usefulness of allocative efficiency analysis and HIPtool in particular, in contributing to priority setting discussions.Publication Health in All Policies as a Strategic Policy Response to NCDs(World Bank, Washington, DC, 2014-02)The aim of Health in All Policies (HiAP) is to bring diverse sectors together to find shared solutions; it focuses on identifying 'win-win' or 'cobenefits' such that policy measures contribute not only to improved health outcomes but also to outcomes desired by other sectors, such as education, environment, welfare, agriculture, and transportation. HiAP can be applied to NCD prevention and control from three different entry points: risk factors or conditions, population groups (including life course), and sectors. (HiAP) is a relatively new concept and policy practice that attempts to incorporate consideration into the policy decision-making process of how public policies and programs affect community health and well-being. It represents a way of working across sectors that aim to find solutions for complex, interrelated, and persistent problems. With the global epidemic in non-communicable diseases (NCDs), HiAP offers a potential approach and a pathway to secure coordinated action on social determinants of health that relate to NCDs and result in health inequalities. Promising examples can be seen globally for action on both specific NCD risk factors as well as in a more systemic approach to policy decision making.
Users also downloaded
Showing related downloaded files
Publication Implementation Know-how Briefs to Support Countries to Prioritize, Connect and Scale for a Digital-in-Health Future(Washington, DC: World Bank, 2023-08-18)Technology and data are integral to daily life. As health systems face increasing demands to deliver new, more, better, and seamless services affordable to all people, data and technology are essential. With the potential and perils of innovations like artificial intelligence the future of health care is expected to be technology-embedded and data-linked. This shift involves expanding the focus from digitization of health data to integrating digital and health as one: Digital-in-Health. The World Bank’s report, Digital-in-Health: Unlocking the Value for Everyone, calls for a new digital-in-health approach where digital technology and data are infused into every aspect of health systems management and health service delivery for better health outcomes. The report proposes ten recommendations across three priority areas for governments to invest in: prioritize, connect and scale. The Implementation Know-How Briefs serve as practical guides for countries as they implement the ten recommendations. Every Implementation Know-How Brief provides practical information to start planning and implementing how to implement the recommendations. It also contains key terminologies for those not familiar with a particular topic, provides key questions to ask, and a general orientation as to typical issues in these sectors. Topics covered are: 1.) Digital health assessments; 2.) Telemedicine and virtual health care; 3.) Private sector involvement in digital health; 4.) Interoperability in health sector; 5.) Data governance for health data; 6.) Cybersecurity for health sector; 7.) Digital health records; 8.) Determining value of digital technology in health; 9.) Certification and regulatory sandboxes for digital technologies in health; 10.) Workflow mapping for digital technology (re)design in health systems.Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication Digital Health Assessment Toolkit Guide(World Bank, Washington, DC, 2021-11-01)The advancement of technology and the exponential growth of data are providing the opportunity to Low Income Countries and Lower Middle-Income Countries to leapfrog and improve quality of care, decision making, the efficient use of resources, while reducing costs and burden of diseases. Recognizing the promise and potential of digital systems, technologies, and data to support the redesign of PHC and solve pernicious healthcare challenges in countries, digital health assessments intend to be an input and the first step towards the digital journey and to plan and prioritize what a country's health system of the future would look like. As expressed in the WHO’s Global Digital Health Strategy, approved by WHO member states in 2021, ‘Digital health should be an integral part of health priorities and benefit people in a way that is ethical, safe, secure, reliable, equitable and sustainable. It should be developed with principles of transparency, accessibility, scalability, replicability, interoperability, privacy, security and confidentiality.’Publication Causes of Deforestation of the Brazilian Amazon(Washington, DC: World Bank, 2004)The worldwide concern with deforestation of Brazilian Amazonia is motivated not only by the irreversible loss of this natural wealth, but also by the perception that it is a destructive process in which the social and economic gains are smaller than the environmental losses. This perception also underlies the diagnosis, formulation and evaluation of public policies proposed by government and non-governmental organizations working in the region, including the World Bank. The present work suggests that a fuller understanding is necessary with regard to the motivations and identity of the agents responsible for deforestation, the evaluation of the social and economic benefits from the process and the resulting implications of public policies for the region. The objective of the report is to show that, in contrast to the 1970s and 1980s when occupation of Brazilian Amazonia was largely induced by government policies and subsidies, recent deforestation in significant parts of the region is basically caused by medium- and large-scale cattle ranching. Following a private rationale, the dynamics of the occupation process gradually became autonomous, as is suggested by the significant increase in deforestation in the 1990s despite the substantial reduction of subsidies and incentives by government. Among the causes of the transformation are technological and managerial changes and the adaptation of cattle ranching to the geo-ecological conditions of eastern Amazonia which allowed for productivity gains and cost reductions. The fact that cattle ranching is viable from the private perspective does not mean that the activity is socially desirable or environmentally sustainable. Private gain needs to be contrasted with the environmental (social) costs associated with cattle ranching and deforestation. From the social perspective, it is legitimate to argue that the private benefits from large-scale cattle ranching are largely exclusive, having contributed little to alleviate social and economic inequalities. The study notes, however, that decreases in the price of beef in national markets and increases in exports caused by the expansion of cattle ranching in Eastern Amazonia may imply social benefits that go beyond sectoral and regional boundaries.Publication A Cost Effective Solution to Reduce Disaster Losses in Developing Countries : Hydro-Meteorological Services, Early Warning, and Evacuation(World Bank, Washington, DC, 2012-05)In Europe, it can be estimated that hydro-meteorological information and early warning systems save several hundreds of lives per year, avoid between 460 million and 2.7 billion Euros of disaster asset losses per year, and produce between 3.4 and 34 billion of additional benefits per year through the optimization of economic production in weather-sensitive sectors (agriculture, energy, etc.). The potential for similar benefits in the developing world is not only proportional to population, but also to increased hazard risk due to climate and geography, as well as increased exposure to weather due to the state of infrastructure. This analysis estimates that the potential benefits from upgrading to developed-country standards the hydro-meteorological information production and early warning capacity in all developing countries include: (i) between 300 million and 2 billion USD per year of avoided asset losses due to natural disasters; (ii) an average of 23,000 saved lives per year, which is valued between 700 million and 3.5 billion USD per year using the Copenhagen Consensus guidelines; and (iii) between 3 and 30 billion USD per year of additional economic benefits. The total benefits would reach between 4 and 36 billion USD per year. Because some of the most expensive components of early warning systems have already been built (e.g., earth observation satellites, global weather forecasts), these investments are relatively modest, estimated here around 1 billion US per year, reaching benefit-cost ratios between 4 and 36.