Publication: A Framework for the Economic Evaluation of Digital Health Interventions
Loading...
Published
2023-04-19
ISSN
Date
2023-04-19
Editor(s)
Abstract
Numerous digital health interventions have been piloted in response to the health care challenges low- and middle-income countries face. Because the opportunity cost of investing in digital health interventions can be large, countries must make choices about which interventions to scale up. To make good investment decisions about digital health interventions, there is a need to define and establish their value, and to use economic evaluation to make informed decisions, however DHIs present methodological challenges for economic evaluation. To address these challenges, this paper first creates a ‘gap map’ of digital evidence which reveals a dearth of economic evaluation evidence about digital health interventions; this lack can limit decisions on policy, programming, and appropriate scale-up of digital health interventions. To advance work in this field, this paper then develops an economic evaluation framework that can be used when determining the economic value of digital health interventions. Such a standardized approach, alongside guidance to assist the conduct and use of economic evidence, can improve decision making and investments in DHI under constrained health budgets. The resulting digital health intervention economic evaluation framework consists of 5 steps: (1) determine the context, (2) determine the intervention type, (3) establish the level of complexity, (4) set the analytic principles, and (5) represent the value proposition. Users of the framework should attempt to adhere to its steps and principles, but where this is not feasible or appropriate, they should provide justification for the methodological choice. The framework should facilitate methodological transparency, thereby improving the overall usefulness of economic evaluations of digital health interventions.
Link to Data Set
Citation
“Wilkinson, Thomas; Wang, Mengxiao; Friedman, Jed; Prestidge, Marelize. 2023. A Framework for the Economic Evaluation of Digital Health Interventions. Policy Research Working Papers; 10407. © World Bank. http://hdl.handle.net/10986/39713 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Integration of Health Systems and Priority Health, Nutrition, and Population Interventions : A Framework for Analysis and Policy Choices(World Bank, Washington, DC, 2008-08)A longstanding debate on health system organization relates to the benefits of integrating programs that emphasize specific interventions into mainstream health systems to increase access and improve health outcomes. This debate has long been characterized by polarization of views and ideologies, with protagonists for and against integration arguing relative merits of each approach. Recently, the debate has been rekindled due to substantial rises in externally funded programs for priority health, nutrition, and population (HNP) interventions and an increase in international efforts aimed at health system strengthening. In this paper the author present a conceptual framework and an analytical approach to define and assess the nature and extent of integration in relation to critical health system functions. The framework can also be used to systematically compare and contrast programs in different settings to generate meaningful evidence to inform policy. In this framework, the author defines integration as the extent, pattern, and rate of adoption and eventual assimilation of priority health interventions into each of the critical functions of a health system, which include, inter alia: (i) governance, (ii) financing, (iii) planning, (iv) service delivery, (v) monitoring and evaluation, and (vi) demand generation. The framework and the analytical approach are intended for evaluative and formative studies of policies, systems, and programs.Publication Costa Rica Case Study : Primary Health Care Achievements and Challenges within the Framework of the Social Health Insurance(World Bank, Washington, DC, 2013-01)The objective of this paper is to assess the key interventions Costa Rica has developed to expand health coverage for the poor and other vulnerable groups, with an emphasis on its approach to primary health care. Universal health coverage in Costa Rica is provided through a single national health insurance program. This program, which protects the poor without the pitfalls of a fragmented system, and the sustained policies that have enabled the building of a solid primary health care system, is broadly recognized as a success story. At the same, time new challenges are emerging to sustaining the success of Costa Rica's universal health coverage. Social Security of Costa Rica (Caja Costarricense de Seguridad Social, CCSS) faces increased production costs and demographic and epidemiological changes in a rapidly aging population. This report is divided into three broad sections: (1) objective of the case study and health system overview; (2) primary health care and the organization of health services within CCSS; and (3) agenda of key policy decisions for a renewed primary health care approach as part of a more responsive and sustainable health insurance system.Publication Impact Evaluation of Trade Interventions : Paving the Way(2011-11-01)The focus of trade policy has shifted in recent years from economy-wide reductions in tariffs and trade restrictions toward targeted interventions to facilitate trade and promote exports. Most of these latter interventions are based on the new mantra of "aid-for-trade" rather than on hard evidence on what works and what does not. On the one hand, rigorous impact-evaluation is needed to justify these interventions and to improve their design. On the other hand, rigorous evaluation is feasible because unlike traditional trade policy, these interventions tend to be targeted and so it is possible to construct treatment and control groups. When interventions are not targeted, such as in the case of customs reforms, some techniques, such as randomized control trials, may not be feasible but meaningful evaluation may still be possible. Theis paper discusses examples of impact evaluations using a range of methods (experimental and non-experimental), highlighting the particular issues and caveats arising in a trade context, and the valuable lessons that are already being learned. The authors argue that systematically building impact evaluation into trade projects could lead to better policy design and a more credible case for "aid-for-trade."Publication Health in All Policies as a Strategic Policy Response to NCDs(World Bank, Washington, DC, 2014-02)The aim of Health in All Policies (HiAP) is to bring diverse sectors together to find shared solutions; it focuses on identifying 'win-win' or 'cobenefits' such that policy measures contribute not only to improved health outcomes but also to outcomes desired by other sectors, such as education, environment, welfare, agriculture, and transportation. HiAP can be applied to NCD prevention and control from three different entry points: risk factors or conditions, population groups (including life course), and sectors. (HiAP) is a relatively new concept and policy practice that attempts to incorporate consideration into the policy decision-making process of how public policies and programs affect community health and well-being. It represents a way of working across sectors that aim to find solutions for complex, interrelated, and persistent problems. With the global epidemic in non-communicable diseases (NCDs), HiAP offers a potential approach and a pathway to secure coordinated action on social determinants of health that relate to NCDs and result in health inequalities. Promising examples can be seen globally for action on both specific NCD risk factors as well as in a more systemic approach to policy decision making.Publication Using Allocative Efficiency Analysis to Inform Health Benefits Package Design for Progressing towards Universal Health Coverage(PLoS, 2021-11-29)Countries are increasingly defining health benefits packages (HBPs) as a way of progressing towards Universal Health Coverage (UHC). Resources for health are commonly constrained, so it is imperative to allocate funds as efficiently as possible. We conducted allocative efficiency analyses using the Health Interventions Prioritization tool (HIPtool) to estimate the cost and impact of potential HBPs in three countries. These analyses explore the usefulness of allocative efficiency analysis and HIPtool in particular, in contributing to priority setting discussions.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Global Economic Prospects, June 2024(Washington, DC: World Bank, 2024-06-11)After several years of negative shocks, global growth is expected to hold steady in 2024 and then edge up in the next couple of years, in part aided by cautious monetary policy easing as inflation gradually declines. However, economic prospects are envisaged to remain tepid, especially in the most vulnerable countries. Risks to the outlook, while more balanced, are still tilted to the downside, including the possibility of escalating geopolitical tensions, further trade fragmentation, and higher-for-longer interest rates. Natural disasters related to climate change could also hinder activity. Subdued growth prospects across many emerging market and developing economies and continued risks underscore the need for decisive policy action at the global and national levels. Global Economic Prospects is a World Bank Group Flagship Report that examines global economic developments and prospects, with a special focus on emerging market and developing economies, on a semiannual basis (in January and June). Each edition includes analytical pieces on topical policy challenges faced by these economies.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.