Publication: Timing and Duration of Exposure in Evaluations of Social Programs
Loading...
Published
2008-08
ISSN
Date
2012-05-31
Author(s)
Editor(s)
Abstract
Impact evaluations aim to measure the outcomes that can be attributed to a specific policy or intervention. Although there have been excellent reviews of the different methods that an evaluator can choose in order to estimate impact, there has not been sufficient attention given to questions related to timing: How long after a program has begun should one wait before evaluating it? How long should treatment groups be exposed to a program before they can be expected to benefit from it? Are there important time patterns in a program's impact? Many impact evaluations assume that interventions occur at specified launch dates and produce equal and constant changes in conditions among eligible beneficiary groups; but there are many reasons why this generally is not the case. This paper examines the evaluation issues related to timing and discusses the sources of variation in the duration of exposure within programs and their implications for impact estimates. It reviews the evidence from careful evaluations of programs (with a focus on developing countries) on the ways that duration affects impacts.
Link to Data Set
Citation
“King , Elizabeth M.; Behrman, Jere R.. 2008. Timing and Duration of Exposure in Evaluations of Social Programs. Policy Research Working Paper No. 4686. © World Bank. http://hdl.handle.net/10986/6812 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication China Early Child Development : Early Childhood Education in Yunnan(Washington, DC, 2013-11-18)Yunnan is a medium-sized and relatively poor Chinese province on the southwestern border of China. In 2012, the Yunnan department of education formally requested Bank support in conducting a review of early childhood education policies and programs in order to gain an in-depth and evidence-based understanding of the challenges the province faces in expanding early childhood education-in particular to rural and mountainous regions. The Bank's China education team embarked on raising funds, designing and implementing a rather elaborate research agenda around early childhood education. The goal was to investigate key challenges, and to propose policy interventions for expanding the Early Child Development (ECD) coverage in rural Yunnan. This report presents the findings from the background studies, and draws potential policy implications for improving the access to and quality of preschool education in Yunnan province. China has now almost achieved universal 9-year basic education. Over the last decade, the country has devoted increasing attention to policy development in early childhood education. Even though China does not yet have a specific early childhood education law, it has established a rather elaborate set of guidelines and regulations pertaining to early childhood education. Early childhood education has expanded significantly within the last few years. There are two main types of preschool programs for 3-6 year olds including: a regular 3-year program which is called kindergarten, and a one-year program attached usually to primary schools. The rapid growth of preschool teacher supply has contributed to the drop in pupil-teacher ratios across the nation. In Yunnan in particular, the ratio has decreased from approximately 30 to 20 in recent years. However, urban areas still enjoy a more favorable pupil-teacher ratio, as well as a higher proportion of qualified teachers compared to rural areas. Rural areas account for 50 percent of total preschool enrollment, but only 22 percent of all trained teachers serve in rural areas.Publication Early Childhood Care and Development Project : Implementation Completion Memorandum(Washington, DC, 2008-04)The objective of the Project is to assist the Socialist Republic of Vietnam, through Save the Children UK on behalf of International Save the Children Alliance acting under the coordination of the Early Childhood Education Department of the Ministry of Education and Training (MOET) in establishing an enabling environment in the poorest and most vulnerable communities, and providing young children the opportunities to develop to their full potential. All communes in three selected provinces of project locations (Quang Tri, Yen Bai and Dien Bien) face food insecurity, limited access to markets, limited provision of basic infrastructures, poor health, inadequate education, high illiteracy, and environmental degradation. Despite the challenging contextual environment in which this grant has taken place, the grant objectives were largely highly satisfactorily met and fulfilled though four key intermediate project results: increased access and availability of early childhood care and development services and supplies; increased quality of early childhood care and development services (Health and Education); increased family and community awareness and capacity to promote utilization of early childhood care and development services; and improved implementation of policies in support of ethnic minority children.Publication Quality of education in Colombia - Achievements and challenges ahead : analysis of the results of TIMSS 1995-2007(World Bank, 2010-08-06)The main objective of this report is to analyze the effect of time changes and factors associated with student achievement in Colombia in order to foster policies to improve education quality that are grounded in research and the Colombian context. In 2007, Colombia participated for the second time in the Trends in International Mathematics and Science Study (TIMSS), providing a first-time opportunity to analyze the effects of time changes on student achievement over a period (1995-2007) during which a number of education reforms were made. Using the TIMSS 2007 results offers a chance to deepen the study on the factors associated with learning in Colombia and to benchmark Colombia's education system against that of other countries. This effort began during the first phase of the Colombia Programmatic Quality and Relevance of Education Analytic and Advisory Activities (AAA), in which an analysis of Colombia's debut in the 2006 Program for International Student Assessment (PISA), resulted in publication of, 'the quality of education in Colombia: an analysis and options for a policy agenda' report (hereafter, 'PISA report'). The present report builds on this work through an analysis of Colombia's participation in TIMSS 2007 in relation to its performance on TIMSS 1995, and reaffirms the urgent need for improved student learning outcomes in Colombia, further confirming a number of the policy options put forward in the PISA report to inform a future agenda for system design and reform.Publication Liberia - Public Expenditure Review : Human Development(Washington, DC, 2012-11)The human development sector (essentially, education, health, and social protection) plays an important role in promoting economic development and social equity, and improvement in these areas can have a salutary impact on peace and stability. This report is a compilation of three separate sector studies, covering education, health, and social protection. Notwithstanding that each study focuses on progress achieved in distinct areas, a number of cross cutting themes permeate the different chapters. The main cross-cutting threads can be summarized as follows: (i) overall public spending on human development is low given the needs of the population and is highly dependent on donor financing for a large number of activities, a situation that entails risks to sustainability and future development; (ii) intra sectoral allocation is not sufficiently pro-poor; (iii) resource allocation is inequitable; (iv) inefficiency in public expenditures, with large shares of funds going to overhead; leakage of wage funds; and low value for money; and (v) severe lack of data and capacity to monitor and analyze developments.Publication Snakes and Ladders : Factors Influencing Successful Primary School Completion for Children in Poverty Contexts(Washington, DC, 2004-09)The World Bank (New Delhi) commissioned this qualitative study in June 2002 with the objective of exploring various factors that facilitate or impede successful primary school completion, with special reference to children living in diverse poverty situations. The study looks at children from conception to 11 years - tracking key milestones of children in diverse poverty situations in one district each in the states of Andhra Pradesh, Karnataka and Uttar Pradesh. It explores the synergy between health, education and nutritional inputs in the overall development of children in different poverty situations and reflects on whether the proximal and distal environment promotes a holistic development of the child. This study includes the following headings: executive summary; background; through the life cycle of children; emerging issues; and policy implications.
Users also downloaded
Showing related downloaded files
Publication Social Gains in the Balance : A Fiscal Policy Challenge for Latin America and the Caribbean(Washington, DC, 2014-02-24)In 2012, the Latin America and the Caribbean (LAC) region continued its successful drive to reduce poverty and build the middle class. The proportion of the region's 600 million people living in extreme poverty, defined in the region as life on less than $2.50 a day, was cut in half between 2003 and 2012 to 12.3 percent. Reflecting the upward mobility out of poverty, households vulnerable to falling back into poverty became the largest group in LAC in 2005, and represent almost 38 percent of the population. However, in the last two years, the share of vulnerable households has started to decline. The middle class, currently 34.3 percent of the population, is growing rapidly and is projected to replace the vulnerable as the largest economic group in LAC by 2016. The Southern Cone region (including Brazil) continued to be the most dynamic region and the main driver of poverty reduction in LAC, while poverty in Central America and Mexico proved more stubborn. About 68 percent of poverty reduction between 2003 and 2012 was driven by economic growth, with the remaining 32 percent arising from decline in inequality. Overall, equality of access to basic childhood goods and services has improved in recent years. Yet access can be further improved, and serious issues remain concerning the quality of those goods and services, particularly in education and housing infrastructure. Moreover, access increases with parental education and income or assets, reflecting low intergenerational mobility in many countries in the region. As with poverty reduction, most of the progress in equality of access since 2000 has come in the Southern Cone and the Andean regions, while many of Central America's countries managed only small improvements. There are also severe differences at the subnational level and between urban and rural areas, highlighting the need to strengthen the capacity of local governments to deliver high quality basic services to all their citizens.Publication Remarks to the G20 Finance Ministers and Central Bank Governors Meeting(World Bank, Washington, DC, 2020-11-20)World Bank Group President David Malpass said that while some countries are recovering, the pandemic is still taking a terrible toll, with poverty levels rising sharply. He highlighted on the health emergency response programs in one hundred twelve countries using a fast-track mechanism that is now able to access a further window of twelve billion in funding for vaccine purchases and delivery. He also mentioned that the World Bank is already at work in cooperation with WHO, UNICEF, the Global Fund and GAVI on rapid vaccine deployment readiness assessments for one hundred countries. He spoke about IFC working in coordination with CEPI to invest a further four billion in manufacturing and distribution of vaccines and products that support vaccination programs. He recognized that fragile conflict and violence (FCV) states are most in need, and World Bank's engagement with them. Under his Presidency, the World Bank Group has invested more in climate finance than at any time in its history. He mentioned that IDA is frontloading its financing to make more resources available for the poorest countries. He highlighted on an important step that the G20 call on DSSI beneficiary countries to commit to disclose all public sector financial commitments. The Development Committee that asked the Bank and the IMF to propose more actions to address the unsustainable debt burdens of low- and middle-income countries. He concluded that the fuller transparency is the only way to balance the interests of the people with the interests of those signing the debt and investment contracts.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication South Asia Development Update, October 2024: Women, Jobs, and Growth(Washington, DC: World Bank, 2024-10-10)South Asia’s growth is on track to exceed earlier expectations, in a broad-based upturn. The region is expected to remain the fastest-growing among emerging market and developing economies (EMDEs). Several risks could upend this generally promising outlook, including extreme weather events, social unrest, and policy missteps, such as reform delays. But South Asian countries also have considerable untapped potential that could help them further boost productivity growth and employment and adapt to climate change. In particular, with about two-thirds of the region’s working-age women out of the labor force, raising female employment rates to those of men could increase per capita income by as much as one-half. Measures to accelerate job creation, remove obstacles to women working, and equalize gender rights would be more effective if combined with a shift toward social norms that looked more favorably on working women. Also, most South Asian countries rank among the EMDEs least open to global trade and investment. Greater openness could boost women’s employment, spur the growth of firms, and allow the region to take better advantage of the reshaping of global supply chains and trade. Reducing the cost of conducting business could help the region better harness large-scale remittance inflows.Publication World Bank East Asia and the Pacific Economic Update, October 2024: Jobs and Technology(Washington, DC: World Bank, 2024-10-07)East Asia and the Pacific, seen in the context of the world economy, stands out as a paragon of development. Despite the recent ravages of the pandemic and the persistent tensions of geopolitics, the region is growing at stably high rates and the benefits are widely shared. But compared to its own past and potential, the region’s economic performance is less impressive. Growth is still below pre-pandemic rates, except in Indonesia, and output has not yet recovered to pre-pandemic levels in several countries, especially in the Pacific. This Economic Update highlights three key developments: shifting regional growth dynamics as China’s growth slows, changing trade patterns due to global tensions, and the impact of technologies such as robots, artificial intelligence, and digital platforms on jobs. The report calls for productivity-enhancing structural reforms to strengthen domestic growth drivers through; deeper international trade agreements to foster more open and stable trade regimes; deeper technical, digital, and soft skills while addressing impediments to labor mobility, factor price distortions and expanding social protection for workers in the digital informal economy to boost productivity and employment.