Publication: Improving the Quality of Survey Estimates from Longitudinal Studies: An Application to LSMS Panel Surveys
Loading...
Date
2025-01-10
ISSN
Published
2025-01-10
Author(s)
Editor(s)
Abstract
Longitudinal surveys are an invaluable source for analyzing the current state of and changes in human populations over time. However, maintaining the accuracy of estimates from a panel sample becomes more difficult as the length of the panel survey increases. Key concerns are the lack of sample representativeness, due to the sample erosion caused by deaths and movers and the impact of new births, and migration flows. Moreover, sample fatigue introduces an increasing measurement error. Correct design, implementation, and use of a panel survey considers a set of methods to deal with these problems at different stages of the statistical process: the sampling design, the data collection, and the estimation. This paper focuses on the case of panels with a rotating sample design. This case represents a powerful hybrid solution for facing the impact of panel dynamics on sample representativeness. Empirically, the paper focuses on the estimation procedures. Using data from the Uganda National Panel Survey, the longest Living Standards Measurement Study panel survey, it experimentally evaluates the suggested technique. In summary, the findings show that the calibrated generalized weight share method base estimator yields individual-level statistics that appear to be more accurate than those produced by the current Uganda National Panel Survey estimator. Additionally, the calibrated generalized weight share method base cross-sectional estimates on the transition matrix show a generally higher degree of stability when the sample is changed compared to the current Uganda National Panel Survey estimates.
Link to Data Set
Citation
“Falorsi, Piero; Righi, Paolo; Ponzini, Giulia. 2025. Improving the Quality of Survey Estimates from Longitudinal Studies: An Application to LSMS Panel Surveys. Policy Research Working Paper; 11026. © World Bank. http://hdl.handle.net/10986/42655 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Tradeoffs over Rate Cycles(Washington, DC: World Bank, 2025-05-23)Central banks often face tradeoffs in how their monetary policy decisions impact economic activity (including employment), inflation and the price level. This paper assesses how these tradeoffs have evolved over time and varied across countries, with a focus on understanding the post-pandemic adjustment. To make these comparisons, we compile a cross-country, historical database of “rate cycles” (i.e., easing and tightening phases for monetary policy) for 24 advanced economies from 1970 through 2024. This allows us to quantify the characteristics of interest rate adjustments and corresponding macroeconomic outcomes and tradeoffs. We also calculate Sacrifice Ratios (output losses per inflation reduction) and document a historically low “sacrifice” during the post-pandemic tightening. This popular measure, however, ignores adjustments in the price level—which increased by more after the pandemic than over the past four decades. A series of regressions and simulations suggest monetary policy (and particularly the timing and aggressiveness of rate hikes) play a meaningful role in explaining these tradeoffs and how adjustments occur during tightening phases. Central bank credibility is the one measure we assess that corresponds to only positive outcomes and no difficult tradeoffs.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Chalkboards to Chatbots(Washington, DC: World Bank, 2025-05-20)This study evaluates the impact of a program leveraging large language models for virtual tutoring in secondary education in Nigeria. Using a randomized controlled trial, the program deployed Microsoft Copilot (powered by GPT-4) to support first-year senior secondary students in English language learning over six weeks. The intervention demonstrated a significant improvement of 0.31 standard deviation on an assessment that included English topics aligned with the Nigerian curriculum, knowledge of artificial intelligence and digital skills. The effect on English, the main outcome of interest, was of 0.23 standard deviations. Cost-effectiveness analysis revealed substantial learning gains, equating to 1.5 to 2 years of ’business-as-usual’ schooling, situating the intervention among some of the most cost-effective programs to improve learning outcomes. An analysis of heterogeneous effects shows that while the program benefits students across the baseline ability distribution, the largest effects are for female students, and those with higher initial academic performance. The findings highlight that artificial intelligence-powered tutoring, when designed and used properly, can have transformative impacts in the education sector in low-resource settings.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Effectiveness of Interventions Aimed atImproving Women’s Employability and Quality of Work : A Critical Review(World Bank, Washington, DC, 2012-09)This paper examines the effectiveness of a variety of policy interventions that have been tried in developing and transition economies with the goal of improving women's employability and quality of work. The programs include active labor market programs, education and training programs, programs that facilitate work (such as childcare subsidies, parental leave programs and land titling programs), microfinance programs, entrepreneurship and leadership programs, and conditional cash transfer programs. Some of these policy interventions were undertaken to increase employment, some to increase female employment, and some for other reasons. All of these programs have been subjected to impact evaluations of different kinds and some also to rigorous cost-benefit analyses. Many were found to be effective in increasing women's quantity of work as measured by increased rates of labor market participation and number of hours worked. In some cases, the programs also increased women's quality of work, for example, by increasing the capacity for women to work in the formal rather than the informal sector where wages are higher and where women are more likely to have access to health, retirement, and other benefits.Publication Attrition in Longitudinal Household Survey Data : Some Tests for Three Developing-Country Samples(World Bank, Washington, DC, 2000-09)For capturing dynamic demographic relationships, longitudinal household data can have considerable advantages over more widely used cross-sectional data. But because the collection of longitudinal data may be difficult and expensive, analysts must assess the magnitudes of the problems, specific to longitudinal, but not to cross-sectional data. One problem that concerns many analysts is that sample attrition may make the interpretation of estimates problematic. Such attrition may be especially severe where there is considerable migration between rural, and urban areas. And attrition is likely to be selective on such characteristics as schooling, so high attrition is likely to bias estimates. The authors consider the extent, and implications of attrition for three longitudinal household surveys from Bolivia, Kenya, and South Africa that report very high annual attrition rates between survey rounds. Their estimates indicate that: 1) the means for a number of critical outcome, and family background variables differ significantly between those who are lost to follow-up, and those who are re-interviewed. 2) A number of family background variables are significant predictors of attrition. 3) Nevertheless, the coefficient estimates for standard family background variables in regressions, and probit equations for the majority of outcome variables in all three data sets, are not significantly affected by attrition. So attrition is apparently not a general problem for obtaining consistent estimates of the coefficients of interest for most of these outcomes. These results, which are very similar to those for industrial countries, suggest that multivariate estimates of behavioral relations may not be biased because of attrition. This would support the collection of longitudinal data.Publication Estimating Quarterly Poverty Rates Using Labor Force Surveys : A Primer(World Bank, Washington, DC, 2013-05)The paper shows how Labor Force Surveys can be used effectively to estimate poverty rates using Household Expenditure Surveys and cross-survey imputation methods. With only two rounds of Household Expenditure Survey data for Morocco (2001 and 2007), the paper estimates quarterly poverty rates for the period 2001-2010 by imputing household expenditures into the Labor Force Surveys. The results are encouraging. The methodology is able to accurately reproduce official poverty statistics by combining current Labor Force Surveys with previous period Household Expenditure Surveys, and vice versa. Although the focus is on head-count poverty, the method can be applied to any welfare indicator that is a function of household income or expenditure, such as the poverty gap or the Gini index of inequality. The newly produced time-series of poverty rates can help researchers and policy makers to: (a) study the determinants of poverty reduction or use poverty as an explanatory factor in cross-section and panel models; (b) forecast poverty rates based on a time-series model fitted to the data; and (c) explore the linkages between labor market conditions and poverty and simulate the effects of policy reforms or economic shocks. This is a promising research agenda that can expand significantly the tool-kit of the welfare economist.Publication Findings from the Bhutan Learning Quality Survey(Washington, DC, 2009-01)The education sector in Bhutan has been growing steadily since the 1960s and concomitantly the literacy rates of the population have also been steadily going up over time. The mostly mountainous country regards education as central to its national development. Every cohort has seen an increasing share of children going to school and the education system now strains to keep up with the speed with which enrolment has expanded over the last ten years, in-line with Bhutan's commitment to meet the education Millennium Development Goals (MDGs). This report is structured as follows: section two presents the background and context of Bhutan's education system; section three discusses previous theoretical and empirical literature on education quality; section four describes the sampling design methodology, the sample and empirical methodology used in this study; section five presents findings on students' actual knowledge in three subjects and their corresponding scaled scores; section six presents the results of multivariate regression analysis for estimating school, teacher and child related correlates of learning outcomes; section seven profiles teachers in grades two and four and the education process; and section eight concludes with brief summary, discussion of policy implications, and recommendation for future research.Publication The Microeconomics of Creating Productive Jobs : A Synthesis of Firm-Level Studies in Transition Economies(World Bank, Washington, DC, 2006-04)The challenge for labor market policy in the transition economies has been to redress the sharp drops in employment and rises in unemployment in a way that fosters the creation of productive jobs. The authors first document the magnitude and productivity of job and worker reallocation. Then they investigate the effects of privatization, product and labor market liberalization, and obstacles to growth in the new private sector on reallocation and its productivity in Hungary, Romania, Russia, and Ukraine. The authors find that market reform has resulted in a large increase in the pace of job reallocation, particularly that occurring between sectors and through firm turnover. Unlike under central planning, the job reallocation during the transition has contributed significantly to aggregate productivity growth. Privatization has not only stimulated intrasectoral job reallocation, but the reallocation is more productive than that among remaining state firms. The effect of privatization on firm productivity varies considerably across countries and is not always positive. The productivity gains from privatization have generally not come at the expense of workers but are rather associated with increased wages and employment.
Users also downloaded
Showing related downloaded files
Publication Poverty, Prosperity, and Planet Report 2024(Washington, DC: World Bank, 2024-10-15)The Poverty, Prosperity, and Planet Report 2024 is the latest edition of the series formerly known as Poverty and Shared Prosperity. The report emphasizes that reducing poverty and increasing shared prosperity must be achieved in ways that do not come at unacceptably high costs to the environment. The current “polycrisis”—where the multiple crises of slow economic growth, increased fragility, climate risks, and heightened uncertainty have come together at the same time—makes national development strategies and international cooperation difficult. Offering the first post-Coronavirus (COVID)-19 pandemic assessment of global progress on this interlinked agenda, the report finds that global poverty reduction has resumed but at a pace slower than before the COVID-19 crisis. Nearly 700 million people worldwide live in extreme poverty with less than US$2.15 per person per day. Progress has essentially plateaued amid lower economic growth and the impacts of COVID-19 and other crises. Today, extreme poverty is concentrated mostly in Sub-Saharan Africa and fragile settings. At a higher standard more typical of upper-middle-income countries—US$6.85 per person per day—almost one-half of the world is living in poverty. The report also provides evidence that the number of countries that have high levels of income inequality has declined considerably during the past two decades, but the pace of improvements in shared prosperity has slowed, and that inequality remains high in Latin America and the Caribbean and Sub-Saharan Africa. Worldwide, people’s incomes today would need to increase fivefold on average to reach a minimum prosperity threshold of US$25 per person per day. Where there has been progress in poverty reduction and shared prosperity, there is evidence of an increasing ability of countries to manage natural hazards, but climate risks are significantly higher in the poorest settings. Nearly one in five people globally is at risk of experiencing welfare losses due to an extreme weather event from which they will struggle to recover. The interconnected issues of climate change and poverty call for a united and inclusive effort from the global community. Development cooperation stakeholders—from governments, nongovernmental organizations, and the private sector to communities and citizens acting locally in every corner of the globe—hold pivotal roles in promoting fair and sustainable transitions. By emphasizing strategies that yield multiple benefits and diligently monitoring and addressing trade-offs, we can strive toward a future that is prosperous, equitable, and resilient.Publication Expanding Financial Inclusion through Digital Financial Services(Washington, DC: World Bank, 2024-12-23)Worldwide, account ownership increased by 50 percent in the 10 years spanning 2011 to 2021, to reach 76 percent of the global adult population. The goal of financial inclusion is not just for more adults to have accounts but for account owners to benefit from using them, such as for digital payments, which provide a range of positive benefits that extend far beyond convenience. This paper reviews the evidence demonstrating how digital payments can expand financial inclusion among recipients and encourage the use of additional formal financial services, such as savings, credit, and insurance. It explores how digital transactions offer greater security and privacy, especially for women, as well as opportunities to build a digital credit history for credit risk assessments. The introduction of digital payments to low-income adults brings some risks, however, such as fraud and phishing scams targeting accounts, over indebtedness in digital credit, and customers receiving incomplete or incorrect information on the fees and costs of financial products.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.