Publication: Improving the Quality of Survey Estimates from Longitudinal Studies: An Application to LSMS Panel Surveys
Loading...
Date
2025-01-10
ISSN
Published
2025-01-10
Author(s)
Editor(s)
Abstract
Longitudinal surveys are an invaluable source for analyzing the current state of and changes in human populations over time. However, maintaining the accuracy of estimates from a panel sample becomes more difficult as the length of the panel survey increases. Key concerns are the lack of sample representativeness, due to the sample erosion caused by deaths and movers and the impact of new births, and migration flows. Moreover, sample fatigue introduces an increasing measurement error. Correct design, implementation, and use of a panel survey considers a set of methods to deal with these problems at different stages of the statistical process: the sampling design, the data collection, and the estimation. This paper focuses on the case of panels with a rotating sample design. This case represents a powerful hybrid solution for facing the impact of panel dynamics on sample representativeness. Empirically, the paper focuses on the estimation procedures. Using data from the Uganda National Panel Survey, the longest Living Standards Measurement Study panel survey, it experimentally evaluates the suggested technique. In summary, the findings show that the calibrated generalized weight share method base estimator yields individual-level statistics that appear to be more accurate than those produced by the current Uganda National Panel Survey estimator. Additionally, the calibrated generalized weight share method base cross-sectional estimates on the transition matrix show a generally higher degree of stability when the sample is changed compared to the current Uganda National Panel Survey estimates.
Link to Data Set
Citation
“Falorsi, Piero; Righi, Paolo; Ponzini, Giulia. 2025. Improving the Quality of Survey Estimates from Longitudinal Studies: An Application to LSMS Panel Surveys. Policy Research Working Paper; 11026. © World Bank. http://hdl.handle.net/10986/42655 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Effectiveness of Interventions Aimed atImproving Women’s Employability and Quality of Work : A Critical Review(World Bank, Washington, DC, 2012-09)This paper examines the effectiveness of a variety of policy interventions that have been tried in developing and transition economies with the goal of improving women's employability and quality of work. The programs include active labor market programs, education and training programs, programs that facilitate work (such as childcare subsidies, parental leave programs and land titling programs), microfinance programs, entrepreneurship and leadership programs, and conditional cash transfer programs. Some of these policy interventions were undertaken to increase employment, some to increase female employment, and some for other reasons. All of these programs have been subjected to impact evaluations of different kinds and some also to rigorous cost-benefit analyses. Many were found to be effective in increasing women's quantity of work as measured by increased rates of labor market participation and number of hours worked. In some cases, the programs also increased women's quality of work, for example, by increasing the capacity for women to work in the formal rather than the informal sector where wages are higher and where women are more likely to have access to health, retirement, and other benefits.Publication Attrition in Longitudinal Household Survey Data : Some Tests for Three Developing-Country Samples(World Bank, Washington, DC, 2000-09)For capturing dynamic demographic relationships, longitudinal household data can have considerable advantages over more widely used cross-sectional data. But because the collection of longitudinal data may be difficult and expensive, analysts must assess the magnitudes of the problems, specific to longitudinal, but not to cross-sectional data. One problem that concerns many analysts is that sample attrition may make the interpretation of estimates problematic. Such attrition may be especially severe where there is considerable migration between rural, and urban areas. And attrition is likely to be selective on such characteristics as schooling, so high attrition is likely to bias estimates. The authors consider the extent, and implications of attrition for three longitudinal household surveys from Bolivia, Kenya, and South Africa that report very high annual attrition rates between survey rounds. Their estimates indicate that: 1) the means for a number of critical outcome, and family background variables differ significantly between those who are lost to follow-up, and those who are re-interviewed. 2) A number of family background variables are significant predictors of attrition. 3) Nevertheless, the coefficient estimates for standard family background variables in regressions, and probit equations for the majority of outcome variables in all three data sets, are not significantly affected by attrition. So attrition is apparently not a general problem for obtaining consistent estimates of the coefficients of interest for most of these outcomes. These results, which are very similar to those for industrial countries, suggest that multivariate estimates of behavioral relations may not be biased because of attrition. This would support the collection of longitudinal data.Publication Estimating Quarterly Poverty Rates Using Labor Force Surveys : A Primer(World Bank, Washington, DC, 2013-05)The paper shows how Labor Force Surveys can be used effectively to estimate poverty rates using Household Expenditure Surveys and cross-survey imputation methods. With only two rounds of Household Expenditure Survey data for Morocco (2001 and 2007), the paper estimates quarterly poverty rates for the period 2001-2010 by imputing household expenditures into the Labor Force Surveys. The results are encouraging. The methodology is able to accurately reproduce official poverty statistics by combining current Labor Force Surveys with previous period Household Expenditure Surveys, and vice versa. Although the focus is on head-count poverty, the method can be applied to any welfare indicator that is a function of household income or expenditure, such as the poverty gap or the Gini index of inequality. The newly produced time-series of poverty rates can help researchers and policy makers to: (a) study the determinants of poverty reduction or use poverty as an explanatory factor in cross-section and panel models; (b) forecast poverty rates based on a time-series model fitted to the data; and (c) explore the linkages between labor market conditions and poverty and simulate the effects of policy reforms or economic shocks. This is a promising research agenda that can expand significantly the tool-kit of the welfare economist.Publication Findings from the Bhutan Learning Quality Survey(Washington, DC, 2009-01)The education sector in Bhutan has been growing steadily since the 1960s and concomitantly the literacy rates of the population have also been steadily going up over time. The mostly mountainous country regards education as central to its national development. Every cohort has seen an increasing share of children going to school and the education system now strains to keep up with the speed with which enrolment has expanded over the last ten years, in-line with Bhutan's commitment to meet the education Millennium Development Goals (MDGs). This report is structured as follows: section two presents the background and context of Bhutan's education system; section three discusses previous theoretical and empirical literature on education quality; section four describes the sampling design methodology, the sample and empirical methodology used in this study; section five presents findings on students' actual knowledge in three subjects and their corresponding scaled scores; section six presents the results of multivariate regression analysis for estimating school, teacher and child related correlates of learning outcomes; section seven profiles teachers in grades two and four and the education process; and section eight concludes with brief summary, discussion of policy implications, and recommendation for future research.Publication The Microeconomics of Creating Productive Jobs : A Synthesis of Firm-Level Studies in Transition Economies(World Bank, Washington, DC, 2006-04)The challenge for labor market policy in the transition economies has been to redress the sharp drops in employment and rises in unemployment in a way that fosters the creation of productive jobs. The authors first document the magnitude and productivity of job and worker reallocation. Then they investigate the effects of privatization, product and labor market liberalization, and obstacles to growth in the new private sector on reallocation and its productivity in Hungary, Romania, Russia, and Ukraine. The authors find that market reform has resulted in a large increase in the pace of job reallocation, particularly that occurring between sectors and through firm turnover. Unlike under central planning, the job reallocation during the transition has contributed significantly to aggregate productivity growth. Privatization has not only stimulated intrasectoral job reallocation, but the reallocation is more productive than that among remaining state firms. The effect of privatization on firm productivity varies considerably across countries and is not always positive. The productivity gains from privatization have generally not come at the expense of workers but are rather associated with increased wages and employment.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication The Journey Ahead(Washington, DC: World Bank, 2024-10-31)The Journey Ahead: Supporting Successful Migration in Europe and Central Asia provides an in-depth analysis of international migration in Europe and Central Asia (ECA) and the implications for policy making. By identifying challenges and opportunities associated with migration in the region, it aims to inform a more nuanced, evidencebased debate on the costs and benefits of cross-border mobility. Using data-driven insights and new analysis, the report shows that migration has been an engine of prosperity and has helped address some of ECA’s demographic and socioeconomic disparities. Yet, migration’s full economic potential remains untapped. The report identifies multiple barriers keeping migration from achieving its full potential. Crucially, it argues that policies in both origin and destination countries can help maximize the development impacts of migration and effectively manage the economic, social, and political costs. Drawing from a wide range of literature, country experiences, and novel analysis, The Journey Ahead presents actionable policy options to enhance the benefits of migration for destination and origin countries and migrants themselves. Some measures can be taken unilaterally by countries, whereas others require close bilateral or regional coordination. The recommendations are tailored to different types of migration— forced displacement as well as high-skilled and low-skilled economic migration—and from the perspectives of both sending and receiving countries. This report serves as a comprehensive resource for governments, development partners, and other stakeholders throughout Europe and Central Asia, where the richness and diversity of migration experiences provide valuable insights for policy makers in other regions of the world.Publication Women, Business and the Law 2024(Washington, DC: World Bank, 2024-03-04)Women, Business and the Law 2024 is the 10th in a series of annual studies measuring the enabling conditions that affect women’s economic opportunity in 190 economies. To present a more complete picture of the global environment that enables women’s socioeconomic participation, this year Women, Business and the Law introduces two new indicators—Safety and Childcare—and presents findings on the implementation gap between laws (de jure) and how they function in practice (de facto). This study presents three indexes: (1) legal frameworks, (2) supportive frameworks (policies, institutions, services, data, budget, and access to justice), and (3) expert opinions on women’s rights in practice in the areas measured. The study’s 10 indicators—Safety, Mobility, Workplace, Pay, Marriage, Parenthood, Childcare, Entrepreneurship, Assets, and Pension—are structured around the different stages of a woman’s working life. Findings from this new research can inform policy discussions to ensure women’s full and equal participation in the economy. The indicators build evidence of the critical relationship between legal gender equality and women’s employment and entrepreneurship. Data in Women, Business and the Law 2024 are current as of October 1, 2023.Publication Poverty, Prosperity, and Planet Report 2024(Washington, DC: World Bank, 2024-10-15)The Poverty, Prosperity, and Planet Report 2024 is the latest edition of the series formerly known as Poverty and Shared Prosperity. The report emphasizes that reducing poverty and increasing shared prosperity must be achieved in ways that do not come at unacceptably high costs to the environment. The current “polycrisis”—where the multiple crises of slow economic growth, increased fragility, climate risks, and heightened uncertainty have come together at the same time—makes national development strategies and international cooperation difficult. Offering the first post-Coronavirus (COVID)-19 pandemic assessment of global progress on this interlinked agenda, the report finds that global poverty reduction has resumed but at a pace slower than before the COVID-19 crisis. Nearly 700 million people worldwide live in extreme poverty with less than US$2.15 per person per day. Progress has essentially plateaued amid lower economic growth and the impacts of COVID-19 and other crises. Today, extreme poverty is concentrated mostly in Sub-Saharan Africa and fragile settings. At a higher standard more typical of upper-middle-income countries—US$6.85 per person per day—almost one-half of the world is living in poverty. The report also provides evidence that the number of countries that have high levels of income inequality has declined considerably during the past two decades, but the pace of improvements in shared prosperity has slowed, and that inequality remains high in Latin America and the Caribbean and Sub-Saharan Africa. Worldwide, people’s incomes today would need to increase fivefold on average to reach a minimum prosperity threshold of US$25 per person per day. Where there has been progress in poverty reduction and shared prosperity, there is evidence of an increasing ability of countries to manage natural hazards, but climate risks are significantly higher in the poorest settings. Nearly one in five people globally is at risk of experiencing welfare losses due to an extreme weather event from which they will struggle to recover. The interconnected issues of climate change and poverty call for a united and inclusive effort from the global community. Development cooperation stakeholders—from governments, nongovernmental organizations, and the private sector to communities and citizens acting locally in every corner of the globe—hold pivotal roles in promoting fair and sustainable transitions. By emphasizing strategies that yield multiple benefits and diligently monitoring and addressing trade-offs, we can strive toward a future that is prosperous, equitable, and resilient.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.